[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:58:22.178122   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37199
I20260709 12:58:22.179595   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:58:22.180534   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:22.197180   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:22.197192   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:22.200356   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.380443   439 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1181 milliseconds
I20260709 12:58:23.380550   431 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:58:23.381809   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:23.382046   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:23.382246   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601903382222 us; error 0 us; skew 500 ppm
I20260709 12:58:23.383078   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:23.389226   431 webserver.cc:533] Webserver started at http://127.0.107.254:41335/ using document root <none> and password file <none>
I20260709 12:58:23.390044   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:23.390275   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:23.390748   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:23.396622   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/master-0-root/instance:
uuid: "c77bcda340f04519969e7c16ee79f9c0"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-szgt"
I20260709 12:58:23.404270   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:23.409395   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.410470   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:58:23.410838   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/master-0-root
uuid: "c77bcda340f04519969e7c16ee79f9c0"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-szgt"
I20260709 12:58:23.411154   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:23.472456   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:23.473927   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:58:23.474808   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:23.548713   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37199
I20260709 12:58:23.548770   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37199 every 8 connection(s)
I20260709 12:58:23.556483   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.577167   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0: Bootstrap starting.
I20260709 12:58:23.582926   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.584611   498 log.cc:826] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0: Log is configured to *not* fsync() on all Append() calls
I20260709 12:58:23.588984   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0: No bootstrap required, opened a new log
I20260709 12:58:23.609261   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77bcda340f04519969e7c16ee79f9c0" member_type: VOTER }
I20260709 12:58:23.609764   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.610397   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c77bcda340f04519969e7c16ee79f9c0, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.611253   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77bcda340f04519969e7c16ee79f9c0" member_type: VOTER }
I20260709 12:58:23.611719   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:23.611999   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:23.612318   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.616081   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77bcda340f04519969e7c16ee79f9c0" member_type: VOTER }
I20260709 12:58:23.616729   498 leader_election.cc:304] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c77bcda340f04519969e7c16ee79f9c0; no voters: 
I20260709 12:58:23.618664   498 leader_election.cc:290] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:23.619041   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:23.621837   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 1 LEADER]: Becoming Leader. State: Replica: c77bcda340f04519969e7c16ee79f9c0, State: Running, Role: LEADER
I20260709 12:58:23.622661   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77bcda340f04519969e7c16ee79f9c0" member_type: VOTER }
I20260709 12:58:23.624130   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:23.635298   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c77bcda340f04519969e7c16ee79f9c0. Latest consensus state: current_term: 1 leader_uuid: "c77bcda340f04519969e7c16ee79f9c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77bcda340f04519969e7c16ee79f9c0" member_type: VOTER } }
I20260709 12:58:23.636086   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:23.635618   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c77bcda340f04519969e7c16ee79f9c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77bcda340f04519969e7c16ee79f9c0" member_type: VOTER } }
I20260709 12:58:23.636864   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:23.639331   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:23.652725   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:23.655001   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:23.669569   511 catalog_manager.cc:1383] Generated new cluster ID: 69727e5153f543eaa325f71e39472b89
I20260709 12:58:23.669874   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:23.681360   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:23.682647   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:23.698246   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0: Generated new TSK 0
I20260709 12:58:23.699055   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:23.721793   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:23.732921   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.732916   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.737311   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:23.737552   431 server_base.cc:1061] running on GCE node
I20260709 12:58:23.738472   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:23.738750   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:23.738965   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601903738946 us; error 0 us; skew 500 ppm
I20260709 12:58:23.739883   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:23.743933   431 webserver.cc:533] Webserver started at http://127.0.107.193:41461/ using document root <none> and password file <none>
I20260709 12:58:23.744632   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:23.744895   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:23.745321   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:23.746784   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-0-root/instance:
uuid: "167adef003144f679f4ca961edac8d31"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-szgt"
I20260709 12:58:23.753783   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:23.759068   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.759889   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:58:23.760222   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "167adef003144f679f4ca961edac8d31"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-szgt"
I20260709 12:58:23.760594   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:23.785477   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:23.787467   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:23.789964   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:23.795125   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:23.795416   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.795717   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:23.795933   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.891350   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43159
I20260709 12:58:23.891381   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43159 every 8 connection(s)
I20260709 12:58:23.900607   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:23.910387   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.915735   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.920389   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:23.923177   431 server_base.cc:1061] running on GCE node
I20260709 12:58:23.923998   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:23.924165   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:23.924353   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601903924327 us; error 0 us; skew 500 ppm
I20260709 12:58:23.924937   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:23.927505   431 webserver.cc:533] Webserver started at http://127.0.107.194:42857/ using document root <none> and password file <none>
I20260709 12:58:23.927965   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:23.928195   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:23.928529   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:23.929910   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-1-root/instance:
uuid: "3ef331b90a594e6489dfd39ebaee3224"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-szgt"
I20260709 12:58:23.931579   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37199
I20260709 12:58:23.932016   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:23.933135   591 heartbeater.cc:507] Master 127.0.107.254:37199 requested a full tablet report, sending...
I20260709 12:58:23.936681   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:58:23.936568   463 ts_manager.cc:194] Registered new tserver with Master: 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159)
I20260709 12:58:23.939576   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58550
I20260709 12:58:23.941358   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.942498   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:58:23.942816   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-1-root
uuid: "3ef331b90a594e6489dfd39ebaee3224"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-szgt"
I20260709 12:58:23.943143   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:23.970659   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:23.972220   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:23.974999   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:23.978734   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:23.978988   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.979264   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:23.979465   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:24.081462   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:41591
I20260709 12:58:24.081535   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:41591 every 8 connection(s)
I20260709 12:58:24.089015   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:24.097040   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:24.099888   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:24.105845   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37199
I20260709 12:58:24.106213   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:24.107860   666 heartbeater.cc:507] Master 127.0.107.254:37199 requested a full tablet report, sending...
I20260709 12:58:24.108842   431 server_base.cc:1061] running on GCE node
W20260709 12:58:24.108862   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:24.110074   463 ts_manager.cc:194] Registered new tserver with Master: 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:24.110435   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:24.110714   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:24.110901   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601904110886 us; error 0 us; skew 500 ppm
I20260709 12:58:24.111392   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58554
I20260709 12:58:24.111598   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:24.114392   431 webserver.cc:533] Webserver started at http://127.0.107.195:42943/ using document root <none> and password file <none>
I20260709 12:58:24.114965   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:24.115177   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:24.115456   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:24.116808   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-2-root/instance:
uuid: "b617c79595224797a4fa2ceda67ef9a3"
format_stamp: "Formatted at 2026-07-09 12:58:24 on dist-test-slave-szgt"
I20260709 12:58:24.122314   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:58:24.126523   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:24.127276   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:58:24.127579   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-2-root
uuid: "b617c79595224797a4fa2ceda67ef9a3"
format_stamp: "Formatted at 2026-07-09 12:58:24 on dist-test-slave-szgt"
I20260709 12:58:24.127899   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601902018772-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:24.147493   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:24.149055   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:24.150556   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:24.153173   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:24.153410   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:24.153672   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:24.153867   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:24.242053   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41099
I20260709 12:58:24.242105   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41099 every 8 connection(s)
I20260709 12:58:24.259965   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37199
I20260709 12:58:24.260310   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:24.260973   740 heartbeater.cc:507] Master 127.0.107.254:37199 requested a full tablet report, sending...
I20260709 12:58:24.262812   463 ts_manager.cc:194] Registered new tserver with Master: b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:24.262984   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015477029s
I20260709 12:58:24.264086   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58564
I20260709 12:58:24.313251   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58574:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:24.316620   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:24.418751   703 tablet_service.cc:1511] Processing CreateTablet for tablet fbebec53d4bb45ee9cedd32e3702cc7c (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:24.419772   704 tablet_service.cc:1511] Processing CreateTablet for tablet 82f172eef8a84cb68f23efe20d9818a0 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:24.420367   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbebec53d4bb45ee9cedd32e3702cc7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.421202   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f172eef8a84cb68f23efe20d9818a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.423494   702 tablet_service.cc:1511] Processing CreateTablet for tablet ef8743d3bfde49d9b57d8fa59461605f (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:24.424736   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8743d3bfde49d9b57d8fa59461605f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.418066   705 tablet_service.cc:1511] Processing CreateTablet for tablet 48f7b8d019004d1bb34f4e9f883722eb (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:24.432065   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f7b8d019004d1bb34f4e9f883722eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.426579   701 tablet_service.cc:1511] Processing CreateTablet for tablet 9f51f3b2e11f49609d25b8ff5730df87 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:24.435062   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f51f3b2e11f49609d25b8ff5730df87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.436594   700 tablet_service.cc:1511] Processing CreateTablet for tablet f36934cab51c48c6a541ebcef13e9c03 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:24.438076   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36934cab51c48c6a541ebcef13e9c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.455648   699 tablet_service.cc:1511] Processing CreateTablet for tablet fbd1dce5aaa7422c841d31ec641e1fd1 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:24.457517   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd1dce5aaa7422c841d31ec641e1fd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.471161   698 tablet_service.cc:1511] Processing CreateTablet for tablet 679ee1b0217c4e74980b16f699151bd7 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:24.474037   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 679ee1b0217c4e74980b16f699151bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.481828   697 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6b4f0a2ecd4c0887602048721f7c46 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:24.484123   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6b4f0a2ecd4c0887602048721f7c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.506800   631 tablet_service.cc:1511] Processing CreateTablet for tablet 48f7b8d019004d1bb34f4e9f883722eb (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:24.515419   628 tablet_service.cc:1511] Processing CreateTablet for tablet ef8743d3bfde49d9b57d8fa59461605f (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:24.517274   626 tablet_service.cc:1511] Processing CreateTablet for tablet f36934cab51c48c6a541ebcef13e9c03 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:24.522207   758 tablet_bootstrap.cc:492] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3: Bootstrap starting.
I20260709 12:58:24.521535   625 tablet_service.cc:1511] Processing CreateTablet for tablet fbd1dce5aaa7422c841d31ec641e1fd1 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:24.514124   630 tablet_service.cc:1511] Processing CreateTablet for tablet 82f172eef8a84cb68f23efe20d9818a0 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:24.514153   556 tablet_service.cc:1511] Processing CreateTablet for tablet 48f7b8d019004d1bb34f4e9f883722eb (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:24.515539   627 tablet_service.cc:1511] Processing CreateTablet for tablet 9f51f3b2e11f49609d25b8ff5730df87 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:24.515592   629 tablet_service.cc:1511] Processing CreateTablet for tablet fbebec53d4bb45ee9cedd32e3702cc7c (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:24.530575   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f7b8d019004d1bb34f4e9f883722eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.521584   624 tablet_service.cc:1511] Processing CreateTablet for tablet 679ee1b0217c4e74980b16f699151bd7 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:24.517392   555 tablet_service.cc:1511] Processing CreateTablet for tablet 82f172eef8a84cb68f23efe20d9818a0 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:24.532333   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f7b8d019004d1bb34f4e9f883722eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.537928   623 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6b4f0a2ecd4c0887602048721f7c46 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:24.530509   554 tablet_service.cc:1511] Processing CreateTablet for tablet fbebec53d4bb45ee9cedd32e3702cc7c (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:24.541407   552 tablet_service.cc:1511] Processing CreateTablet for tablet 9f51f3b2e11f49609d25b8ff5730df87 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:24.548552   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f172eef8a84cb68f23efe20d9818a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.547789   550 tablet_service.cc:1511] Processing CreateTablet for tablet fbd1dce5aaa7422c841d31ec641e1fd1 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:24.541467   551 tablet_service.cc:1511] Processing CreateTablet for tablet f36934cab51c48c6a541ebcef13e9c03 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:24.547215   553 tablet_service.cc:1511] Processing CreateTablet for tablet ef8743d3bfde49d9b57d8fa59461605f (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:24.553529   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f51f3b2e11f49609d25b8ff5730df87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.553586   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbebec53d4bb45ee9cedd32e3702cc7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.556280   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f51f3b2e11f49609d25b8ff5730df87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.561733   548 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6b4f0a2ecd4c0887602048721f7c46 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:24.560578   549 tablet_service.cc:1511] Processing CreateTablet for tablet 679ee1b0217c4e74980b16f699151bd7 (DEFAULT_TABLE table=test-workload [id=e36277d3394e4455b9139559911116c7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:24.564347   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8743d3bfde49d9b57d8fa59461605f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.565989   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8743d3bfde49d9b57d8fa59461605f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.567320   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6b4f0a2ecd4c0887602048721f7c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.569792   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd1dce5aaa7422c841d31ec641e1fd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.571895   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36934cab51c48c6a541ebcef13e9c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.573235   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 679ee1b0217c4e74980b16f699151bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.577903   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbebec53d4bb45ee9cedd32e3702cc7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.589865   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd1dce5aaa7422c841d31ec641e1fd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.618837   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36934cab51c48c6a541ebcef13e9c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.630930   758 tablet_bootstrap.cc:654] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.628239   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f172eef8a84cb68f23efe20d9818a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.633044   759 tablet_bootstrap.cc:492] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31: Bootstrap starting.
W20260709 12:58:24.641287   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:24.649317   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 679ee1b0217c4e74980b16f699151bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.651600   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6b4f0a2ecd4c0887602048721f7c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.670885   759 tablet_bootstrap.cc:654] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.704716   761 tablet_bootstrap.cc:492] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224: Bootstrap starting.
I20260709 12:58:24.716970   758 tablet_bootstrap.cc:492] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3: No bootstrap required, opened a new log
I20260709 12:58:24.725672   758 ts_tablet_manager.cc:1403] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3: Time spent bootstrapping tablet: real 0.220s	user 0.012s	sys 0.020s
I20260709 12:58:24.731555   761 tablet_bootstrap.cc:654] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.732116   758 raft_consensus.cc:359] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.733362   758 raft_consensus.cc:385] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.733804   758 raft_consensus.cc:740] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.734797   759 tablet_bootstrap.cc:492] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31: No bootstrap required, opened a new log
I20260709 12:58:24.734602   758 consensus_queue.cc:260] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.735255   759 ts_tablet_manager.cc:1403] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.013s
I20260709 12:58:24.738616   740 heartbeater.cc:499] Master 127.0.107.254:37199 was elected leader, sending a full tablet report...
I20260709 12:58:24.739209   758 ts_tablet_manager.cc:1434] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.008s
I20260709 12:58:24.739512   759 raft_consensus.cc:359] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.741398   759 raft_consensus.cc:385] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.741503   758 tablet_bootstrap.cc:492] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3: Bootstrap starting.
I20260709 12:58:24.741701   759 raft_consensus.cc:740] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.742388   759 consensus_queue.cc:260] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.746982   761 tablet_bootstrap.cc:492] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224: No bootstrap required, opened a new log
I20260709 12:58:24.747365   761 ts_tablet_manager.cc:1403] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.001s
W20260709 12:58:24.748915   741 tablet.cc:2406] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:24.750388   591 heartbeater.cc:499] Master 127.0.107.254:37199 was elected leader, sending a full tablet report...
I20260709 12:58:24.751010   761 raft_consensus.cc:359] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.751708   761 raft_consensus.cc:385] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.751981   761 raft_consensus.cc:740] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.752642   761 consensus_queue.cc:260] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.753517   758 tablet_bootstrap.cc:654] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.754281   759 ts_tablet_manager.cc:1434] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.002s
I20260709 12:58:24.757184   759 tablet_bootstrap.cc:492] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31: Bootstrap starting.
I20260709 12:58:24.766885   759 tablet_bootstrap.cc:654] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.774278   666 heartbeater.cc:499] Master 127.0.107.254:37199 was elected leader, sending a full tablet report...
I20260709 12:58:24.775148   761 ts_tablet_manager.cc:1434] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 12:58:24.776404   761 tablet_bootstrap.cc:492] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224: Bootstrap starting.
I20260709 12:58:24.782753   758 tablet_bootstrap.cc:492] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3: No bootstrap required, opened a new log
I20260709 12:58:24.783285   758 ts_tablet_manager.cc:1403] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 12:58:24.786548   758 raft_consensus.cc:359] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.788350   758 raft_consensus.cc:385] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.788702   758 raft_consensus.cc:740] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.789456   758 consensus_queue.cc:260] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.792121   758 ts_tablet_manager.cc:1434] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:58:24.792660   759 tablet_bootstrap.cc:492] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31: No bootstrap required, opened a new log
I20260709 12:58:24.793033   759 ts_tablet_manager.cc:1403] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.003s
I20260709 12:58:24.793424   758 tablet_bootstrap.cc:492] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3: Bootstrap starting.
I20260709 12:58:24.795503   759 raft_consensus.cc:359] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.796162   759 raft_consensus.cc:385] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.796443   759 raft_consensus.cc:740] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.800493   758 tablet_bootstrap.cc:654] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.803725   761 tablet_bootstrap.cc:654] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.806917   759 consensus_queue.cc:260] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.810078   759 ts_tablet_manager.cc:1434] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:58:24.810906   759 tablet_bootstrap.cc:492] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31: Bootstrap starting.
I20260709 12:58:24.811389   758 tablet_bootstrap.cc:492] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3: No bootstrap required, opened a new log
I20260709 12:58:24.811826   758 ts_tablet_manager.cc:1403] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:58:24.815569   758 raft_consensus.cc:359] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.816285   758 raft_consensus.cc:385] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.816596   758 raft_consensus.cc:740] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.817119   759 tablet_bootstrap.cc:654] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.817476   758 consensus_queue.cc:260] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.821141   761 tablet_bootstrap.cc:492] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224: No bootstrap required, opened a new log
I20260709 12:58:24.821601   761 ts_tablet_manager.cc:1403] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 12:58:24.822402   758 ts_tablet_manager.cc:1434] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:58:24.823343   758 tablet_bootstrap.cc:492] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3: Bootstrap starting.
I20260709 12:58:24.824695   761 raft_consensus.cc:359] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.825341   761 raft_consensus.cc:385] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.825639   761 raft_consensus.cc:740] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.826319   761 consensus_queue.cc:260] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.833576   761 ts_tablet_manager.cc:1434] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:58:24.834759   761 tablet_bootstrap.cc:492] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224: Bootstrap starting.
I20260709 12:58:24.842921   758 tablet_bootstrap.cc:654] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.845012   761 tablet_bootstrap.cc:654] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.848177   759 tablet_bootstrap.cc:492] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31: No bootstrap required, opened a new log
I20260709 12:58:24.848769   759 ts_tablet_manager.cc:1403] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.016s
I20260709 12:58:24.852603   759 raft_consensus.cc:359] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.854909   759 raft_consensus.cc:385] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.855343   759 raft_consensus.cc:740] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.856055   758 tablet_bootstrap.cc:492] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3: No bootstrap required, opened a new log
I20260709 12:58:24.856523   759 consensus_queue.cc:260] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.856501   758 ts_tablet_manager.cc:1403] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.012s
I20260709 12:58:24.859153   759 ts_tablet_manager.cc:1434] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:58:24.860028   761 tablet_bootstrap.cc:492] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224: No bootstrap required, opened a new log
I20260709 12:58:24.860386   759 tablet_bootstrap.cc:492] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31: Bootstrap starting.
I20260709 12:58:24.860425   761 ts_tablet_manager.cc:1403] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 12:58:24.864533   761 raft_consensus.cc:359] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.865301   761 raft_consensus.cc:385] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.865641   761 raft_consensus.cc:740] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.865267   763 raft_consensus.cc:493] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.866185   763 raft_consensus.cc:515] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.866274   761 consensus_queue.cc:260] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.867199   758 raft_consensus.cc:359] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.867815   758 raft_consensus.cc:385] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.868080   758 raft_consensus.cc:740] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.868609   761 ts_tablet_manager.cc:1434] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:58:24.868737   758 consensus_queue.cc:260] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.869557   761 tablet_bootstrap.cc:492] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224: Bootstrap starting.
I20260709 12:58:24.874157   759 tablet_bootstrap.cc:654] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.876004   761 tablet_bootstrap.cc:654] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.880350   763 leader_election.cc:290] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:24.890319   758 ts_tablet_manager.cc:1434] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.008s
I20260709 12:58:24.891633   758 tablet_bootstrap.cc:492] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3: Bootstrap starting.
I20260709 12:58:24.897902   758 tablet_bootstrap.cc:654] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.898485   774 raft_consensus.cc:493] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.899205   774 raft_consensus.cc:515] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.901858   774 leader_election.cc:290] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:24.907166   759 tablet_bootstrap.cc:492] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31: No bootstrap required, opened a new log
I20260709 12:58:24.907780   759 ts_tablet_manager.cc:1403] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.006s
I20260709 12:58:24.911798   758 tablet_bootstrap.cc:492] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3: No bootstrap required, opened a new log
I20260709 12:58:24.912206   758 ts_tablet_manager.cc:1403] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:58:24.917969   758 raft_consensus.cc:359] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.919046   758 raft_consensus.cc:385] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.919314   758 raft_consensus.cc:740] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.920184   758 consensus_queue.cc:260] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.921192   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:24.921962   759 raft_consensus.cc:359] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.922596   759 raft_consensus.cc:385] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.923025   758 ts_tablet_manager.cc:1434] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.007s
I20260709 12:58:24.923112   759 raft_consensus.cc:740] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.923693   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:24.924719   565 raft_consensus.cc:2468] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 0.
I20260709 12:58:24.924635   759 consensus_queue.cc:260] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.927187   758 tablet_bootstrap.cc:492] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3: Bootstrap starting.
W20260709 12:58:24.926956   678 leader_election.cc:343] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.931615   759 ts_tablet_manager.cc:1434] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:58:24.932821   678 leader_election.cc:304] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:24.933228   759 tablet_bootstrap.cc:492] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31: Bootstrap starting.
I20260709 12:58:24.933761   774 raft_consensus.cc:2804] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.926937   761 tablet_bootstrap.cc:492] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224: No bootstrap required, opened a new log
I20260709 12:58:24.934109   774 raft_consensus.cc:493] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.935681   774 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.936908   761 ts_tablet_manager.cc:1403] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.010s
I20260709 12:58:24.943832   759 tablet_bootstrap.cc:654] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.943684   761 raft_consensus.cc:359] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.947129   761 raft_consensus.cc:385] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.947412   761 raft_consensus.cc:740] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.948312   774 raft_consensus.cc:515] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.948374   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:24.951442   774 leader_election.cc:290] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:24.951680   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:24.951968   761 consensus_queue.cc:260] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.952431   758 tablet_bootstrap.cc:654] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.957298   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:24.958068   565 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.955436   761 ts_tablet_manager.cc:1434] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:58:24.961685   761 tablet_bootstrap.cc:492] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224: Bootstrap starting.
W20260709 12:58:24.967172   678 leader_election.cc:343] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.969648   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:24.967934   678 leader_election.cc:304] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b617c79595224797a4fa2ceda67ef9a3; no voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:24.973620   774 raft_consensus.cc:2749] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:24.974081   678 leader_election.cc:343] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:24.975086   678 leader_election.cc:343] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.976277   565 raft_consensus.cc:2468] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 1.
I20260709 12:58:24.977854   678 leader_election.cc:304] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:24.978875   774 raft_consensus.cc:2804] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.979331   774 raft_consensus.cc:697] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Becoming Leader. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:24.980120   774 consensus_queue.cc:237] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.981877   761 tablet_bootstrap.cc:654] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.990551   763 raft_consensus.cc:493] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.991144   759 tablet_bootstrap.cc:492] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31: No bootstrap required, opened a new log
I20260709 12:58:24.991694   759 ts_tablet_manager.cc:1403] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.022s
I20260709 12:58:24.991163   763 raft_consensus.cc:515] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.993764   763 leader_election.cc:290] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159)
I20260709 12:58:24.994725   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:24.994233   759 raft_consensus.cc:359] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.995080   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:24.995299   759 raft_consensus.cc:385] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.995592   759 raft_consensus.cc:740] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.995594   565 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 0.
W20260709 12:58:24.995931   678 leader_election.cc:343] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.996338   759 consensus_queue.cc:260] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:24.996660   678 leader_election.cc:304] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:24.997599   763 raft_consensus.cc:2804] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.997984   763 raft_consensus.cc:493] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.998189   759 ts_tablet_manager.cc:1434] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:58:24.998368   763 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.002337   761 tablet_bootstrap.cc:492] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224: No bootstrap required, opened a new log
I20260709 12:58:25.002789   761 ts_tablet_manager.cc:1403] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.007s
I20260709 12:58:25.005731   758 tablet_bootstrap.cc:492] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3: No bootstrap required, opened a new log
I20260709 12:58:25.005836   761 raft_consensus.cc:359] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.006491   761 raft_consensus.cc:385] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.006862   759 tablet_bootstrap.cc:492] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31: Bootstrap starting.
I20260709 12:58:25.008315   761 raft_consensus.cc:740] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.006163   758 ts_tablet_manager.cc:1403] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3: Time spent bootstrapping tablet: real 0.079s	user 0.027s	sys 0.006s
I20260709 12:58:25.006176   763 raft_consensus.cc:515] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.011310   763 leader_election.cc:290] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159)
I20260709 12:58:25.006844   461 catalog_manager.cc:5697] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b617c79595224797a4fa2ceda67ef9a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.009160   761 consensus_queue.cc:260] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.013581   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:25.014112   565 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.015372   761 ts_tablet_manager.cc:1434] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:58:25.016223   761 tablet_bootstrap.cc:492] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224: Bootstrap starting.
I20260709 12:58:25.017602   759 tablet_bootstrap.cc:654] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.023058   761 tablet_bootstrap.cc:654] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.025983   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
W20260709 12:58:25.028051   678 leader_election.cc:343] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.030411   759 tablet_bootstrap.cc:492] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31: No bootstrap required, opened a new log
I20260709 12:58:25.030869   759 ts_tablet_manager.cc:1403] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 12:58:25.031215   565 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 1.
I20260709 12:58:25.032665   678 leader_election.cc:304] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:25.033556   763 raft_consensus.cc:2804] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.033993   763 raft_consensus.cc:697] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Becoming Leader. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:25.034667   763 consensus_queue.cc:237] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.035554   758 raft_consensus.cc:359] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.036649   758 raft_consensus.cc:385] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.037065   758 raft_consensus.cc:740] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.038208   758 consensus_queue.cc:260] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.040995   758 ts_tablet_manager.cc:1434] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 12:58:25.041138   759 raft_consensus.cc:359] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.041870   759 raft_consensus.cc:385] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.042168   759 raft_consensus.cc:740] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.042371   758 tablet_bootstrap.cc:492] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3: Bootstrap starting.
I20260709 12:58:25.042917   759 consensus_queue.cc:260] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.049239   759 ts_tablet_manager.cc:1434] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:58:25.050519   765 raft_consensus.cc:493] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.055141   759 tablet_bootstrap.cc:492] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31: Bootstrap starting.
I20260709 12:58:25.053534   766 raft_consensus.cc:493] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.056384   766 raft_consensus.cc:515] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.050988   765 raft_consensus.cc:515] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.096944   765 leader_election.cc:290] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.112744   758 tablet_bootstrap.cc:654] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.114835   766 leader_election.cc:290] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.117177   766 raft_consensus.cc:493] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.117610   766 raft_consensus.cc:515] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.122562   761 tablet_bootstrap.cc:492] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224: No bootstrap required, opened a new log
I20260709 12:58:25.123032   761 ts_tablet_manager.cc:1403] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224: Time spent bootstrapping tablet: real 0.107s	user 0.044s	sys 0.035s
I20260709 12:58:25.123308   766 leader_election.cc:290] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.128907   759 tablet_bootstrap.cc:654] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.177654   763 raft_consensus.cc:493] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.178167   763 raft_consensus.cc:515] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.180371   774 raft_consensus.cc:493] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.182580   774 raft_consensus.cc:515] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.176786   761 raft_consensus.cc:359] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.189306   792 raft_consensus.cc:493] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.186000   761 raft_consensus.cc:385] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.189779   792 raft_consensus.cc:515] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.189895   763 leader_election.cc:290] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:25.189949   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.192808   766 raft_consensus.cc:493] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.191020   774 leader_election.cc:290] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:25.195663   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:25.196218   641 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 0.
I20260709 12:58:25.193742   766 raft_consensus.cc:515] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.192010   761 raft_consensus.cc:740] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Initialized, Role: FOLLOWER
W20260709 12:58:25.198824   678 leader_election.cc:343] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.200372   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.200937   565 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 0.
I20260709 12:58:25.201316   678 leader_election.cc:304] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:25.198366   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:25.202458   774 raft_consensus.cc:2804] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.204432   640 raft_consensus.cc:2468] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 0.
I20260709 12:58:25.205557   766 leader_election.cc:290] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.204558   774 raft_consensus.cc:493] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.206753   774 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.206845   761 consensus_queue.cc:260] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.207491   678 leader_election.cc:304] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 167adef003144f679f4ca961edac8d31
I20260709 12:58:25.201700   460 catalog_manager.cc:5697] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b617c79595224797a4fa2ceda67ef9a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.208496   792 leader_election.cc:290] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.210314   763 raft_consensus.cc:2804] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.210876   763 raft_consensus.cc:493] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.211205   763 raft_consensus.cc:3060] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.208773   758 tablet_bootstrap.cc:492] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3: No bootstrap required, opened a new log
I20260709 12:58:25.213744   758 ts_tablet_manager.cc:1403] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.010s
I20260709 12:58:25.217118   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.217041   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.220321   566 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 0.
I20260709 12:58:25.218921   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.219453   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.220117   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.219822   761 ts_tablet_manager.cc:1434] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224: Time spent starting tablet: real 0.096s	user 0.011s	sys 0.000s
I20260709 12:58:25.226933   765 raft_consensus.cc:493] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.227672   565 raft_consensus.cc:2468] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 0.
W20260709 12:58:25.234097   530 leader_election.cc:343] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.234344   761 tablet_bootstrap.cc:492] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224: Bootstrap starting.
I20260709 12:58:25.229485   765 raft_consensus.cc:515] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.236261   765 leader_election.cc:290] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.227576   604 leader_election.cc:304] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
W20260709 12:58:25.239192   604 leader_election.cc:343] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.239715   564 raft_consensus.cc:2468] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 0.
I20260709 12:58:25.241670   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.242539   763 raft_consensus.cc:515] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.242859   792 raft_consensus.cc:2804] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.240300   604 leader_election.cc:304] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
I20260709 12:58:25.245244   792 raft_consensus.cc:493] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.246740   766 raft_consensus.cc:2804] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.247799   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:25.248529   604 leader_election.cc:304] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
I20260709 12:58:25.245724   792 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.226984   758 raft_consensus.cc:359] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.248636   766 raft_consensus.cc:493] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.249498   758 raft_consensus.cc:385] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.249989   758 raft_consensus.cc:740] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.250129   766 raft_consensus.cc:3060] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.252775   758 consensus_queue.cc:260] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.261445   715 raft_consensus.cc:2468] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 0.
I20260709 12:58:25.261914   774 raft_consensus.cc:515] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.263345   530 leader_election.cc:304] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:25.264201   765 raft_consensus.cc:2804] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.264557   765 raft_consensus.cc:493] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.264848   765 raft_consensus.cc:3060] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.266592   774 leader_election.cc:290] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:25.267496   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:25.268427   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:25.268623   564 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.266439   766 raft_consensus.cc:515] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.272816   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:25.275465   801 raft_consensus.cc:2804] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.276854   640 raft_consensus.cc:2393] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 167adef003144f679f4ca961edac8d31 in current term 1: Already voted for candidate 3ef331b90a594e6489dfd39ebaee3224 in this term.
I20260709 12:58:25.276782   641 raft_consensus.cc:2468] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 0.
I20260709 12:58:25.278199   766 leader_election.cc:290] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.279690   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:25.280208   565 raft_consensus.cc:3060] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.281293   765 raft_consensus.cc:515] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.283116   792 raft_consensus.cc:515] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.283479   759 tablet_bootstrap.cc:492] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31: No bootstrap required, opened a new log
I20260709 12:58:25.284605   639 raft_consensus.cc:2393] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b617c79595224797a4fa2ceda67ef9a3 in current term 1: Already voted for candidate 3ef331b90a594e6489dfd39ebaee3224 in this term.
I20260709 12:58:25.284813   759 ts_tablet_manager.cc:1403] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31: Time spent bootstrapping tablet: real 0.230s	user 0.024s	sys 0.026s
I20260709 12:58:25.282454   564 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 1.
I20260709 12:58:25.286818   529 leader_election.cc:304] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 167adef003144f679f4ca961edac8d31; no voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:25.271624   800 raft_consensus.cc:493] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.291287   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:25.296811   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:25.308640   715 raft_consensus.cc:3060] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.297835   565 raft_consensus.cc:2468] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 1.
I20260709 12:58:25.278563   801 raft_consensus.cc:493] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.285410   765 leader_election.cc:290] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.309901   563 raft_consensus.cc:2393] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ef331b90a594e6489dfd39ebaee3224 in current term 1: Already voted for candidate b617c79595224797a4fa2ceda67ef9a3 in this term.
I20260709 12:58:25.328285   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:25.328464   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:25.310863   801 raft_consensus.cc:3060] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.331004   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:25.332190   678 leader_election.cc:304] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:25.313185   788 raft_consensus.cc:2749] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:25.329398   763 leader_election.cc:290] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:25.334216   774 raft_consensus.cc:2804] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.333613   640 raft_consensus.cc:3060] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.338284   774 raft_consensus.cc:697] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Becoming Leader. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:25.334569   604 leader_election.cc:304] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
I20260709 12:58:25.340840   774 consensus_queue.cc:237] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.337414   792 leader_election.cc:290] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.329154   800 raft_consensus.cc:515] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
W20260709 12:58:25.341308   678 leader_election.cc:343] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.343345   766 raft_consensus.cc:2804] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.348446   761 tablet_bootstrap.cc:654] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.349807   766 raft_consensus.cc:697] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:25.350900   766 consensus_queue.cc:237] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.346256   759 raft_consensus.cc:359] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.354262   759 raft_consensus.cc:385] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.354564   759 raft_consensus.cc:740] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.356715   759 consensus_queue.cc:260] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.360296   715 raft_consensus.cc:2468] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 1.
I20260709 12:58:25.360504   758 ts_tablet_manager.cc:1434] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3: Time spent starting tablet: real 0.146s	user 0.010s	sys 0.004s
I20260709 12:58:25.361384   640 raft_consensus.cc:2468] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 1.
I20260709 12:58:25.361549   758 tablet_bootstrap.cc:492] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3: Bootstrap starting.
I20260709 12:58:25.362587   678 leader_election.cc:304] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 167adef003144f679f4ca961edac8d31
I20260709 12:58:25.363477   763 raft_consensus.cc:2804] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.363932   763 raft_consensus.cc:697] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Becoming Leader. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:25.365001   530 leader_election.cc:304] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:25.365202   763 consensus_queue.cc:237] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.368829   765 raft_consensus.cc:493] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.369580   788 raft_consensus.cc:2804] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.369669   765 raft_consensus.cc:515] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.375171   761 tablet_bootstrap.cc:492] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224: No bootstrap required, opened a new log
I20260709 12:58:25.375291   765 leader_election.cc:290] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.375605   761 ts_tablet_manager.cc:1403] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.006s
I20260709 12:58:25.378799   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.379377   715 raft_consensus.cc:2468] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 0.
I20260709 12:58:25.380971   759 ts_tablet_manager.cc:1434] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31: Time spent starting tablet: real 0.096s	user 0.012s	sys 0.000s
I20260709 12:58:25.382109   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:25.385109   759 tablet_bootstrap.cc:492] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31: Bootstrap starting.
I20260709 12:58:25.387012   530 leader_election.cc:304] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:25.388046   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.384008   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.393641   710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:25.394944   712 raft_consensus.cc:2393] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ef331b90a594e6489dfd39ebaee3224 in current term 1: Already voted for candidate 167adef003144f679f4ca961edac8d31 in this term.
I20260709 12:58:25.384886   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.394110   765 raft_consensus.cc:2804] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:25.396576   605 leader_election.cc:343] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.397248   765 raft_consensus.cc:493] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.395641   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.398608   800 leader_election.cc:290] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:25.397737   765 raft_consensus.cc:3060] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:25.398904   529 leader_election.cc:343] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.398067   801 raft_consensus.cc:515] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.398100   788 raft_consensus.cc:697] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:25.397270   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.397369   711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:25.411115   639 raft_consensus.cc:2393] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 167adef003144f679f4ca961edac8d31 in current term 1: Already voted for candidate 3ef331b90a594e6489dfd39ebaee3224 in this term.
I20260709 12:58:25.413702   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:25.415012   801 leader_election.cc:290] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
W20260709 12:58:25.408720   605 leader_election.cc:343] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:25.418272   678 leader_election.cc:343] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.419723   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:25.421021   788 consensus_queue.cc:237] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.423488   765 raft_consensus.cc:515] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.421646   761 raft_consensus.cc:359] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.425294   566 raft_consensus.cc:2393] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b617c79595224797a4fa2ceda67ef9a3 in current term 1: Already voted for candidate 167adef003144f679f4ca961edac8d31 in this term.
I20260709 12:58:25.427273   759 tablet_bootstrap.cc:654] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.427454   711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:25.429042   711 raft_consensus.cc:3060] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.427603   460 catalog_manager.cc:5697] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.429651   765 leader_election.cc:290] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.425273   761 raft_consensus.cc:385] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.435386   761 raft_consensus.cc:740] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.436305   761 consensus_queue.cc:260] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.417687   605 leader_election.cc:304] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224; no voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:25.441133   678 leader_election.cc:304] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b617c79595224797a4fa2ceda67ef9a3; no voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:25.441891   605 leader_election.cc:304] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224; no voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:25.441903   801 raft_consensus.cc:2749] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:25.444257   605 leader_election.cc:343] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.446851   758 tablet_bootstrap.cc:654] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.445111   801 raft_consensus.cc:2749] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:25.443336   711 raft_consensus.cc:2468] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 1.
I20260709 12:58:25.446867   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:25.449304   712 raft_consensus.cc:2393] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ef331b90a594e6489dfd39ebaee3224 in current term 1: Already voted for candidate 167adef003144f679f4ca961edac8d31 in this term.
I20260709 12:58:25.446859   461 catalog_manager.cc:5697] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b617c79595224797a4fa2ceda67ef9a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.450073   761 ts_tablet_manager.cc:1434] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.005s
I20260709 12:58:25.447965   800 raft_consensus.cc:2749] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:25.450953   761 tablet_bootstrap.cc:492] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224: Bootstrap starting.
I20260709 12:58:25.450769   461 catalog_manager.cc:5697] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b617c79595224797a4fa2ceda67ef9a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.452425   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
W20260709 12:58:25.453504   529 leader_election.cc:343] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.455358   605 leader_election.cc:304] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224; no voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:25.456141   801 raft_consensus.cc:2749] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:25.459287   530 leader_election.cc:304] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:25.459578   801 raft_consensus.cc:493] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.459983   801 raft_consensus.cc:515] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.461808   801 leader_election.cc:290] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.462446   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.463598   566 raft_consensus.cc:2393] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ef331b90a594e6489dfd39ebaee3224 in current term 1: Already voted for candidate b617c79595224797a4fa2ceda67ef9a3 in this term.
I20260709 12:58:25.464167   788 raft_consensus.cc:2804] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.463599   711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.465444   788 raft_consensus.cc:697] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:25.466085   759 tablet_bootstrap.cc:492] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31: No bootstrap required, opened a new log
I20260709 12:58:25.466413   759 ts_tablet_manager.cc:1403] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.005s
I20260709 12:58:25.465888   463 catalog_manager.cc:5697] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.468289   604 leader_election.cc:304] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224; no voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:25.469100   758 tablet_bootstrap.cc:492] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3: No bootstrap required, opened a new log
I20260709 12:58:25.469024   801 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.469547   758 ts_tablet_manager.cc:1403] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3: Time spent bootstrapping tablet: real 0.108s	user 0.002s	sys 0.011s
I20260709 12:58:25.472211   759 raft_consensus.cc:359] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.472790   759 raft_consensus.cc:385] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.473048   759 raft_consensus.cc:740] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.473637   759 consensus_queue.cc:260] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.475325   759 ts_tablet_manager.cc:1434] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:58:25.476119   759 tablet_bootstrap.cc:492] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31: Bootstrap starting.
I20260709 12:58:25.478403   761 tablet_bootstrap.cc:654] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.481083   800 consensus_queue.cc:1048] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.479413   801 raft_consensus.cc:2749] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:25.487036   800 consensus_queue.cc:1048] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.487486   759 tablet_bootstrap.cc:654] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.487619   788 consensus_queue.cc:237] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.485888   758 raft_consensus.cc:359] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.489305   758 raft_consensus.cc:385] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.489625   758 raft_consensus.cc:740] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.490720   758 consensus_queue.cc:260] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.495323   758 ts_tablet_manager.cc:1434] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:58:25.496120   758 tablet_bootstrap.cc:492] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3: Bootstrap starting.
I20260709 12:58:25.505000   761 tablet_bootstrap.cc:492] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224: No bootstrap required, opened a new log
I20260709 12:58:25.505549   761 ts_tablet_manager.cc:1403] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.015s
I20260709 12:58:25.512609   761 raft_consensus.cc:359] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.513496   761 raft_consensus.cc:385] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.513818   761 raft_consensus.cc:740] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.514626   761 consensus_queue.cc:260] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.517179   761 ts_tablet_manager.cc:1434] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:58:25.518293   761 tablet_bootstrap.cc:492] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224: Bootstrap starting.
I20260709 12:58:25.530082   758 tablet_bootstrap.cc:654] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.553712   759 tablet_bootstrap.cc:492] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31: No bootstrap required, opened a new log
I20260709 12:58:25.554289   759 ts_tablet_manager.cc:1403] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.026s
I20260709 12:58:25.557535   761 tablet_bootstrap.cc:654] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.558504   759 raft_consensus.cc:359] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.559278   759 raft_consensus.cc:385] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.559937   759 raft_consensus.cc:740] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.560928   759 consensus_queue.cc:260] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.563450   759 ts_tablet_manager.cc:1434] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:58:25.566911   461 catalog_manager.cc:5697] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.571257   640 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.592494   758 tablet_bootstrap.cc:492] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3: No bootstrap required, opened a new log
I20260709 12:58:25.593067   758 ts_tablet_manager.cc:1403] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.039s
I20260709 12:58:25.598029   758 raft_consensus.cc:359] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.598712   758 raft_consensus.cc:385] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.598984   758 raft_consensus.cc:740] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.599601   758 consensus_queue.cc:260] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.602846   758 ts_tablet_manager.cc:1434] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:58:25.604851   763 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.607299   761 tablet_bootstrap.cc:492] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224: No bootstrap required, opened a new log
I20260709 12:58:25.609282   761 ts_tablet_manager.cc:1403] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.004s
I20260709 12:58:25.611707   761 raft_consensus.cc:359] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.612335   761 raft_consensus.cc:385] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.612597   761 raft_consensus.cc:740] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.614285   761 consensus_queue.cc:260] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.618114   761 ts_tablet_manager.cc:1434] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:25.619127   788 raft_consensus.cc:493] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.619983   788 raft_consensus.cc:515] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.621869   788 leader_election.cc:290] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.623071   711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.623044   763 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.623708   711 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 0.
I20260709 12:58:25.625300   530 leader_election.cc:304] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:25.626938   788 raft_consensus.cc:2804] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.627274   788 raft_consensus.cc:493] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.627583   788 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.631035   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:25.631659   640 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 0.
I20260709 12:58:25.632170   801 raft_consensus.cc:493] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.632681   801 raft_consensus.cc:515] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.638070   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.638649   565 raft_consensus.cc:2468] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 0.
I20260709 12:58:25.639580   711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3" is_pre_election: true
I20260709 12:58:25.640172   711 raft_consensus.cc:2468] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 0.
I20260709 12:58:25.641283   605 leader_election.cc:304] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:25.642009   766 raft_consensus.cc:2804] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.642361   766 raft_consensus.cc:493] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.642694   766 raft_consensus.cc:3060] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.643330   801 leader_election.cc:290] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.647778   788 raft_consensus.cc:515] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
W20260709 12:58:25.649210   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:25.650565   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:25.651546   640 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.652261   766 raft_consensus.cc:515] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.655145   788 leader_election.cc:290] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.655113   711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:25.655719   711 raft_consensus.cc:3060] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.657395   640 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 1.
I20260709 12:58:25.659358   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:25.659617   529 leader_election.cc:304] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
I20260709 12:58:25.659910   712 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.660610   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:25.661159   566 raft_consensus.cc:3060] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.661980   711 raft_consensus.cc:2468] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 1.
I20260709 12:58:25.662827   788 raft_consensus.cc:2804] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.662489   766 leader_election.cc:290] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:25.663060   605 leader_election.cc:304] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:25.664255   766 raft_consensus.cc:2804] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.664476   788 raft_consensus.cc:697] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:25.664763   766 raft_consensus.cc:697] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:25.665335   788 consensus_queue.cc:237] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.665648   766 consensus_queue.cc:237] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.666774   712 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 1.
I20260709 12:58:25.675302   566 raft_consensus.cc:2468] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 1.
I20260709 12:58:25.675557   461 catalog_manager.cc:5697] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.678153   800 raft_consensus.cc:493] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.678593   800 raft_consensus.cc:515] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:25.680388   460 catalog_manager.cc:5697] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.683936   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef331b90a594e6489dfd39ebaee3224" is_pre_election: true
I20260709 12:58:25.680987   800 leader_election.cc:290] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:25.686278   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "167adef003144f679f4ca961edac8d31" is_pre_election: true
I20260709 12:58:25.686950   566 raft_consensus.cc:2393] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b617c79595224797a4fa2ceda67ef9a3 in current term 1: Already voted for candidate 3ef331b90a594e6489dfd39ebaee3224 in this term.
I20260709 12:58:25.687870   678 leader_election.cc:304] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b617c79595224797a4fa2ceda67ef9a3; no voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:25.688957   800 raft_consensus.cc:3060] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.693617   800 raft_consensus.cc:2749] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:25.780546   800 consensus_queue.cc:1048] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.784071   766 consensus_queue.cc:1048] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.792783   802 consensus_queue.cc:1048] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.811411   792 consensus_queue.cc:1048] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.855732   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
mode: GRACEFUL
new_leader_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:44816
I20260709 12:58:25.856307   712 raft_consensus.cc:606] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Received request to transfer leadership to TS 167adef003144f679f4ca961edac8d31
I20260709 12:58:25.870061   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
mode: GRACEFUL
new_leader_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:57012
I20260709 12:58:25.870532   640 raft_consensus.cc:606] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Received request to transfer leadership to TS 167adef003144f679f4ca961edac8d31
I20260709 12:58:25.871863   566 raft_consensus.cc:3060] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.875092   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
mode: GRACEFUL
new_leader_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:44816
I20260709 12:58:25.875522   712 raft_consensus.cc:606] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Received request to transfer leadership to TS 167adef003144f679f4ca961edac8d31
I20260709 12:58:25.880322   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
mode: GRACEFUL
new_leader_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:44816
I20260709 12:58:25.880605   763 consensus_queue.cc:1048] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.880839   712 raft_consensus.cc:606] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Received request to transfer leadership to TS 167adef003144f679f4ca961edac8d31
I20260709 12:58:25.881835   763 consensus_queue.cc:1048] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.913195   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87"
dest_uuid: "167adef003144f679f4ca961edac8d31"
mode: GRACEFUL
new_leader_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:37506
I20260709 12:58:25.913709   566 raft_consensus.cc:606] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Received request to transfer leadership to TS 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:25.919397   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
mode: GRACEFUL
new_leader_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:44816
I20260709 12:58:25.919952   712 raft_consensus.cc:606] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Received request to transfer leadership to TS 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:25.924413   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1"
dest_uuid: "167adef003144f679f4ca961edac8d31"
mode: GRACEFUL
new_leader_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:37506
I20260709 12:58:25.924944   566 raft_consensus.cc:606] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Received request to transfer leadership to TS 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:25.929296   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7"
dest_uuid: "167adef003144f679f4ca961edac8d31"
mode: GRACEFUL
new_leader_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:37506
I20260709 12:58:25.929801   566 raft_consensus.cc:606] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Received request to transfer leadership to TS 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:25.934286   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
mode: GRACEFUL
new_leader_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:57012
I20260709 12:58:25.934804   640 raft_consensus.cc:606] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Received request to transfer leadership to TS b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:26.012068   640 raft_consensus.cc:3060] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.021148   788 consensus_queue.cc:1048] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.028540   765 raft_consensus.cc:993] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31: : Instructing follower 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:26.029258   788 raft_consensus.cc:1081] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Signalling peer 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:26.031105   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:58:26.033721   639 raft_consensus.cc:493] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.034088   639 raft_consensus.cc:3060] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.034700   835 consensus_queue.cc:1048] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:26.042312   639 raft_consensus.cc:515] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.049754   765 consensus_queue.cc:1048] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.054106   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:26.054589   566 raft_consensus.cc:3055] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.054881   566 raft_consensus.cc:740] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:26.054924   639 leader_election.cc:290] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 2 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:26.055824   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "679ee1b0217c4e74980b16f699151bd7" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:26.056391   713 raft_consensus.cc:3060] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.059361   765 consensus_queue.cc:1048] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.060592   566 consensus_queue.cc:260] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.061849   566 raft_consensus.cc:3060] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.065721   835 raft_consensus.cc:993] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31: : Instructing follower 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:26.066111   788 raft_consensus.cc:1081] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Signalling peer 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:26.067822   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:58:26.068327   639 raft_consensus.cc:493] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.068694   639 raft_consensus.cc:3060] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.074501   639 raft_consensus.cc:515] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.075690   640 raft_consensus.cc:1240] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Rejecting Update request from peer 167adef003144f679f4ca961edac8d31 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:26.077135   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:26.077785   565 raft_consensus.cc:3055] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.078107   565 raft_consensus.cc:740] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:26.078323   788 consensus_queue.cc:1059] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.079470   565 consensus_queue.cc:260] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.080299   565 raft_consensus.cc:3060] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.086434   774 raft_consensus.cc:993] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3: : Instructing follower 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:26.086999   565 raft_consensus.cc:2468] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 2.
I20260709 12:58:26.087306   774 raft_consensus.cc:1081] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Signalling peer 167adef003144f679f4ca961edac8d31 to start an election
W20260709 12:58:26.087651   788 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:58:26.088339   604 leader_election.cc:304] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
I20260709 12:58:26.089040   563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c"
dest_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:37486
I20260709 12:58:26.089242   792 raft_consensus.cc:2804] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.089558   563 raft_consensus.cc:493] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.089805   792 raft_consensus.cc:697] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:26.090001   563 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.090747   792 consensus_queue.cc:237] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.095630   711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:26.096146   711 raft_consensus.cc:3060] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.096939   563 raft_consensus.cc:515] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.100616   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:26.101243   640 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.101603   713 raft_consensus.cc:2468] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 2.
I20260709 12:58:26.101984   711 raft_consensus.cc:2468] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 2.
I20260709 12:58:26.101814   766 consensus_queue.cc:1048] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.102542   605 leader_election.cc:304] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:26.103256   766 raft_consensus.cc:2804] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.103736   766 raft_consensus.cc:697] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:26.104463   766 consensus_queue.cc:237] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.108750   640 raft_consensus.cc:2468] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 2.
I20260709 12:58:26.109163   639 leader_election.cc:290] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 2 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:26.109879   529 leader_election.cc:304] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
I20260709 12:58:26.110638   788 raft_consensus.cc:2804] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.111187   788 raft_consensus.cc:697] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:26.111999   788 consensus_queue.cc:237] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.120193   766 consensus_queue.cc:1048] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.122699   566 raft_consensus.cc:2468] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 2.
I20260709 12:58:26.125185   462 catalog_manager.cc:5697] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 1 to 2, leader changed from b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195) to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.126973   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:26.127485   713 raft_consensus.cc:3055] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.127774   713 raft_consensus.cc:740] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:26.131244   774 raft_consensus.cc:993] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3: : Instructing follower 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:26.131654   802 raft_consensus.cc:1081] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Signalling peer 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:26.136855   713 consensus_queue.cc:260] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.137892   713 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.138376   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb"
dest_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:37486
I20260709 12:58:26.138304   788 consensus_queue.cc:1048] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.139102   565 raft_consensus.cc:493] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.139602   565 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.141131   563 leader_election.cc:290] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 2 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:26.163795   462 catalog_manager.cc:5697] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 1 to 2, leader changed from 167adef003144f679f4ca961edac8d31 (127.0.107.193) to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.162058   565 raft_consensus.cc:515] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.166114   462 catalog_manager.cc:5697] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 1 to 2, leader changed from 167adef003144f679f4ca961edac8d31 (127.0.107.193) to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.170706   766 raft_consensus.cc:993] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224: : Instructing follower 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:26.171115   766 raft_consensus.cc:1081] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Signalling peer 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:26.168972   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:26.173337   640 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.173381   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:26.173944   715 raft_consensus.cc:3055] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.174247   715 raft_consensus.cc:740] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:26.175072   715 consensus_queue.cc:260] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.175843   715 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.178748   713 raft_consensus.cc:2468] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 2.
I20260709 12:58:26.182065   640 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 2.
I20260709 12:58:26.183529   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0"
dest_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:37498
I20260709 12:58:26.186362   566 raft_consensus.cc:493] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.186753   566 raft_consensus.cc:3060] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.186920   529 leader_election.cc:304] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
I20260709 12:58:26.187834   788 raft_consensus.cc:2804] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.188267   788 raft_consensus.cc:697] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:26.192318   788 consensus_queue.cc:237] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.184072   565 leader_election.cc:290] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 2 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:26.184906   715 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 2.
I20260709 12:58:26.193573   566 raft_consensus.cc:515] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.196863   566 leader_election.cc:290] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 2 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:26.197523   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:26.198077   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:26.198880   640 raft_consensus.cc:3055] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.198902   715 raft_consensus.cc:3060] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.199483   640 raft_consensus.cc:740] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:26.200410   640 consensus_queue.cc:260] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.201644   640 raft_consensus.cc:3060] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.205673   715 raft_consensus.cc:2468] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 2.
I20260709 12:58:26.206833   530 leader_election.cc:304] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:26.208061   835 raft_consensus.cc:2804] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.208509   835 raft_consensus.cc:697] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:26.208616   640 raft_consensus.cc:2468] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 2.
I20260709 12:58:26.209380   835 consensus_queue.cc:237] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.214473   462 catalog_manager.cc:5697] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 1 to 2, leader changed from b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195) to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.219972   801 raft_consensus.cc:993] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224: : Instructing follower b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:26.220368   801 raft_consensus.cc:1081] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Signalling peer b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:26.224242   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:44810
I20260709 12:58:26.224749   712 raft_consensus.cc:493] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.225096   712 raft_consensus.cc:3060] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.224979   788 consensus_queue.cc:1048] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.231952   712 raft_consensus.cc:515] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.235688   712 leader_election.cc:290] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 2 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:26.236210   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:26.236809   641 raft_consensus.cc:3055] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.237260   641 raft_consensus.cc:740] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:26.238221   641 consensus_queue.cc:260] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.239353   641 raft_consensus.cc:3060] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.235486   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b4f0a2ecd4c0887602048721f7c46" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:26.244786   566 raft_consensus.cc:3060] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.252894   641 raft_consensus.cc:2468] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 2.
I20260709 12:58:26.254160   678 leader_election.cc:304] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:26.254982   774 raft_consensus.cc:2804] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.255420   774 raft_consensus.cc:697] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 2 LEADER]: Becoming Leader. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:26.255748   460 catalog_manager.cc:5697] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 1 to 2, leader changed from 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194) to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.256256   774 consensus_queue.cc:237] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.259859   566 raft_consensus.cc:2468] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 2.
I20260709 12:58:26.265763   461 catalog_manager.cc:5697] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 reported cstate change: term changed from 1 to 2, leader changed from 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194) to b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b617c79595224797a4fa2ceda67ef9a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.273916   788 raft_consensus.cc:993] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31: : Instructing follower 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:26.274322   788 raft_consensus.cc:1081] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Signalling peer 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:26.275664   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:58:26.276181   639 raft_consensus.cc:493] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.276515   639 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.282475   639 raft_consensus.cc:515] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.284459   639 leader_election.cc:290] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 2 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:26.285115   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:26.285408   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:26.285717   566 raft_consensus.cc:3055] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.285950   712 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.286057   566 raft_consensus.cc:740] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:26.286831   566 consensus_queue.cc:260] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.288034   566 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.292064   712 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 2.
I20260709 12:58:26.292351   566 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 2.
I20260709 12:58:26.293160   605 leader_election.cc:304] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:26.293919   801 raft_consensus.cc:2804] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.294337   801 raft_consensus.cc:697] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:26.295110   801 consensus_queue.cc:237] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.297945   802 raft_consensus.cc:993] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3: : Instructing follower 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:26.298365   802 raft_consensus.cc:1081] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Signalling peer 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:26.300326   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f"
dest_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:37486
I20260709 12:58:26.301898   461 catalog_manager.cc:5697] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 1 to 2, leader changed from 167adef003144f679f4ca961edac8d31 (127.0.107.193) to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.305620   566 raft_consensus.cc:493] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.305998   566 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.312060   566 raft_consensus.cc:515] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.313953   566 leader_election.cc:290] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 2 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:26.314280   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:26.314522   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:26.314893   639 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.315167   712 raft_consensus.cc:3055] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.315531   712 raft_consensus.cc:740] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:26.316147   712 consensus_queue.cc:260] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.316963   712 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.320937   712 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 2.
I20260709 12:58:26.321439   639 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 2.
I20260709 12:58:26.321730   530 leader_election.cc:304] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:26.322400   788 raft_consensus.cc:2804] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.322793   788 raft_consensus.cc:697] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:26.323519   788 consensus_queue.cc:237] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.330024   461 catalog_manager.cc:5697] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 1 to 2, leader changed from b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195) to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.493846   712 raft_consensus.cc:1275] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.495030   801 consensus_queue.cc:1048] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:26.497818   566 raft_consensus.cc:1275] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.500770   792 consensus_queue.cc:1048] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.526706   774 raft_consensus.cc:993] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3: : Instructing follower 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:26.527114   802 raft_consensus.cc:1081] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Signalling peer 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:26.528594   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:56994
I20260709 12:58:26.529033   639 raft_consensus.cc:493] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.529390   639 raft_consensus.cc:3060] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.532217   712 raft_consensus.cc:1275] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.533473   801 consensus_queue.cc:1048] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.534545   639 raft_consensus.cc:515] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.537062   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:26.537699   566 raft_consensus.cc:3060] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.537773   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:26.538388   713 raft_consensus.cc:3055] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.538738   713 raft_consensus.cc:740] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:26.539515   713 consensus_queue.cc:260] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.540529   713 raft_consensus.cc:3060] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.549454   565 raft_consensus.cc:1275] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.550738   801 consensus_queue.cc:1048] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.554402   713 raft_consensus.cc:2468] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 2.
I20260709 12:58:26.555186   639 leader_election.cc:290] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 2 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:26.555517   605 leader_election.cc:304] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:26.556734   801 raft_consensus.cc:2804] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.557173   801 raft_consensus.cc:697] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:26.549999   566 raft_consensus.cc:2468] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 2.
I20260709 12:58:26.557976   801 consensus_queue.cc:237] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:26.564308   460 catalog_manager.cc:5697] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 1 to 2, leader changed from b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195) to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.586059   639 raft_consensus.cc:1275] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.587363   835 consensus_queue.cc:1048] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.594488   712 raft_consensus.cc:1275] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.596372   788 consensus_queue.cc:1048] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:26.597437   712 raft_consensus.cc:1275] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.598693   788 consensus_queue.cc:1048] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.612550   639 raft_consensus.cc:1275] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.613576   835 consensus_queue.cc:1048] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.708788   713 raft_consensus.cc:1275] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.710142   835 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.722971   639 raft_consensus.cc:1275] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.727262   765 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.770419   566 raft_consensus.cc:1275] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.771695   802 consensus_queue.cc:1048] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.783723   639 raft_consensus.cc:1275] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.785174   846 consensus_queue.cc:1048] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.851076   566 raft_consensus.cc:1275] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.852334   801 consensus_queue.cc:1048] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.861310   713 raft_consensus.cc:1275] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.863317   801 consensus_queue.cc:1048] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.866400   639 raft_consensus.cc:1275] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.871034   765 consensus_queue.cc:1048] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.879026   713 raft_consensus.cc:1275] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.880349   835 consensus_queue.cc:1048] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.988240   713 raft_consensus.cc:1275] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.989530   801 consensus_queue.cc:1048] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.997798   566 raft_consensus.cc:1275] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.999172   792 consensus_queue.cc:1048] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.962170   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:58:28.963053   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:28.982467   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb"
dest_uuid: "167adef003144f679f4ca961edac8d31"
mode: GRACEFUL
new_leader_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:37510
I20260709 12:58:28.983038   566 raft_consensus.cc:606] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Received request to transfer leadership to TS b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:28.992393   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
mode: GRACEFUL
new_leader_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:57026
I20260709 12:58:28.992898   639 raft_consensus.cc:606] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Received request to transfer leadership to TS b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:28.993894   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:28.994308   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:29.034757   792 raft_consensus.cc:993] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224: : Instructing follower b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:29.035288   859 raft_consensus.cc:1081] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Signalling peer b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:29.036792   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:44810
I20260709 12:58:29.037189   713 raft_consensus.cc:493] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:29.037421   713 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.041733   713 raft_consensus.cc:515] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:29.043148   713 leader_election.cc:290] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 3 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:29.043876   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:29.044158   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:29.044327   566 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.044688   639 raft_consensus.cc:3055] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:29.045034   639 raft_consensus.cc:740] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:29.045737   639 consensus_queue.cc:260] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:29.046839   639 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.049961   566 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 3.
I20260709 12:58:29.051163   678 leader_election.cc:304] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:29.051788   855 raft_consensus.cc:2804] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:29.052486   639 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 3.
I20260709 12:58:29.052911   855 raft_consensus.cc:697] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Becoming Leader. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:29.053694   855 consensus_queue.cc:237] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:29.059546   462 catalog_manager.cc:5697] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 reported cstate change: term changed from 2 to 3, leader changed from 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194) to b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b617c79595224797a4fa2ceda67ef9a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.124023   788 raft_consensus.cc:993] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31: : Instructing follower b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:29.124447   854 raft_consensus.cc:1081] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Signalling peer b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:29.125815   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:44802
I20260709 12:58:29.126196   713 raft_consensus.cc:493] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:29.126415   713 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.130543   713 raft_consensus.cc:515] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:29.132081   713 leader_election.cc:290] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 3 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159)
I20260709 12:58:29.132730   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:29.133038   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:29.133337   639 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.133482   566 raft_consensus.cc:3055] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:29.133806   566 raft_consensus.cc:740] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:29.134276   566 consensus_queue.cc:260] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:29.135018   566 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.137542   639 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 3.
I20260709 12:58:29.138494   566 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 3.
I20260709 12:58:29.138489   678 leader_election.cc:304] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:29.139421   855 raft_consensus.cc:2804] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:29.139885   855 raft_consensus.cc:697] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Becoming Leader. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:29.140592   855 consensus_queue.cc:237] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:29.146586   462 catalog_manager.cc:5697] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 reported cstate change: term changed from 2 to 3, leader changed from 167adef003144f679f4ca961edac8d31 (127.0.107.193) to b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b617c79595224797a4fa2ceda67ef9a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.534240   566 raft_consensus.cc:1275] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:29.535315   855 consensus_queue.cc:1048] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:29.543471   639 raft_consensus.cc:1275] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:29.544616   860 consensus_queue.cc:1048] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:29.680167   639 raft_consensus.cc:1275] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:29.681246   860 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:29.690228   566 raft_consensus.cc:1275] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:29.691942   873 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:29.995216   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:30.004583   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
mode: GRACEFUL
new_leader_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:44816
I20260709 12:58:30.005097   713 raft_consensus.cc:606] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Received request to transfer leadership to TS 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:30.009234   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0"
dest_uuid: "167adef003144f679f4ca961edac8d31"
mode: GRACEFUL
new_leader_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:37506
I20260709 12:58:30.009666   566 raft_consensus.cc:606] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Received request to transfer leadership to TS 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:30.013741   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c"
dest_uuid: "167adef003144f679f4ca961edac8d31"
mode: GRACEFUL
new_leader_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:37506
I20260709 12:58:30.014158   566 raft_consensus.cc:606] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Received request to transfer leadership to TS 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:30.018172   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f"
dest_uuid: "167adef003144f679f4ca961edac8d31"
mode: GRACEFUL
new_leader_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:37506
I20260709 12:58:30.018559   566 raft_consensus.cc:606] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Received request to transfer leadership to TS 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:30.027053   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
mode: GRACEFUL
new_leader_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:44816
I20260709 12:58:30.027510   713 raft_consensus.cc:606] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Received request to transfer leadership to TS 3ef331b90a594e6489dfd39ebaee3224
I20260709 12:58:30.034365   788 raft_consensus.cc:993] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31: : Instructing follower 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.034759   788 raft_consensus.cc:1081] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Signalling peer 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.036003   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:58:30.036430   639 raft_consensus.cc:493] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.036710   639 raft_consensus.cc:3060] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.043485   639 raft_consensus.cc:515] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.045289   639 leader_election.cc:290] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 3 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:30.045761   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:30.046072   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f172eef8a84cb68f23efe20d9818a0" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:30.046286   566 raft_consensus.cc:3055] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:30.046571   566 raft_consensus.cc:740] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:30.046612   713 raft_consensus.cc:3060] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.047380   566 consensus_queue.cc:260] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.048326   566 raft_consensus.cc:3060] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.052971   713 raft_consensus.cc:2468] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 3.
I20260709 12:58:30.053969   566 raft_consensus.cc:2468] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 3.
I20260709 12:58:30.054014   605 leader_election.cc:304] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:30.054850   859 raft_consensus.cc:2804] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:30.055871   859 raft_consensus.cc:697] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:30.056500   859 consensus_queue.cc:237] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.062584   462 catalog_manager.cc:5697] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 2 to 3, leader changed from 167adef003144f679f4ca961edac8d31 (127.0.107.193) to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.065835   873 raft_consensus.cc:993] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3: : Instructing follower 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.066283   855 raft_consensus.cc:1081] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Signalling peer 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.067826   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:56994
I20260709 12:58:30.068302   639 raft_consensus.cc:493] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.068616   639 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.073905   639 raft_consensus.cc:515] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.075243   639 leader_election.cc:290] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 4 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:30.075834   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:30.076304   566 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.076273   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd1dce5aaa7422c841d31ec641e1fd1" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:30.076822   713 raft_consensus.cc:3055] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:30.077032   713 raft_consensus.cc:740] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:30.077719   713 consensus_queue.cc:260] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.078594   713 raft_consensus.cc:3060] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.080132   566 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 4.
I20260709 12:58:30.080976   604 leader_election.cc:304] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
I20260709 12:58:30.081696   859 raft_consensus.cc:2804] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:30.082089   859 raft_consensus.cc:697] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 4 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:30.082798   859 consensus_queue.cc:237] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.083352   713 raft_consensus.cc:2468] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 4.
I20260709 12:58:30.087751   462 catalog_manager.cc:5697] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 3 to 4, leader changed from b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195) to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.099922   875 raft_consensus.cc:993] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31: : Instructing follower 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.100298   788 raft_consensus.cc:1081] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Signalling peer 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.101467   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:58:30.101804   639 raft_consensus.cc:493] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.102005   639 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.105471   639 raft_consensus.cc:515] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.106712   639 leader_election.cc:290] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 3 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:30.107395   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:30.107656   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:30.107869   566 raft_consensus.cc:3055] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:30.108229   566 raft_consensus.cc:740] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:30.108233   713 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.108871   566 consensus_queue.cc:260] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.109637   566 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.112813   713 raft_consensus.cc:2468] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 3.
I20260709 12:58:30.113165   566 raft_consensus.cc:2468] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 3.
I20260709 12:58:30.113823   605 leader_election.cc:304] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:30.114496   859 raft_consensus.cc:2804] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:30.114912   859 raft_consensus.cc:697] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:30.115468   859 consensus_queue.cc:237] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.120994   462 catalog_manager.cc:5697] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 2 to 3, leader changed from 167adef003144f679f4ca961edac8d31 (127.0.107.193) to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.273933   855 raft_consensus.cc:993] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3: : Instructing follower 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.274338   873 raft_consensus.cc:1081] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Signalling peer 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.275566   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:56994
I20260709 12:58:30.275933   639 raft_consensus.cc:493] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.276163   639 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.279804   639 raft_consensus.cc:515] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.281070   639 leader_election.cc:290] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 4 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:30.281744   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:30.281981   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:30.282229   566 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.282449   713 raft_consensus.cc:3055] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:30.282779   713 raft_consensus.cc:740] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:30.283320   713 consensus_queue.cc:260] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.284044   713 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.286135   566 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 4.
I20260709 12:58:30.286958   604 leader_election.cc:304] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, 3ef331b90a594e6489dfd39ebaee3224; no voters: 
I20260709 12:58:30.287567   859 raft_consensus.cc:2804] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:30.287878   713 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 4.
I20260709 12:58:30.288223   859 raft_consensus.cc:697] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 4 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:30.289021   859 consensus_queue.cc:237] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.291039   875 raft_consensus.cc:993] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31: : Instructing follower 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.291422   788 raft_consensus.cc:1081] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Signalling peer 3ef331b90a594e6489dfd39ebaee3224 to start an election
I20260709 12:58:30.292744   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:58:30.293206   639 raft_consensus.cc:493] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.293491   639 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.294930   462 catalog_manager.cc:5697] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 3 to 4, leader changed from b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195) to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.296902   639 raft_consensus.cc:515] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.298496   639 leader_election.cc:290] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 3 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:30.299036   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:30.299446   566 raft_consensus.cc:3055] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:30.299715   566 raft_consensus.cc:740] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:30.299948   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "3ef331b90a594e6489dfd39ebaee3224" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:30.300457   713 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.300410   566 consensus_queue.cc:260] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.301255   566 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.305071   713 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 3.
I20260709 12:58:30.305814   566 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef331b90a594e6489dfd39ebaee3224 in term 3.
I20260709 12:58:30.305841   605 leader_election.cc:304] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef331b90a594e6489dfd39ebaee3224, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:30.306613   859 raft_consensus.cc:2804] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:30.307019   859 raft_consensus.cc:697] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Becoming Leader. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:30.307600   859 consensus_queue.cc:237] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:30.312845   462 catalog_manager.cc:5697] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 reported cstate change: term changed from 2 to 3, leader changed from 167adef003144f679f4ca961edac8d31 (127.0.107.193) to 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "3ef331b90a594e6489dfd39ebaee3224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.487232   566 raft_consensus.cc:1275] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.488351   859 consensus_queue.cc:1048] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.498703   713 raft_consensus.cc:1275] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.500204   885 consensus_queue.cc:1048] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.502816   566 raft_consensus.cc:1275] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:30.503983   859 consensus_queue.cc:1048] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.512285   713 raft_consensus.cc:1275] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:30.514765   859 consensus_queue.cc:1048] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.579737   713 raft_consensus.cc:1275] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.580792   876 consensus_queue.cc:1048] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.587973   566 raft_consensus.cc:1275] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.589311   885 consensus_queue.cc:1048] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.710758   566 raft_consensus.cc:1275] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.711977   885 consensus_queue.cc:1048] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.719388   713 raft_consensus.cc:1275] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.720913   859 consensus_queue.cc:1048] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.861326   566 raft_consensus.cc:1275] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:30.862341   859 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.871613   713 raft_consensus.cc:1275] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Refusing update from remote peer 3ef331b90a594e6489dfd39ebaee3224: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:30.872987   859 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:33.033659   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:33.040892   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
mode: GRACEFUL
new_leader_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:57026
I20260709 12:58:33.041509   639 raft_consensus.cc:606] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 4 LEADER]: Received request to transfer leadership to TS b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:33.043655   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
mode: GRACEFUL
new_leader_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:57026
I20260709 12:58:33.044016   639 raft_consensus.cc:606] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Received request to transfer leadership to TS b617c79595224797a4fa2ceda67ef9a3
I20260709 12:58:33.045984   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
mode: GRACEFUL
new_leader_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:57026
I20260709 12:58:33.046332   639 raft_consensus.cc:606] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Received request to transfer leadership to TS 167adef003144f679f4ca961edac8d31
I20260709 12:58:33.048278   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
mode: GRACEFUL
new_leader_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:57026
I20260709 12:58:33.048655   639 raft_consensus.cc:606] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Received request to transfer leadership to TS 167adef003144f679f4ca961edac8d31
I20260709 12:58:33.049670   885 raft_consensus.cc:993] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224: : Instructing follower 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:33.050151   898 raft_consensus.cc:1081] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Signalling peer 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:33.050805   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c"
dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
mode: GRACEFUL
new_leader_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:57026
I20260709 12:58:33.051187   639 raft_consensus.cc:606] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Received request to transfer leadership to TS 167adef003144f679f4ca961edac8d31
I20260709 12:58:33.051654   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f"
dest_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:37498
I20260709 12:58:33.052054   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:33.052160   566 raft_consensus.cc:493] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:33.052479   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:33.052572   566 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:33.057179   566 raft_consensus.cc:515] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.058990   566 leader_election.cc:290] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 4 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:33.059635   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:33.060148   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8743d3bfde49d9b57d8fa59461605f" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:33.060318   639 raft_consensus.cc:3055] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:33.060640   713 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:33.060637   639 raft_consensus.cc:740] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:33.061625   639 consensus_queue.cc:260] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.062546   639 raft_consensus.cc:3060] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:33.065282   713 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 4.
I20260709 12:58:33.066268   530 leader_election.cc:304] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:33.066459   639 raft_consensus.cc:2468] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 4.
I20260709 12:58:33.067821   899 raft_consensus.cc:2804] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:33.068624   899 raft_consensus.cc:697] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 4 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:33.069399   899 consensus_queue.cc:237] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.075601   460 catalog_manager.cc:5697] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 3 to 4, leader changed from 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194) to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:33.213459   885 raft_consensus.cc:993] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224: : Instructing follower 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:33.213860   898 raft_consensus.cc:1081] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Signalling peer 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:33.215000   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c"
dest_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:37498
I20260709 12:58:33.215404   566 raft_consensus.cc:493] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:33.215687   566 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:33.219647   566 raft_consensus.cc:515] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.220983   566 leader_election.cc:290] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 4 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:33.221669   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:33.221987   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbebec53d4bb45ee9cedd32e3702cc7c" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:33.222208   639 raft_consensus.cc:3055] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:33.222424   713 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:33.222507   639 raft_consensus.cc:740] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:33.223243   639 consensus_queue.cc:260] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.224014   639 raft_consensus.cc:3060] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:33.226281   713 raft_consensus.cc:2468] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 4.
I20260709 12:58:33.227016   530 leader_election.cc:304] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:33.227681   899 raft_consensus.cc:2804] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:33.228036   899 raft_consensus.cc:697] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 4 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:33.228222   639 raft_consensus.cc:2468] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 4.
I20260709 12:58:33.228750   899 consensus_queue.cc:237] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.234368   460 catalog_manager.cc:5697] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 3 to 4, leader changed from 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194) to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:33.277417   885 raft_consensus.cc:993] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224: : Instructing follower b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:33.277820   898 raft_consensus.cc:1081] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Signalling peer b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:33.279150   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:44810
I20260709 12:58:33.279575   713 raft_consensus.cc:493] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:33.279831   713 raft_consensus.cc:3060] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.283278   713 raft_consensus.cc:515] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.284571   713 leader_election.cc:290] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 3 election: Requested vote from peers 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159), 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591)
I20260709 12:58:33.285315   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:33.285653   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f51f3b2e11f49609d25b8ff5730df87" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:33.285791   566 raft_consensus.cc:3060] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.286077   639 raft_consensus.cc:3055] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:33.286295   639 raft_consensus.cc:740] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:33.286859   639 consensus_queue.cc:260] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.287557   639 raft_consensus.cc:3060] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.289438   566 raft_consensus.cc:2468] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 3.
I20260709 12:58:33.290460   678 leader_election.cc:304] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:33.291277   855 raft_consensus.cc:2804] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:33.291414   639 raft_consensus.cc:2468] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 3.
I20260709 12:58:33.292459   855 raft_consensus.cc:697] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Becoming Leader. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:33.293179   855 consensus_queue.cc:237] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.299911   460 catalog_manager.cc:5697] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 reported cstate change: term changed from 2 to 3, leader changed from 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194) to b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b617c79595224797a4fa2ceda67ef9a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:33.397270   885 raft_consensus.cc:993] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224: : Instructing follower b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:33.397648   898 raft_consensus.cc:1081] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 4 LEADER]: Signalling peer b617c79595224797a4fa2ceda67ef9a3 to start an election
I20260709 12:58:33.398883   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb"
dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
 from {username='slave'} at 127.0.0.1:44810
I20260709 12:58:33.399281   713 raft_consensus.cc:493] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:33.399538   713 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:33.403306   713 raft_consensus.cc:515] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.404788   713 leader_election.cc:290] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 5 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159)
I20260709 12:58:33.405383   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:33.405881   639 raft_consensus.cc:3055] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:33.406186   639 raft_consensus.cc:740] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:33.406538   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f7b8d019004d1bb34f4e9f883722eb" candidate_uuid: "b617c79595224797a4fa2ceda67ef9a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "167adef003144f679f4ca961edac8d31"
I20260709 12:58:33.406776   885 raft_consensus.cc:993] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224: : Instructing follower 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:33.407035   566 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:33.406872   639 consensus_queue.cc:260] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.407382   885 raft_consensus.cc:1081] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Signalling peer 167adef003144f679f4ca961edac8d31 to start an election
I20260709 12:58:33.408077   639 raft_consensus.cc:3060] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:33.408788   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03"
dest_uuid: "167adef003144f679f4ca961edac8d31"
 from {username='slave'} at 127.0.0.1:37498
I20260709 12:58:33.409185   565 raft_consensus.cc:493] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:33.409449   565 raft_consensus.cc:3060] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.412496   566 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 5.
I20260709 12:58:33.413487   639 raft_consensus.cc:2468] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b617c79595224797a4fa2ceda67ef9a3 in term 5.
I20260709 12:58:33.413602   678 leader_election.cc:304] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:33.414551   855 raft_consensus.cc:2804] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:33.415033   855 raft_consensus.cc:697] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 5 LEADER]: Becoming Leader. State: Replica: b617c79595224797a4fa2ceda67ef9a3, State: Running, Role: LEADER
I20260709 12:58:33.415139   565 raft_consensus.cc:515] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.415897   855 consensus_queue.cc:237] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.416813   565 leader_election.cc:290] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 3 election: Requested vote from peers 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591), b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195:41099)
I20260709 12:58:33.417641   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b617c79595224797a4fa2ceda67ef9a3"
I20260709 12:58:33.418112   713 raft_consensus.cc:3060] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.419016   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36934cab51c48c6a541ebcef13e9c03" candidate_uuid: "167adef003144f679f4ca961edac8d31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ef331b90a594e6489dfd39ebaee3224"
I20260709 12:58:33.419598   639 raft_consensus.cc:3055] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:33.420008   639 raft_consensus.cc:740] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ef331b90a594e6489dfd39ebaee3224, State: Running, Role: LEADER
I20260709 12:58:33.420902   639 consensus_queue.cc:260] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.421847   639 raft_consensus.cc:3060] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.423530   713 raft_consensus.cc:2468] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 3.
I20260709 12:58:33.423662   460 catalog_manager.cc:5697] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 reported cstate change: term changed from 4 to 5, leader changed from 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194) to b617c79595224797a4fa2ceda67ef9a3 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "b617c79595224797a4fa2ceda67ef9a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:33.424398   530 leader_election.cc:304] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 167adef003144f679f4ca961edac8d31, b617c79595224797a4fa2ceda67ef9a3; no voters: 
I20260709 12:58:33.425129   899 raft_consensus.cc:2804] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:33.425580   899 raft_consensus.cc:697] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 3 LEADER]: Becoming Leader. State: Replica: 167adef003144f679f4ca961edac8d31, State: Running, Role: LEADER
I20260709 12:58:33.426358   899 consensus_queue.cc:237] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } }
I20260709 12:58:33.427618   639 raft_consensus.cc:2468] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 167adef003144f679f4ca961edac8d31 in term 3.
I20260709 12:58:33.433462   462 catalog_manager.cc:5697] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 reported cstate change: term changed from 2 to 3, leader changed from 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194) to 167adef003144f679f4ca961edac8d31 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "167adef003144f679f4ca961edac8d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:33.492952   713 raft_consensus.cc:1275] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:33.494094   899 consensus_queue.cc:1048] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:33.504184   639 raft_consensus.cc:1275] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:33.506429   900 consensus_queue.cc:1048] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:33.729871   639 raft_consensus.cc:1275] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:33.731127   899 consensus_queue.cc:1048] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:33.740932   713 raft_consensus.cc:1275] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:33.742144   900 consensus_queue.cc:1048] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:33.849808   565 raft_consensus.cc:1275] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:33.850880   855 consensus_queue.cc:1048] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.852862   565 raft_consensus.cc:1275] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 5 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:33.854104   907 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "167adef003144f679f4ca961edac8d31" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:33.863128   639 raft_consensus.cc:1275] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:33.864799   921 consensus_queue.cc:1048] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:33.866870   639 raft_consensus.cc:1275] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 5 FOLLOWER]: Refusing update from remote peer b617c79595224797a4fa2ceda67ef9a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:33.868760   907 consensus_queue.cc:1048] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:33.945690   713 raft_consensus.cc:1275] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:33.946739   900 consensus_queue.cc:1048] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b617c79595224797a4fa2ceda67ef9a3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.955951   639 raft_consensus.cc:1275] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Refusing update from remote peer 167adef003144f679f4ca961edac8d31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:33.958112   899 consensus_queue.cc:1048] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef331b90a594e6489dfd39ebaee3224" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:34.053428   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:34.058096   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:34.077809   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:34.078480   431 tablet_replica.cc:333] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31: stopping tablet replica
I20260709 12:58:34.079160   431 raft_consensus.cc:2243] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.079671   431 raft_consensus.cc:2272] T fbd1dce5aaa7422c841d31ec641e1fd1 P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.081763   431 tablet_replica.cc:333] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31: stopping tablet replica
I20260709 12:58:34.082258   431 raft_consensus.cc:2243] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.082955   431 raft_consensus.cc:2272] T f36934cab51c48c6a541ebcef13e9c03 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.084712   431 tablet_replica.cc:333] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31: stopping tablet replica
I20260709 12:58:34.085196   431 raft_consensus.cc:2243] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.085860   431 raft_consensus.cc:2272] T ef8743d3bfde49d9b57d8fa59461605f P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.087589   431 tablet_replica.cc:333] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31: stopping tablet replica
I20260709 12:58:34.088104   431 raft_consensus.cc:2243] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.088470   431 raft_consensus.cc:2272] T 679ee1b0217c4e74980b16f699151bd7 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.089861   431 tablet_replica.cc:333] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31: stopping tablet replica
I20260709 12:58:34.090281   431 raft_consensus.cc:2243] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.090656   431 raft_consensus.cc:2272] T 2d6b4f0a2ecd4c0887602048721f7c46 P 167adef003144f679f4ca961edac8d31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.092101   431 tablet_replica.cc:333] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31: stopping tablet replica
I20260709 12:58:34.092547   431 raft_consensus.cc:2243] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.092907   431 raft_consensus.cc:2272] T 82f172eef8a84cb68f23efe20d9818a0 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.094588   431 tablet_replica.cc:333] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31: stopping tablet replica
W20260709 12:58:34.095064   604 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:58:34.095077   431 raft_consensus.cc:2243] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.095937   431 raft_consensus.cc:2272] T fbebec53d4bb45ee9cedd32e3702cc7c P 167adef003144f679f4ca961edac8d31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.097852   431 tablet_replica.cc:333] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31: stopping tablet replica
W20260709 12:58:34.097914   604 consensus_peers.cc:597] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 -> Peer 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159): Couldn't send request to peer 167adef003144f679f4ca961edac8d31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:34.098380   431 raft_consensus.cc:2243] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.098881   431 raft_consensus.cc:2272] T 9f51f3b2e11f49609d25b8ff5730df87 P 167adef003144f679f4ca961edac8d31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.100651   431 tablet_replica.cc:333] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31: stopping tablet replica
I20260709 12:58:34.101043   431 raft_consensus.cc:2243] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.101404   431 raft_consensus.cc:2272] T 48f7b8d019004d1bb34f4e9f883722eb P 167adef003144f679f4ca961edac8d31 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.190311   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:58:34.191196   604 consensus_peers.cc:597] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 -> Peer 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159): Couldn't send request to peer 167adef003144f679f4ca961edac8d31. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:34.207523   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:58:34.226972   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:34.227564   431 tablet_replica.cc:333] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224: stopping tablet replica
I20260709 12:58:34.228135   431 raft_consensus.cc:2243] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.228525   431 raft_consensus.cc:2272] T 48f7b8d019004d1bb34f4e9f883722eb P 3ef331b90a594e6489dfd39ebaee3224 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.230872   431 tablet_replica.cc:333] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224: stopping tablet replica
I20260709 12:58:34.231333   431 raft_consensus.cc:2243] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.231693   431 raft_consensus.cc:2272] T fbebec53d4bb45ee9cedd32e3702cc7c P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.233330   431 tablet_replica.cc:333] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224: stopping tablet replica
I20260709 12:58:34.233790   431 raft_consensus.cc:2243] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.234438   431 raft_consensus.cc:2272] T 82f172eef8a84cb68f23efe20d9818a0 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.235916   431 tablet_replica.cc:333] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224: stopping tablet replica
I20260709 12:58:34.236481   431 raft_consensus.cc:2243] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.237301   431 raft_consensus.cc:2272] T fbd1dce5aaa7422c841d31ec641e1fd1 P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.239256   431 tablet_replica.cc:333] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224: stopping tablet replica
W20260709 12:58:34.239297   678 consensus_peers.cc:597] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 -> Peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Couldn't send request to peer 3ef331b90a594e6489dfd39ebaee3224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:34.239774   431 raft_consensus.cc:2243] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.240182   431 raft_consensus.cc:2272] T f36934cab51c48c6a541ebcef13e9c03 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.241873   431 tablet_replica.cc:333] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224: stopping tablet replica
I20260709 12:58:34.242296   431 raft_consensus.cc:2243] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.242697   431 raft_consensus.cc:2272] T 9f51f3b2e11f49609d25b8ff5730df87 P 3ef331b90a594e6489dfd39ebaee3224 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.244658   431 tablet_replica.cc:333] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224: stopping tablet replica
I20260709 12:58:34.245131   431 raft_consensus.cc:2243] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.245777   431 raft_consensus.cc:2272] T 679ee1b0217c4e74980b16f699151bd7 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.247246   431 tablet_replica.cc:333] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224: stopping tablet replica
I20260709 12:58:34.247634   431 raft_consensus.cc:2243] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.247970   431 raft_consensus.cc:2272] T ef8743d3bfde49d9b57d8fa59461605f P 3ef331b90a594e6489dfd39ebaee3224 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.249539   431 tablet_replica.cc:333] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224: stopping tablet replica
I20260709 12:58:34.249933   431 raft_consensus.cc:2243] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.250298   431 raft_consensus.cc:2272] T 2d6b4f0a2ecd4c0887602048721f7c46 P 3ef331b90a594e6489dfd39ebaee3224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.275133   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 12:58:34.293648   678 consensus_peers.cc:597] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 -> Peer 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159): Couldn't send request to peer 167adef003144f679f4ca961edac8d31. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:34.294436   678 consensus_peers.cc:597] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 -> Peer 3ef331b90a594e6489dfd39ebaee3224 (127.0.107.194:41591): Couldn't send request to peer 3ef331b90a594e6489dfd39ebaee3224. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:34.297883   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:34.319250   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:34.319963   431 tablet_replica.cc:333] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3: stopping tablet replica
I20260709 12:58:34.320796   431 raft_consensus.cc:2243] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.321708   431 raft_consensus.cc:2272] T 2d6b4f0a2ecd4c0887602048721f7c46 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.323315   431 tablet_replica.cc:333] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3: stopping tablet replica
I20260709 12:58:34.323753   431 raft_consensus.cc:2243] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.324075   431 raft_consensus.cc:2272] T fbd1dce5aaa7422c841d31ec641e1fd1 P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.325539   431 tablet_replica.cc:333] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3: stopping tablet replica
I20260709 12:58:34.325948   431 raft_consensus.cc:2243] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.326522   431 raft_consensus.cc:2272] T 9f51f3b2e11f49609d25b8ff5730df87 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.328063   431 tablet_replica.cc:333] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3: stopping tablet replica
I20260709 12:58:34.328471   431 raft_consensus.cc:2243] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.328819   431 raft_consensus.cc:2272] T ef8743d3bfde49d9b57d8fa59461605f P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.330875   431 tablet_replica.cc:333] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3: stopping tablet replica
I20260709 12:58:34.331489   431 raft_consensus.cc:2243] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.331971   431 raft_consensus.cc:2272] T 679ee1b0217c4e74980b16f699151bd7 P b617c79595224797a4fa2ceda67ef9a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.334095   431 tablet_replica.cc:333] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3: stopping tablet replica
W20260709 12:58:34.334498   678 consensus_peers.cc:597] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 -> Peer 167adef003144f679f4ca961edac8d31 (127.0.107.193:43159): Couldn't send request to peer 167adef003144f679f4ca961edac8d31. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:34.334619   431 raft_consensus.cc:2243] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.335139   431 raft_consensus.cc:2272] T f36934cab51c48c6a541ebcef13e9c03 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.336702   431 tablet_replica.cc:333] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3: stopping tablet replica
I20260709 12:58:34.337139   431 raft_consensus.cc:2243] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.337742   431 raft_consensus.cc:2272] T 48f7b8d019004d1bb34f4e9f883722eb P b617c79595224797a4fa2ceda67ef9a3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.339449   431 tablet_replica.cc:333] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3: stopping tablet replica
I20260709 12:58:34.339877   431 raft_consensus.cc:2243] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.340257   431 raft_consensus.cc:2272] T 82f172eef8a84cb68f23efe20d9818a0 P b617c79595224797a4fa2ceda67ef9a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.341635   431 tablet_replica.cc:333] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3: stopping tablet replica
I20260709 12:58:34.342037   431 raft_consensus.cc:2243] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.342432   431 raft_consensus.cc:2272] T fbebec53d4bb45ee9cedd32e3702cc7c P b617c79595224797a4fa2ceda67ef9a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.367208   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:34.381692   431 master.cc:562] Master@127.0.107.254:37199 shutting down...
I20260709 12:58:34.487401   518 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:58:34.496479   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.496995   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.497308   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P c77bcda340f04519969e7c16ee79f9c0: stopping tablet replica
I20260709 12:58:34.515959   431 master.cc:584] Master@127.0.107.254:37199 shutdown complete.
167adef003144f679f4ca961edac8d31  4
3ef331b90a594e6489dfd39ebaee3224  4
b617c79595224797a4fa2ceda67ef9a3  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12375 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:58:34.551302   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:45273
I20260709 12:58:34.552363   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:34.557202   933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.557380   934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.558872   936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:34.559327   431 server_base.cc:1061] running on GCE node
I20260709 12:58:34.560096   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:34.560274   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:34.560437   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601914560400 us; error 0 us; skew 500 ppm
I20260709 12:58:34.560966   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:34.563402   431 webserver.cc:533] Webserver started at http://127.0.107.254:41575/ using document root <none> and password file <none>
I20260709 12:58:34.563876   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:34.564064   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:34.564317   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:34.565373   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/master-0-root/instance:
uuid: "a1766ff9636f4843b2220abc11f803bd"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-szgt"
I20260709 12:58:34.569334   431 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260709 12:58:34.572326   941 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.572926   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:58:34.573215   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/master-0-root
uuid: "a1766ff9636f4843b2220abc11f803bd"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-szgt"
I20260709 12:58:34.573462   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:34.594084   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:34.595257   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:34.629796   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:45273
I20260709 12:58:34.629880   992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:45273 every 8 connection(s)
I20260709 12:58:34.633388   993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.641940   993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd: Bootstrap starting.
I20260709 12:58:34.646552   993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:34.650190   993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd: No bootstrap required, opened a new log
I20260709 12:58:34.652089   993 raft_consensus.cc:359] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1766ff9636f4843b2220abc11f803bd" member_type: VOTER }
I20260709 12:58:34.652412   993 raft_consensus.cc:385] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:34.652596   993 raft_consensus.cc:740] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1766ff9636f4843b2220abc11f803bd, State: Initialized, Role: FOLLOWER
I20260709 12:58:34.653102   993 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1766ff9636f4843b2220abc11f803bd" member_type: VOTER }
I20260709 12:58:34.653482   993 raft_consensus.cc:399] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:34.653669   993 raft_consensus.cc:493] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:34.653893   993 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:34.657411   993 raft_consensus.cc:515] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1766ff9636f4843b2220abc11f803bd" member_type: VOTER }
I20260709 12:58:34.657825   993 leader_election.cc:304] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1766ff9636f4843b2220abc11f803bd; no voters: 
I20260709 12:58:34.658835   993 leader_election.cc:290] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:34.659093   996 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:34.660411   996 raft_consensus.cc:697] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 1 LEADER]: Becoming Leader. State: Replica: a1766ff9636f4843b2220abc11f803bd, State: Running, Role: LEADER
I20260709 12:58:34.661070   996 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1766ff9636f4843b2220abc11f803bd" member_type: VOTER }
I20260709 12:58:34.661653   993 sys_catalog.cc:565] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:34.665678   998 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1766ff9636f4843b2220abc11f803bd. Latest consensus state: current_term: 1 leader_uuid: "a1766ff9636f4843b2220abc11f803bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1766ff9636f4843b2220abc11f803bd" member_type: VOTER } }
I20260709 12:58:34.666361   998 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:34.668669   997 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1766ff9636f4843b2220abc11f803bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1766ff9636f4843b2220abc11f803bd" member_type: VOTER } }
I20260709 12:58:34.669356   997 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:34.673470  1002 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:34.678365  1002 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:34.686532   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:34.688565  1002 catalog_manager.cc:1383] Generated new cluster ID: 01b6640c907e4d8eb39956b931cd6127
I20260709 12:58:34.688804  1002 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:34.733572  1002 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:34.734691  1002 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:34.746608  1002 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd: Generated new TSK 0
I20260709 12:58:34.747174  1002 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:34.752733   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:34.758031  1014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.759243  1015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.760563  1017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:34.760979   431 server_base.cc:1061] running on GCE node
I20260709 12:58:34.761673   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:34.761838   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:34.761950   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601914761940 us; error 0 us; skew 500 ppm
I20260709 12:58:34.762387   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:34.764501   431 webserver.cc:533] Webserver started at http://127.0.107.193:46525/ using document root <none> and password file <none>
I20260709 12:58:34.764918   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:34.765064   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:34.765257   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:34.766170   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-0-root/instance:
uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-szgt"
I20260709 12:58:34.770030   431 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260709 12:58:34.772866  1022 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.773468   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:58:34.773684   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-szgt"
I20260709 12:58:34.773888   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:34.786170   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:34.787191   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:34.788383   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:34.790307   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:34.790504   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.790772   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:34.790961   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.825680   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:44611
I20260709 12:58:34.825764  1084 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:44611 every 8 connection(s)
I20260709 12:58:34.830232   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:34.836872  1089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.837750  1090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.840543  1092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:34.841324   431 server_base.cc:1061] running on GCE node
I20260709 12:58:34.842396   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:34.842563   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:34.842738   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601914842719 us; error 0 us; skew 500 ppm
I20260709 12:58:34.843170   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:34.845399   431 webserver.cc:533] Webserver started at http://127.0.107.194:38373/ using document root <none> and password file <none>
I20260709 12:58:34.846050   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:34.846273   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:34.846571   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:34.847203  1085 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45273
I20260709 12:58:34.847519  1085 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:34.847852   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-1-root/instance:
uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-szgt"
I20260709 12:58:34.848251  1085 heartbeater.cc:507] Master 127.0.107.254:45273 requested a full tablet report, sending...
I20260709 12:58:34.850174   958 ts_manager.cc:194] Registered new tserver with Master: 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611)
I20260709 12:58:34.851912   958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36266
I20260709 12:58:34.852553   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:58:34.855588  1097 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.856240   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:34.856498   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-1-root
uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-szgt"
I20260709 12:58:34.856746   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:34.876919   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:34.878007   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:34.879395   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:34.881392   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:34.881582   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.881834   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:34.881973   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.918951   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:40279
I20260709 12:58:34.919041  1159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:40279 every 8 connection(s)
I20260709 12:58:34.923411   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:34.930119  1163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.931877  1164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.935113  1166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:34.935529   431 server_base.cc:1061] running on GCE node
I20260709 12:58:34.936197  1160 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45273
I20260709 12:58:34.936553   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:58:34.936615  1160 heartbeater.cc:461] Registering TS with master...
W20260709 12:58:34.936909   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:34.937107   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601914937092 us; error 0 us; skew 500 ppm
I20260709 12:58:34.937508  1160 heartbeater.cc:507] Master 127.0.107.254:45273 requested a full tablet report, sending...
I20260709 12:58:34.937640   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:34.939607   958 ts_manager.cc:194] Registered new tserver with Master: d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:34.940447   431 webserver.cc:533] Webserver started at http://127.0.107.195:41733/ using document root <none> and password file <none>
I20260709 12:58:34.940925   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:34.941145   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:34.941011   958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36270
I20260709 12:58:34.941484   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:34.942658   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-2-root/instance:
uuid: "c5d2d678e76d4d3aad49521856989aae"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-szgt"
I20260709 12:58:34.946578   431 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:58:34.949586  1171 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.950281   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:58:34.950558   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-2-root
uuid: "c5d2d678e76d4d3aad49521856989aae"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-szgt"
I20260709 12:58:34.950862   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601902018772-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:34.964501   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:34.965689   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:34.967058   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:34.968979   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:34.969177   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.969413   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:34.969573   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.005995   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:36839
I20260709 12:58:35.006078  1233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:36839 every 8 connection(s)
I20260709 12:58:35.017962  1234 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45273
I20260709 12:58:35.018280  1234 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:35.019050  1234 heartbeater.cc:507] Master 127.0.107.254:45273 requested a full tablet report, sending...
I20260709 12:58:35.020813   958 ts_manager.cc:194] Registered new tserver with Master: c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.021111   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.011969833s
I20260709 12:58:35.022425   958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36280
I20260709 12:58:35.043303   958 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36284:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:35.045863   958 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:35.124933  1199 tablet_service.cc:1511] Processing CreateTablet for tablet 05b30b02204b4588bc5517f0c63e8c33 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:35.126291  1199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b30b02204b4588bc5517f0c63e8c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.128607  1198 tablet_service.cc:1511] Processing CreateTablet for tablet f315ce1ede9b438d89c54a90758aa691 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:35.129143  1197 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb3e309ac8241b3926a0057a4a7b944 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:35.129864  1198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f315ce1ede9b438d89c54a90758aa691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.130465  1197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb3e309ac8241b3926a0057a4a7b944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.140576  1196 tablet_service.cc:1511] Processing CreateTablet for tablet 616cbbeddcdb4f6b9d11c2c7719276d5 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:35.142267  1196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616cbbeddcdb4f6b9d11c2c7719276d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.146469  1125 tablet_service.cc:1511] Processing CreateTablet for tablet 05b30b02204b4588bc5517f0c63e8c33 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:35.147704  1125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b30b02204b4588bc5517f0c63e8c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.148150  1124 tablet_service.cc:1511] Processing CreateTablet for tablet f315ce1ede9b438d89c54a90758aa691 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:35.148548  1199 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdcb3a1058b42a5aaee93f47c7cbc15 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:35.149261  1124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f315ce1ede9b438d89c54a90758aa691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.151436  1118 tablet_service.cc:1511] Processing CreateTablet for tablet e4696b682cb1442cae3322616fe744a6 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:35.151718  1197 tablet_service.cc:1511] Processing CreateTablet for tablet 075bf95529704009a9ad40b1d34d0201 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:35.152136  1195 tablet_service.cc:1511] Processing CreateTablet for tablet e4696b682cb1442cae3322616fe744a6 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:35.153410  1123 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb3e309ac8241b3926a0057a4a7b944 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:35.154335  1199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdcb3a1058b42a5aaee93f47c7cbc15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.155530  1122 tablet_service.cc:1511] Processing CreateTablet for tablet 616cbbeddcdb4f6b9d11c2c7719276d5 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:35.156888  1195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4696b682cb1442cae3322616fe744a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.157454  1121 tablet_service.cc:1511] Processing CreateTablet for tablet 98a657945a214a778f926b5eca233f93 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:35.159787  1194 tablet_service.cc:1511] Processing CreateTablet for tablet 281f1b7e5b6d4ba8b2fc37b845d77e1c (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:35.159922  1117 tablet_service.cc:1511] Processing CreateTablet for tablet 281f1b7e5b6d4ba8b2fc37b845d77e1c (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:35.160974  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281f1b7e5b6d4ba8b2fc37b845d77e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.161123  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281f1b7e5b6d4ba8b2fc37b845d77e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.161245  1196 tablet_service.cc:1511] Processing CreateTablet for tablet cf8a70f259284b0b97306da8ccf75758 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:35.162374  1196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8a70f259284b0b97306da8ccf75758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.163343  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 075bf95529704009a9ad40b1d34d0201 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:35.163349  1120 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdcb3a1058b42a5aaee93f47c7cbc15 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:35.166718  1197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075bf95529704009a9ad40b1d34d0201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.172209  1116 tablet_service.cc:1511] Processing CreateTablet for tablet cf8a70f259284b0b97306da8ccf75758 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:35.173918  1046 tablet_service.cc:1511] Processing CreateTablet for tablet 98a657945a214a778f926b5eca233f93 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:35.175132  1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a657945a214a778f926b5eca233f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.166460  1050 tablet_service.cc:1511] Processing CreateTablet for tablet 05b30b02204b4588bc5517f0c63e8c33 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:35.180102  1045 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdcb3a1058b42a5aaee93f47c7cbc15 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:35.180801  1050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b30b02204b4588bc5517f0c63e8c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.180830  1043 tablet_service.cc:1511] Processing CreateTablet for tablet e4696b682cb1442cae3322616fe744a6 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:35.182116  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4696b682cb1442cae3322616fe744a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.182220  1044 tablet_service.cc:1511] Processing CreateTablet for tablet 075bf95529704009a9ad40b1d34d0201 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:35.163651  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a657945a214a778f926b5eca233f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.183359  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075bf95529704009a9ad40b1d34d0201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.184892  1123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb3e309ac8241b3926a0057a4a7b944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.167944  1049 tablet_service.cc:1511] Processing CreateTablet for tablet f315ce1ede9b438d89c54a90758aa691 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:35.180125  1047 tablet_service.cc:1511] Processing CreateTablet for tablet 616cbbeddcdb4f6b9d11c2c7719276d5 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:35.187371  1049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f315ce1ede9b438d89c54a90758aa691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.188026  1047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616cbbeddcdb4f6b9d11c2c7719276d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.169456  1048 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb3e309ac8241b3926a0057a4a7b944 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:35.188911  1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb3e309ac8241b3926a0057a4a7b944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.189435  1045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdcb3a1058b42a5aaee93f47c7cbc15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.188094  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4696b682cb1442cae3322616fe744a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.191030  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdcb3a1058b42a5aaee93f47c7cbc15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.194960  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075bf95529704009a9ad40b1d34d0201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.198997  1122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616cbbeddcdb4f6b9d11c2c7719276d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.199877  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8a70f259284b0b97306da8ccf75758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.205601  1041 tablet_service.cc:1511] Processing CreateTablet for tablet cf8a70f259284b0b97306da8ccf75758 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:35.207577  1042 tablet_service.cc:1511] Processing CreateTablet for tablet 281f1b7e5b6d4ba8b2fc37b845d77e1c (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:35.208964  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8a70f259284b0b97306da8ccf75758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.210986  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281f1b7e5b6d4ba8b2fc37b845d77e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.248379  1198 tablet_service.cc:1511] Processing CreateTablet for tablet 98a657945a214a778f926b5eca233f93 (DEFAULT_TABLE table=test-workload [id=631ac08104b146a8a3e416697cbab3be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:35.249711  1198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a657945a214a778f926b5eca233f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.254575  1249 tablet_bootstrap.cc:492] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.256994  1250 tablet_bootstrap.cc:492] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:35.268472  1249 tablet_bootstrap.cc:654] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.274010  1251 tablet_bootstrap.cc:492] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.289135  1250 tablet_bootstrap.cc:654] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.299659  1250 tablet_bootstrap.cc:492] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:35.300045  1250 ts_tablet_manager.cc:1403] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.005s
I20260709 12:58:35.300730  1251 tablet_bootstrap.cc:654] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.301988  1250 raft_consensus.cc:359] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.302510  1250 raft_consensus.cc:385] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.302870  1250 raft_consensus.cc:740] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.303966  1249 tablet_bootstrap.cc:492] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.303730  1250 consensus_queue.cc:260] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.304382  1249 ts_tablet_manager.cc:1403] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.019s
I20260709 12:58:35.304736  1251 tablet_bootstrap.cc:492] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:35.305213  1251 ts_tablet_manager.cc:1403] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.032s	user 0.000s	sys 0.011s
I20260709 12:58:35.305686  1160 heartbeater.cc:499] Master 127.0.107.254:45273 was elected leader, sending a full tablet report...
I20260709 12:58:35.306155  1250 ts_tablet_manager.cc:1434] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:58:35.307011  1250 tablet_bootstrap.cc:492] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:35.307307  1249 raft_consensus.cc:359] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:35.308142  1249 raft_consensus.cc:385] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.307878  1251 raft_consensus.cc:359] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.308447  1249 raft_consensus.cc:740] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.308598  1251 raft_consensus.cc:385] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.308945  1251 raft_consensus.cc:740] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.309268  1249 consensus_queue.cc:260] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:35.309753  1251 consensus_queue.cc:260] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.313884  1250 tablet_bootstrap.cc:654] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.319052  1251 ts_tablet_manager.cc:1434] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:58:35.319763  1085 heartbeater.cc:499] Master 127.0.107.254:45273 was elected leader, sending a full tablet report...
I20260709 12:58:35.334880  1234 heartbeater.cc:499] Master 127.0.107.254:45273 was elected leader, sending a full tablet report...
I20260709 12:58:35.334928  1258 raft_consensus.cc:493] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.335847  1258 raft_consensus.cc:515] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:35.340171  1258 leader_election.cc:290] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611)
I20260709 12:58:35.340517  1251 tablet_bootstrap.cc:492] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.347569  1251 tablet_bootstrap.cc:654] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.353852  1251 tablet_bootstrap.cc:492] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:35.354458  1251 ts_tablet_manager.cc:1403] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:58:35.358309  1251 raft_consensus.cc:359] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.359294  1251 raft_consensus.cc:385] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.359699  1251 raft_consensus.cc:740] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.360575  1251 consensus_queue.cc:260] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.362130  1249 ts_tablet_manager.cc:1434] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.012s
I20260709 12:58:35.362907  1251 ts_tablet_manager.cc:1434] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:35.363245  1249 tablet_bootstrap.cc:492] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.363758  1251 tablet_bootstrap.cc:492] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.364763  1250 tablet_bootstrap.cc:492] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:35.365305  1250 ts_tablet_manager.cc:1403] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.035s
I20260709 12:58:35.368638  1250 raft_consensus.cc:359] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.370122  1250 raft_consensus.cc:385] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.370404  1250 raft_consensus.cc:740] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.369819  1249 tablet_bootstrap.cc:654] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.372802  1251 tablet_bootstrap.cc:654] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.373664  1250 consensus_queue.cc:260] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.377982  1250 ts_tablet_manager.cc:1434] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:58:35.378860  1250 tablet_bootstrap.cc:492] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:35.384539  1250 tablet_bootstrap.cc:654] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.388520  1249 tablet_bootstrap.cc:492] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.388954  1249 ts_tablet_manager.cc:1403] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.005s
I20260709 12:58:35.388962  1251 tablet_bootstrap.cc:492] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:35.389896  1251 ts_tablet_manager.cc:1403] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.002s
I20260709 12:58:35.391762  1249 raft_consensus.cc:359] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.392481  1249 raft_consensus.cc:385] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.392791  1249 raft_consensus.cc:740] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.393502  1249 consensus_queue.cc:260] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.393659  1251 raft_consensus.cc:359] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.394533  1251 raft_consensus.cc:385] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.394932  1251 raft_consensus.cc:740] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.395370  1249 ts_tablet_manager.cc:1434] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:58:35.396152  1249 tablet_bootstrap.cc:492] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.396023  1251 consensus_queue.cc:260] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.401605  1251 ts_tablet_manager.cc:1434] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:58:35.403025  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b30b02204b4588bc5517f0c63e8c33" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.404881  1250 tablet_bootstrap.cc:492] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:35.405306  1135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b30b02204b4588bc5517f0c63e8c33" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.405530  1250 ts_tablet_manager.cc:1403] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.012s
W20260709 12:58:35.404819  1173 leader_election.cc:343] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:35.406610  1173 leader_election.cc:343] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.407013  1173 leader_election.cc:304] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.407771  1256 raft_consensus.cc:2749] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:35.408666  1249 tablet_bootstrap.cc:654] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.408959  1250 raft_consensus.cc:359] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.409744  1250 raft_consensus.cc:385] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.410142  1250 raft_consensus.cc:740] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.403275  1251 tablet_bootstrap.cc:492] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.411046  1250 consensus_queue.cc:260] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.413182  1250 ts_tablet_manager.cc:1434] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:35.414054  1250 tablet_bootstrap.cc:492] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:35.417564  1251 tablet_bootstrap.cc:654] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.417953  1249 tablet_bootstrap.cc:492] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.418373  1249 ts_tablet_manager.cc:1403] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 12:58:35.420279  1250 tablet_bootstrap.cc:654] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.421308  1249 raft_consensus.cc:359] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.422019  1249 raft_consensus.cc:385] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.422351  1249 raft_consensus.cc:740] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.423377  1249 consensus_queue.cc:260] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.425227  1251 tablet_bootstrap.cc:492] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:35.425420  1249 ts_tablet_manager.cc:1434] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:35.425746  1251 ts_tablet_manager.cc:1403] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.001s
I20260709 12:58:35.426574  1249 tablet_bootstrap.cc:492] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.426553  1258 raft_consensus.cc:493] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.427100  1258 raft_consensus.cc:515] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.428938  1258 leader_election.cc:290] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.429077  1251 raft_consensus.cc:359] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.429891  1251 raft_consensus.cc:385] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.430235  1251 raft_consensus.cc:740] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.431443  1251 consensus_queue.cc:260] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.432909  1249 tablet_bootstrap.cc:654] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.434399  1251 ts_tablet_manager.cc:1434] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:35.436043  1251 tablet_bootstrap.cc:492] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.441138  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f315ce1ede9b438d89c54a90758aa691" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.441921  1060 raft_consensus.cc:2468] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 0.
I20260709 12:58:35.443504  1251 tablet_bootstrap.cc:654] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.443950  1250 tablet_bootstrap.cc:492] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:35.444433  1250 ts_tablet_manager.cc:1403] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.017s
I20260709 12:58:35.445160  1135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f315ce1ede9b438d89c54a90758aa691" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.447445  1250 raft_consensus.cc:359] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.448220  1249 tablet_bootstrap.cc:492] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.448657  1249 ts_tablet_manager.cc:1403] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:58:35.448408  1250 raft_consensus.cc:385] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.449335  1250 raft_consensus.cc:740] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
W20260709 12:58:35.449996  1173 leader_election.cc:343] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.450789  1173 leader_election.cc:304] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.450307  1250 consensus_queue.cc:260] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.451507  1258 raft_consensus.cc:2804] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.451328  1249 raft_consensus.cc:359] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.451889  1258 raft_consensus.cc:493] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.452008  1249 raft_consensus.cc:385] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.452231  1258 raft_consensus.cc:3060] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.453311  1250 ts_tablet_manager.cc:1434] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:58:35.454839  1250 tablet_bootstrap.cc:492] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:35.452342  1249 raft_consensus.cc:740] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.457183  1249 consensus_queue.cc:260] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.458129  1251 tablet_bootstrap.cc:492] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:35.458571  1251 ts_tablet_manager.cc:1403] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 12:58:35.461314  1250 tablet_bootstrap.cc:654] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.462185  1249 ts_tablet_manager.cc:1434] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:58:35.463119  1249 tablet_bootstrap.cc:492] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.464092  1251 raft_consensus.cc:359] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:35.464972  1251 raft_consensus.cc:385] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.465315  1251 raft_consensus.cc:740] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.466166  1251 consensus_queue.cc:260] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:35.469195  1249 tablet_bootstrap.cc:654] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.472483  1251 ts_tablet_manager.cc:1434] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:58:35.472594  1250 tablet_bootstrap.cc:492] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:35.473090  1250 ts_tablet_manager.cc:1403] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:58:35.473395  1251 tablet_bootstrap.cc:492] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.459393  1258 raft_consensus.cc:515] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.475839  1250 raft_consensus.cc:359] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.476528  1250 raft_consensus.cc:385] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.476830  1250 raft_consensus.cc:740] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.477267  1258 leader_election.cc:290] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.477572  1250 consensus_queue.cc:260] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.479115  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f315ce1ede9b438d89c54a90758aa691" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:35.479683  1060 raft_consensus.cc:3060] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.481129  1249 tablet_bootstrap.cc:492] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.481566  1249 ts_tablet_manager.cc:1403] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:58:35.482744  1250 ts_tablet_manager.cc:1434] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:35.483741  1250 tablet_bootstrap.cc:492] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:35.484272  1249 raft_consensus.cc:359] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.484918  1249 raft_consensus.cc:385] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.485180  1249 raft_consensus.cc:740] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.485457  1251 tablet_bootstrap.cc:654] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.486032  1249 consensus_queue.cc:260] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.486517  1060 raft_consensus.cc:2468] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 1.
I20260709 12:58:35.488194  1249 ts_tablet_manager.cc:1434] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:35.489105  1249 tablet_bootstrap.cc:492] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.490935  1255 raft_consensus.cc:493] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.491504  1255 raft_consensus.cc:515] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.495105  1249 tablet_bootstrap.cc:654] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.494510  1255 leader_election.cc:290] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.497494  1135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f315ce1ede9b438d89c54a90758aa691" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:35.498270  1135 raft_consensus.cc:3060] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.505723  1173 leader_election.cc:304] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: 
I20260709 12:58:35.506206  1249 tablet_bootstrap.cc:492] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.506636  1249 ts_tablet_manager.cc:1403] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:58:35.506705  1256 raft_consensus.cc:2804] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.507201  1256 raft_consensus.cc:697] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:35.507993  1256 consensus_queue.cc:237] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.509722  1257 raft_consensus.cc:493] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.509579  1249 raft_consensus.cc:359] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.510326  1249 raft_consensus.cc:385] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.510756  1249 raft_consensus.cc:740] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.510356  1257 raft_consensus.cc:515] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:35.511413  1249 consensus_queue.cc:260] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.515971  1257 leader_election.cc:290] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.519944  1249 ts_tablet_manager.cc:1434] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:58:35.521087  1249 tablet_bootstrap.cc:492] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.529110  1249 tablet_bootstrap.cc:654] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.529969  1250 tablet_bootstrap.cc:654] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.530885  1135 raft_consensus.cc:2468] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 1.
I20260709 12:58:35.531953  1274 raft_consensus.cc:493] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.537480  1274 raft_consensus.cc:515] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.540277  1274 leader_election.cc:290] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.542089  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.542900  1134 raft_consensus.cc:2468] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 0.
I20260709 12:58:35.544327  1173 leader_election.cc:304] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:35.541035  1249 tablet_bootstrap.cc:492] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.540881  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.545538  1249 ts_tablet_manager.cc:1403] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 12:58:35.545447  1274 raft_consensus.cc:2804] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.546111  1274 raft_consensus.cc:493] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:35.546245  1173 leader_election.cc:343] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.546659  1274 raft_consensus.cc:3060] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.548804  1249 raft_consensus.cc:359] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.549607  1249 raft_consensus.cc:385] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.549885  1249 raft_consensus.cc:740] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.550567  1249 consensus_queue.cc:260] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.552718  1249 ts_tablet_manager.cc:1434] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:35.553968  1249 tablet_bootstrap.cc:492] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.561233  1257 raft_consensus.cc:493] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.561992  1257 raft_consensus.cc:515] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.564306  1257 leader_election.cc:290] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.565414  1249 tablet_bootstrap.cc:654] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.571720  1274 raft_consensus.cc:515] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.583848  1274 leader_election.cc:290] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.584870  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:35.590862  1255 raft_consensus.cc:493] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.594075  1135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:35.594776  1135 raft_consensus.cc:3060] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.592458  1255 raft_consensus.cc:515] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
W20260709 12:58:35.595976  1173 leader_election.cc:343] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.597368  1255 leader_election.cc:290] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.604806  1135 raft_consensus.cc:2468] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 1.
I20260709 12:58:35.606177  1173 leader_election.cc:304] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:35.607060  1274 raft_consensus.cc:2804] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.607493  1274 raft_consensus.cc:697] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:35.608170  1274 consensus_queue.cc:237] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.612552  1250 tablet_bootstrap.cc:492] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:35.612995  1250 ts_tablet_manager.cc:1403] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.129s	user 0.007s	sys 0.005s
I20260709 12:58:35.616099  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.616425  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.616665  1060 raft_consensus.cc:2468] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 0.
I20260709 12:58:35.619446  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.620637  1249 tablet_bootstrap.cc:492] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.621112  1249 ts_tablet_manager.cc:1403] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.012s
I20260709 12:58:35.621981  1099 leader_election.cc:304] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:35.622164  1135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b30b02204b4588bc5517f0c63e8c33" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
W20260709 12:58:35.622102  1024 leader_election.cc:343] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.623111  1255 raft_consensus.cc:2804] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.624373  1255 raft_consensus.cc:493] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.624785  1251 tablet_bootstrap.cc:492] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:35.624815  1255 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.625176  1251 ts_tablet_manager.cc:1403] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.152s	user 0.050s	sys 0.055s
I20260709 12:58:35.620452  1250 raft_consensus.cc:359] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.628518  1250 raft_consensus.cc:385] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.629170  1250 raft_consensus.cc:740] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.629822  1250 consensus_queue.cc:260] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
W20260709 12:58:35.628741  1099 leader_election.cc:343] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.632599  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b30b02204b4588bc5517f0c63e8c33" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:35.633178  1209 raft_consensus.cc:2468] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 0.
W20260709 12:58:35.633348  1024 leader_election.cc:343] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.633186  1274 raft_consensus.cc:493] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.634310  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:35.634068  1274 raft_consensus.cc:515] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.628012  1251 raft_consensus.cc:359] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.635360  1258 raft_consensus.cc:493] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.635614  1251 raft_consensus.cc:385] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.635921  1251 raft_consensus.cc:740] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.635772  1258 raft_consensus.cc:515] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.636714  1256 raft_consensus.cc:493] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.636579  1251 consensus_queue.cc:260] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.637684  1258 leader_election.cc:290] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.637271  1256 raft_consensus.cc:515] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.639667  1251 ts_tablet_manager.cc:1434] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:58:35.639569  1274 leader_election.cc:290] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.640712  1251 tablet_bootstrap.cc:492] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.641672  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8a70f259284b0b97306da8ccf75758" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.642879  1135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
W20260709 12:58:35.643112  1173 leader_election.cc:343] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.643637  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8a70f259284b0b97306da8ccf75758" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.644235  1134 raft_consensus.cc:2468] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 0.
I20260709 12:58:35.645545  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.646343  1256 leader_election.cc:290] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.646258  1060 raft_consensus.cc:2468] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 0.
I20260709 12:58:35.647796  1024 leader_election.cc:304] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.648198  1251 tablet_bootstrap.cc:654] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.648233  1173 leader_election.cc:304] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: 
I20260709 12:58:35.648509  1257 raft_consensus.cc:2804] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.648855  1257 raft_consensus.cc:493] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.649163  1173 leader_election.cc:304] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733
W20260709 12:58:35.649706  1024 leader_election.cc:343] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.649194  1257 raft_consensus.cc:3060] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.651839  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.652527  1256 raft_consensus.cc:2804] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.652634  1134 raft_consensus.cc:2468] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 0.
I20260709 12:58:35.653204  1256 raft_consensus.cc:493] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.654134  1256 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.653048  1250 ts_tablet_manager.cc:1434] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.018s
I20260709 12:58:35.659132  1173 leader_election.cc:304] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:35.659524  1250 tablet_bootstrap.cc:492] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:35.660060  1258 raft_consensus.cc:2804] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.660367  1258 raft_consensus.cc:493] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.660652  1258 raft_consensus.cc:3060] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.663654  1249 raft_consensus.cc:359] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.652153  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.653751  1274 raft_consensus.cc:2804] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.664425  1249 raft_consensus.cc:385] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.665138  1249 raft_consensus.cc:740] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.650177  1024 leader_election.cc:304] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733; no voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.666529  1249 consensus_queue.cc:260] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.668478  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:35.670081  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
W20260709 12:58:35.671327  1173 leader_election.cc:343] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.674423  1256 raft_consensus.cc:515] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.675523  1208 raft_consensus.cc:2393] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d83adaaffefb48b88b90baf6fc91bfc4 in current term 1: Already voted for candidate c5d2d678e76d4d3aad49521856989aae in this term.
I20260709 12:58:35.665186  1274 raft_consensus.cc:493] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.679054  1274 raft_consensus.cc:3060] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.679538  1258 raft_consensus.cc:515] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.679416   955 catalog_manager.cc:5697] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:35.680648  1209 raft_consensus.cc:2393] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d83adaaffefb48b88b90baf6fc91bfc4 in current term 1: Already voted for candidate c5d2d678e76d4d3aad49521856989aae in this term.
I20260709 12:58:35.681461   955 catalog_manager.cc:5697] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:35.682725  1006 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:35.683662  1257 raft_consensus.cc:515] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:35.683871  1099 leader_election.cc:304] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d83adaaffefb48b88b90baf6fc91bfc4; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae
I20260709 12:58:35.666747  1255 raft_consensus.cc:515] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.685770  1250 tablet_bootstrap.cc:654] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.685704  1284 raft_consensus.cc:3060] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.686007  1257 leader_election.cc:290] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 election: Requested vote from peers c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.687960  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
W20260709 12:58:35.689203  1173 leader_election.cc:343] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.689945  1251 tablet_bootstrap.cc:492] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:35.690410  1251 ts_tablet_manager.cc:1403] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.010s
I20260709 12:58:35.690464  1274 raft_consensus.cc:515] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.691402  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:35.692507  1274 leader_election.cc:290] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.693058  1257 raft_consensus.cc:2749] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:35.693234  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8a70f259284b0b97306da8ccf75758" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:35.695506  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8a70f259284b0b97306da8ccf75758" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:35.696220  1133 raft_consensus.cc:3060] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.696532  1135 raft_consensus.cc:2393] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5d2d678e76d4d3aad49521856989aae in current term 1: Already voted for candidate d83adaaffefb48b88b90baf6fc91bfc4 in this term.
I20260709 12:58:35.697202  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:35.697292  1257 raft_consensus.cc:493] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.697917  1209 raft_consensus.cc:2393] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d83adaaffefb48b88b90baf6fc91bfc4 in current term 1: Already voted for candidate c5d2d678e76d4d3aad49521856989aae in this term.
I20260709 12:58:35.697773  1257 raft_consensus.cc:515] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.698735  1251 raft_consensus.cc:359] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.699966  1257 leader_election.cc:290] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
W20260709 12:58:35.700042  1173 leader_election.cc:343] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.696234  1255 leader_election.cc:290] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.702131  1284 raft_consensus.cc:2749] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:35.699438  1251 raft_consensus.cc:385] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.704929  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:35.703804  1258 leader_election.cc:290] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.706967  1060 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.713577  1133 raft_consensus.cc:2468] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 1.
I20260709 12:58:35.720069  1173 leader_election.cc:304] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:35.721084  1134 raft_consensus.cc:2468] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 1.
I20260709 12:58:35.721455  1258 raft_consensus.cc:2804] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.705313  1251 raft_consensus.cc:740] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.722230  1258 raft_consensus.cc:697] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:35.723369  1258 consensus_queue.cc:237] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.724255  1173 leader_election.cc:304] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:35.725667  1274 raft_consensus.cc:2804] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.726229  1274 raft_consensus.cc:697] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:35.716203  1060 raft_consensus.cc:2468] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 1.
I20260709 12:58:35.727322  1274 consensus_queue.cc:237] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
W20260709 12:58:35.728811  1024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36839, user_credentials={real_user=slave}} blocked reactor thread for 79100.2us
I20260709 12:58:35.729264  1249 ts_tablet_manager.cc:1434] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.108s	user 0.025s	sys 0.019s
I20260709 12:58:35.730106  1249 tablet_bootstrap.cc:492] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.730545  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b30b02204b4588bc5517f0c63e8c33" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:35.732700  1173 leader_election.cc:304] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: 
I20260709 12:58:35.733655  1256 leader_election.cc:290] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.737048  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b30b02204b4588bc5517f0c63e8c33" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:35.733673  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.731969  1251 consensus_queue.cc:260] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.732102  1209 raft_consensus.cc:3060] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.740638  1256 raft_consensus.cc:2804] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.741212  1256 raft_consensus.cc:697] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:35.742206  1256 consensus_queue.cc:237] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
W20260709 12:58:35.748657  1024 leader_election.cc:343] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.748497  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
W20260709 12:58:35.749342  1024 leader_election.cc:343] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.750905  1249 tablet_bootstrap.cc:654] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.751891  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:35.752660  1060 raft_consensus.cc:2393] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d83adaaffefb48b88b90baf6fc91bfc4 in current term 1: Already voted for candidate c5d2d678e76d4d3aad49521856989aae in this term.
W20260709 12:58:35.754086  1024 leader_election.cc:343] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.754297  1284 raft_consensus.cc:493] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.754623  1024 leader_election.cc:304] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733; no voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.754922  1284 raft_consensus.cc:515] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.755548  1287 raft_consensus.cc:2749] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:35.755962  1099 leader_election.cc:304] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d83adaaffefb48b88b90baf6fc91bfc4; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae
I20260709 12:58:35.756798  1255 raft_consensus.cc:2749] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:35.757475  1284 leader_election.cc:290] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.758114  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.758919  1060 raft_consensus.cc:2468] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 0.
I20260709 12:58:35.759840  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:35.760078  1099 leader_election.cc:304] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
W20260709 12:58:35.761468  1099 leader_election.cc:343] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.760897  1251 ts_tablet_manager.cc:1434] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 12:58:35.761847  1284 raft_consensus.cc:2804] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.765929  1284 raft_consensus.cc:493] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.770413  1284 raft_consensus.cc:3060] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.765247  1251 tablet_bootstrap.cc:492] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.778505  1209 raft_consensus.cc:2468] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 1.
I20260709 12:58:35.780150  1024 leader_election.cc:304] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.781426  1287 raft_consensus.cc:2804] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.781953  1287 raft_consensus.cc:697] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:35.782984  1287 consensus_queue.cc:237] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:35.789358  1251 tablet_bootstrap.cc:654] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.789170  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:35.790270  1134 raft_consensus.cc:2393] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c5d2d678e76d4d3aad49521856989aae in current term 1: Already voted for candidate d83adaaffefb48b88b90baf6fc91bfc4 in this term.
I20260709 12:58:35.791917  1257 raft_consensus.cc:493] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.792425  1257 raft_consensus.cc:515] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.793325  1249 tablet_bootstrap.cc:492] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.793569  1250 tablet_bootstrap.cc:492] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:35.793713  1249 ts_tablet_manager.cc:1403] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.064s	user 0.005s	sys 0.017s
I20260709 12:58:35.794072  1250 ts_tablet_manager.cc:1403] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.135s	user 0.020s	sys 0.012s
I20260709 12:58:35.794163  1257 leader_election.cc:290] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.796206  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.796074  1249 raft_consensus.cc:359] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.796687  1249 raft_consensus.cc:385] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.796927  1249 raft_consensus.cc:740] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
W20260709 12:58:35.797539  1024 leader_election.cc:343] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.797266  1250 raft_consensus.cc:359] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.797912  1249 consensus_queue.cc:260] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.798491  1250 raft_consensus.cc:385] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.798943  1250 raft_consensus.cc:740] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.799237  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:35.803987  1209 raft_consensus.cc:2468] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 0.
I20260709 12:58:35.805109  1024 leader_election.cc:304] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.800375  1249 ts_tablet_manager.cc:1434] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:35.806977  1257 raft_consensus.cc:2804] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.807301  1257 raft_consensus.cc:493] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.807581  1257 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.807762  1249 tablet_bootstrap.cc:492] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae: Bootstrap starting.
I20260709 12:58:35.814227  1249 tablet_bootstrap.cc:654] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.814353  1257 raft_consensus.cc:515] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.816428  1257 leader_election.cc:290] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.803161  1284 raft_consensus.cc:515] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.819550   955 catalog_manager.cc:5697] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:35.801465  1250 consensus_queue.cc:260] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.817790  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:35.818595  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:35.821794  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
W20260709 12:58:35.822232  1024 leader_election.cc:343] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.822485  1209 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.822556  1060 raft_consensus.cc:3060] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.829916  1250 ts_tablet_manager.cc:1434] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 12:58:35.835716  1250 tablet_bootstrap.cc:492] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:35.836737  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:35.831410  1060 raft_consensus.cc:2468] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 1.
W20260709 12:58:35.838533  1099 leader_election.cc:343] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.832077   955 catalog_manager.cc:5697] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:35.839318  1284 leader_election.cc:290] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.839653  1099 leader_election.cc:304] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: c5d2d678e76d4d3aad49521856989aae
I20260709 12:58:35.840390  1284 raft_consensus.cc:2804] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.840111   955 catalog_manager.cc:5697] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:35.841233  1284 raft_consensus.cc:697] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Becoming Leader. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Running, Role: LEADER
I20260709 12:58:35.842113  1284 consensus_queue.cc:237] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.851390  1209 raft_consensus.cc:2468] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 1.
I20260709 12:58:35.853024  1251 tablet_bootstrap.cc:492] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:35.853430  1251 ts_tablet_manager.cc:1403] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.023s
I20260709 12:58:35.854326  1250 tablet_bootstrap.cc:654] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.855047  1291 raft_consensus.cc:493] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.855592  1024 leader_election.cc:304] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.855490  1291 raft_consensus.cc:515] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.857558  1291 leader_election.cc:290] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.857775  1249 tablet_bootstrap.cc:492] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae: No bootstrap required, opened a new log
I20260709 12:58:35.857731  1287 raft_consensus.cc:2804] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.858282  1249 ts_tablet_manager.cc:1403] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.015s
I20260709 12:58:35.859754  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.859962  1287 raft_consensus.cc:697] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
W20260709 12:58:35.861167  1173 leader_election.cc:343] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.860888  1287 consensus_queue.cc:237] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.861976  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.861608  1249 raft_consensus.cc:359] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.862530  1249 raft_consensus.cc:385] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.862856  1249 raft_consensus.cc:740] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Initialized, Role: FOLLOWER
W20260709 12:58:35.863261  1173 leader_election.cc:343] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.863673  1173 leader_election.cc:304] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.863787  1249 consensus_queue.cc:260] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.866910  1291 raft_consensus.cc:2749] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:35.867841  1274 raft_consensus.cc:493] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.868250  1274 raft_consensus.cc:515] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.870047  1274 leader_election.cc:290] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.870579  1251 raft_consensus.cc:359] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.870450   956 catalog_manager.cc:5697] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 0 to 1, leader changed from <none> to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:35.871488  1251 raft_consensus.cc:385] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.871886  1251 raft_consensus.cc:740] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.872149  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.872582  1251 consensus_queue.cc:260] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.873165  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.872854  1060 raft_consensus.cc:2393] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5d2d678e76d4d3aad49521856989aae in current term 1: Already voted for candidate d83adaaffefb48b88b90baf6fc91bfc4 in this term.
I20260709 12:58:35.876317  1251 ts_tablet_manager.cc:1434] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:58:35.877121  1251 tablet_bootstrap.cc:492] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.877699  1173 leader_election.cc:304] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.878865  1274 raft_consensus.cc:3060] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.885211  1251 tablet_bootstrap.cc:654] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.886962  1249 ts_tablet_manager.cc:1434] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:58:35.908023  1274 raft_consensus.cc:2749] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:35.909521  1256 consensus_queue.cc:1048] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:35.914975   955 catalog_manager.cc:5697] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:35.923278   957 catalog_manager.cc:5697] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 0 to 1, leader changed from <none> to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:35.936738  1256 consensus_queue.cc:1048] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:35.937383  1250 tablet_bootstrap.cc:492] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:35.937829  1250 ts_tablet_manager.cc:1403] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.102s	user 0.020s	sys 0.028s
I20260709 12:58:35.938864  1287 raft_consensus.cc:493] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.939285  1287 raft_consensus.cc:515] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.940374  1250 raft_consensus.cc:359] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.940994  1250 raft_consensus.cc:385] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.941167  1287 leader_election.cc:290] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.941250  1250 raft_consensus.cc:740] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.941979  1250 consensus_queue.cc:260] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.943324  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:35.943831  1250 ts_tablet_manager.cc:1434] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:35.944656  1250 tablet_bootstrap.cc:492] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:35.944726  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.945459  1133 raft_consensus.cc:2393] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in current term 1: Already voted for candidate c5d2d678e76d4d3aad49521856989aae in this term.
I20260709 12:58:35.945724  1251 tablet_bootstrap.cc:492] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:35.946101  1251 ts_tablet_manager.cc:1403] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.007s
I20260709 12:58:35.947098  1024 leader_election.cc:304] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733; no voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.949941  1287 raft_consensus.cc:3060] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.951593  1251 raft_consensus.cc:359] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.952378  1251 raft_consensus.cc:385] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.952637  1251 raft_consensus.cc:740] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.953336  1251 consensus_queue.cc:260] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.955101  1251 ts_tablet_manager.cc:1434] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:58:35.958225  1287 raft_consensus.cc:2749] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:35.961686  1250 tablet_bootstrap.cc:654] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.963275  1251 tablet_bootstrap.cc:492] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733: Bootstrap starting.
I20260709 12:58:35.965976  1284 raft_consensus.cc:493] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.966885  1256 raft_consensus.cc:493] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.967460  1256 raft_consensus.cc:515] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.969357  1251 tablet_bootstrap.cc:654] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.969791  1256 leader_election.cc:290] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:35.966552  1284 raft_consensus.cc:515] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.973081  1284 leader_election.cc:290] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.971338  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.973654  1059 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 0.
I20260709 12:58:35.974253  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:35.974788  1209 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 0.
I20260709 12:58:35.974822  1173 leader_election.cc:304] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: 
I20260709 12:58:35.975961  1256 raft_consensus.cc:2804] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.975762  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:35.977061  1256 raft_consensus.cc:493] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.977241  1059 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 0.
I20260709 12:58:35.977564  1256 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.975765  1099 leader_election.cc:304] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:35.978578  1284 raft_consensus.cc:2804] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.979131  1284 raft_consensus.cc:493] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.979573  1284 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.985524  1287 raft_consensus.cc:493] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.986160  1287 raft_consensus.cc:515] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.986752  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.991094  1287 leader_election.cc:290] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:35.993506  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8a70f259284b0b97306da8ccf75758" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:35.994341  1133 raft_consensus.cc:2393] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in current term 1: Already voted for candidate c5d2d678e76d4d3aad49521856989aae in this term.
I20260709 12:58:35.993506  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8a70f259284b0b97306da8ccf75758" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
W20260709 12:58:35.996690  1173 consensus_peers.cc:597] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae -> Peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Couldn't send request to peer 642f6bc0ca614b1e9b7264c3bc8b2733. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:35.996666  1024 leader_election.cc:304] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733; no voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:35.998196  1287 raft_consensus.cc:3060] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.998229  1256 raft_consensus.cc:515] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:35.999596  1284 raft_consensus.cc:515] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.001039  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:36.001559  1059 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.002125  1134 raft_consensus.cc:2393] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5d2d678e76d4d3aad49521856989aae in current term 1: Already voted for candidate d83adaaffefb48b88b90baf6fc91bfc4 in this term.
I20260709 12:58:36.002192  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:36.004148  1284 leader_election.cc:290] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:36.005306  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:36.005960  1209 raft_consensus.cc:2393] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d83adaaffefb48b88b90baf6fc91bfc4 in current term 1: Already voted for candidate c5d2d678e76d4d3aad49521856989aae in this term.
I20260709 12:58:36.006968  1099 leader_election.cc:304] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d83adaaffefb48b88b90baf6fc91bfc4; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae
I20260709 12:58:36.007921  1284 raft_consensus.cc:2749] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.008319  1059 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 1.
I20260709 12:58:36.009783  1173 leader_election.cc:304] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: 
I20260709 12:58:36.010335  1287 raft_consensus.cc:2749] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.010468  1274 raft_consensus.cc:2804] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:36.010905  1251 tablet_bootstrap.cc:492] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733: No bootstrap required, opened a new log
I20260709 12:58:36.010977  1274 raft_consensus.cc:697] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:36.011379  1251 ts_tablet_manager.cc:1403] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.027s
I20260709 12:58:36.011921  1256 leader_election.cc:290] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:36.011897  1274 consensus_queue.cc:237] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.012915  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:36.013612  1134 raft_consensus.cc:2393] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c5d2d678e76d4d3aad49521856989aae in current term 1: Already voted for candidate d83adaaffefb48b88b90baf6fc91bfc4 in this term.
I20260709 12:58:36.013605  1251 raft_consensus.cc:359] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.014230  1251 raft_consensus.cc:385] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.014509  1251 raft_consensus.cc:740] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.015115  1251 consensus_queue.cc:260] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.015956  1250 tablet_bootstrap.cc:492] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:36.016377  1250 ts_tablet_manager.cc:1403] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.015s
I20260709 12:58:36.016817  1251 ts_tablet_manager.cc:1434] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:36.018334  1250 raft_consensus.cc:359] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:36.018868  1250 raft_consensus.cc:385] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.019156  1250 raft_consensus.cc:740] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.019819  1250 consensus_queue.cc:260] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:36.021668  1250 ts_tablet_manager.cc:1434] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:36.022296  1250 tablet_bootstrap.cc:492] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4: Bootstrap starting.
I20260709 12:58:36.026644   956 catalog_manager.cc:5697] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:36.030045  1250 tablet_bootstrap.cc:654] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.035058  1250 tablet_bootstrap.cc:492] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4: No bootstrap required, opened a new log
I20260709 12:58:36.035432  1250 ts_tablet_manager.cc:1403] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.005s
I20260709 12:58:36.037104  1250 raft_consensus.cc:359] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.037531  1250 raft_consensus.cc:385] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.037732  1250 raft_consensus.cc:740] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.038264  1250 consensus_queue.cc:260] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.039945  1250 ts_tablet_manager.cc:1434] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:58:36.062736  1274 consensus_queue.cc:1048] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.117866  1274 consensus_queue.cc:1048] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.130424  1256 consensus_queue.cc:1048] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.170830  1284 raft_consensus.cc:493] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.171275  1284 raft_consensus.cc:515] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.172874  1284 leader_election.cc:290] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:36.173489  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:36.173867  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:36.174173  1059 raft_consensus.cc:2468] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 0.
I20260709 12:58:36.174496  1209 raft_consensus.cc:2468] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 0.
I20260709 12:58:36.175215  1099 leader_election.cc:304] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:36.175910  1284 raft_consensus.cc:2804] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:36.176180  1284 raft_consensus.cc:493] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.176466  1284 raft_consensus.cc:3060] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.180606  1284 raft_consensus.cc:515] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.182119  1284 leader_election.cc:290] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:36.182816  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:36.183090  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:36.183360  1059 raft_consensus.cc:3060] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.183650  1209 raft_consensus.cc:3060] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.185846  1256 consensus_queue.cc:1048] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.188862  1059 raft_consensus.cc:2468] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 1.
I20260709 12:58:36.188973  1209 raft_consensus.cc:2468] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 1.
I20260709 12:58:36.189909  1099 leader_election.cc:304] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:36.190721  1284 raft_consensus.cc:2804] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:36.191257  1284 raft_consensus.cc:697] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Becoming Leader. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Running, Role: LEADER
I20260709 12:58:36.192059  1284 consensus_queue.cc:237] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.196991  1256 consensus_queue.cc:1048] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.203406   955 catalog_manager.cc:5697] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.207197  1284 raft_consensus.cc:493] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.207719  1284 raft_consensus.cc:515] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } }
I20260709 12:58:36.209412  1284 leader_election.cc:290] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839), 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611)
I20260709 12:58:36.210068  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b30b02204b4588bc5517f0c63e8c33" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:36.210866  1209 raft_consensus.cc:2393] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d83adaaffefb48b88b90baf6fc91bfc4 in current term 1: Already voted for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in this term.
I20260709 12:58:36.210947  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b30b02204b4588bc5517f0c63e8c33" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" is_pre_election: true
I20260709 12:58:36.212338  1099 leader_election.cc:304] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d83adaaffefb48b88b90baf6fc91bfc4; no voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae
I20260709 12:58:36.213111  1284 raft_consensus.cc:3060] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.217326  1284 raft_consensus.cc:2749] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.226369  1256 consensus_queue.cc:1048] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.232712  1274 consensus_queue.cc:1048] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.241290  1287 consensus_queue.cc:1048] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.251355  1322 consensus_queue.cc:1048] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:36.275223  1287 raft_consensus.cc:493] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.275674  1287 raft_consensus.cc:515] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.277449  1287 leader_election.cc:290] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:36.277920  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" is_pre_election: true
I20260709 12:58:36.278247  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d2d678e76d4d3aad49521856989aae" is_pre_election: true
I20260709 12:58:36.279351  1024 leader_election.cc:304] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733; no voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:36.279956  1287 raft_consensus.cc:2749] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.285859  1284 consensus_queue.cc:1048] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.296337  1284 consensus_queue.cc:1048] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.415552  1286 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.424628  1256 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.465116  1133 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.470269  1287 consensus_queue.cc:1048] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.478528  1287 consensus_queue.cc:1048] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.504457  1209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f315ce1ede9b438d89c54a90758aa691"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
mode: GRACEFUL
new_leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:53232
I20260709 12:58:36.505023  1209 raft_consensus.cc:606] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Received request to transfer leadership to TS 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:36.507894  1060 raft_consensus.cc:3060] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.510449  1209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
mode: GRACEFUL
new_leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:53232
I20260709 12:58:36.511088  1209 raft_consensus.cc:606] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Received request to transfer leadership to TS 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:36.515961  1209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
mode: GRACEFUL
new_leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:53232
I20260709 12:58:36.516494  1209 raft_consensus.cc:606] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Received request to transfer leadership to TS 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:36.521505  1209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98a657945a214a778f926b5eca233f93"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
mode: GRACEFUL
new_leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:53232
I20260709 12:58:36.521953  1209 raft_consensus.cc:606] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Received request to transfer leadership to TS 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:36.535861  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
mode: GRACEFUL
new_leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
 from {username='slave'} at 127.0.0.1:55322
I20260709 12:58:36.536271  1060 raft_consensus.cc:606] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 LEADER]: Received request to transfer leadership to TS d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:36.545447  1209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
mode: GRACEFUL
new_leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
 from {username='slave'} at 127.0.0.1:53232
I20260709 12:58:36.545939  1209 raft_consensus.cc:606] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Received request to transfer leadership to TS d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:36.596489  1284 consensus_queue.cc:1048] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.606817  1255 consensus_queue.cc:1048] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:36.643697  1286 raft_consensus.cc:993] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae: : Instructing follower d83adaaffefb48b88b90baf6fc91bfc4 to start an election
I20260709 12:58:36.644083  1256 raft_consensus.cc:1081] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Signalling peer d83adaaffefb48b88b90baf6fc91bfc4 to start an election
I20260709 12:58:36.645275  1133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c"
dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
 from {username='slave'} at 127.0.0.1:48206
I20260709 12:58:36.645678  1133 raft_consensus.cc:493] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:36.645951  1133 raft_consensus.cc:3060] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.651525  1133 raft_consensus.cc:515] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.653504  1133 leader_election.cc:290] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 2 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:36.654008  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:36.654759  1060 raft_consensus.cc:3060] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.654973  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1b7e5b6d4ba8b2fc37b845d77e1c" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:36.655447  1209 raft_consensus.cc:3055] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.655714  1209 raft_consensus.cc:740] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:36.656304  1209 consensus_queue.cc:260] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.657100  1209 raft_consensus.cc:3060] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.659536  1060 raft_consensus.cc:2468] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 2.
I20260709 12:58:36.660495  1099 leader_election.cc:304] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:36.661199  1255 raft_consensus.cc:2804] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:36.661587  1255 raft_consensus.cc:697] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 LEADER]: Becoming Leader. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Running, Role: LEADER
I20260709 12:58:36.661715  1209 raft_consensus.cc:2468] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 2.
I20260709 12:58:36.662326  1255 consensus_queue.cc:237] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.669309   956 catalog_manager.cc:5697] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 reported cstate change: term changed from 1 to 2, leader changed from c5d2d678e76d4d3aad49521856989aae (127.0.107.195) to d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.677964  1274 raft_consensus.cc:993] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae: : Instructing follower 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:36.679462  1256 raft_consensus.cc:1081] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Signalling peer 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:36.680722  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:55296
I20260709 12:58:36.681176  1060 raft_consensus.cc:493] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:36.681463  1060 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.685390  1060 raft_consensus.cc:515] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.687095  1060 leader_election.cc:290] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:36.688489  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:36.689018  1133 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.689445  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:36.689890  1209 raft_consensus.cc:3055] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.690142  1209 raft_consensus.cc:740] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:36.690886  1209 consensus_queue.cc:260] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.691720  1209 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.695449  1133 raft_consensus.cc:2468] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:36.695705  1209 raft_consensus.cc:2468] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:36.696548  1024 leader_election.cc:304] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:36.697129  1322 raft_consensus.cc:2804] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:36.697543  1322 raft_consensus.cc:697] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:36.698277  1322 consensus_queue.cc:237] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.703977   957 catalog_manager.cc:5697] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 1 to 2, leader changed from c5d2d678e76d4d3aad49521856989aae (127.0.107.195) to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.819669  1274 raft_consensus.cc:993] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae: : Instructing follower 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:36.820101  1256 raft_consensus.cc:1081] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Signalling peer 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:36.821311  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:55296
I20260709 12:58:36.821700  1060 raft_consensus.cc:493] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:36.821926  1060 raft_consensus.cc:3060] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.826062  1060 raft_consensus.cc:515] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.827423  1060 leader_election.cc:290] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:36.828130  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:36.828415  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:36.828574  1134 raft_consensus.cc:3060] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.828900  1209 raft_consensus.cc:3055] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.829183  1209 raft_consensus.cc:740] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:36.829828  1209 consensus_queue.cc:260] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.830833  1209 raft_consensus.cc:3060] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.834834  1134 raft_consensus.cc:2468] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:36.835865  1024 leader_election.cc:304] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:36.836580  1322 raft_consensus.cc:2804] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:36.836525  1209 raft_consensus.cc:2468] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:36.837146  1322 raft_consensus.cc:697] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:36.837877  1322 consensus_queue.cc:237] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.843853   957 catalog_manager.cc:5697] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 1 to 2, leader changed from c5d2d678e76d4d3aad49521856989aae (127.0.107.195) to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.946468  1330 raft_consensus.cc:993] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733: : Instructing follower d83adaaffefb48b88b90baf6fc91bfc4 to start an election
I20260709 12:58:36.946938  1322 raft_consensus.cc:1081] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 LEADER]: Signalling peer d83adaaffefb48b88b90baf6fc91bfc4 to start an election
I20260709 12:58:36.948275  1134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15"
dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
 from {username='slave'} at 127.0.0.1:48208
I20260709 12:58:36.948757  1134 raft_consensus.cc:493] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:36.949045  1134 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.953451  1134 raft_consensus.cc:515] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.954867  1134 leader_election.cc:290] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 2 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:36.955636  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:36.955946  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:36.956108  1060 raft_consensus.cc:3055] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.956411  1060 raft_consensus.cc:740] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:36.956434  1209 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.957103  1060 consensus_queue.cc:260] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.957984  1060 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.960870  1209 raft_consensus.cc:2468] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 2.
I20260709 12:58:36.961746  1099 leader_election.cc:304] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:36.962471  1060 raft_consensus.cc:2468] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 2.
I20260709 12:58:36.962477  1255 raft_consensus.cc:2804] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:36.963155  1255 raft_consensus.cc:697] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 LEADER]: Becoming Leader. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Running, Role: LEADER
I20260709 12:58:36.963977  1255 consensus_queue.cc:237] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.969333   957 catalog_manager.cc:5697] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 reported cstate change: term changed from 1 to 2, leader changed from 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193) to d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.974066  1274 raft_consensus.cc:993] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae: : Instructing follower 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:36.974434  1256 raft_consensus.cc:1081] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Signalling peer 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:36.975855  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98a657945a214a778f926b5eca233f93"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:55296
I20260709 12:58:36.976263  1060 raft_consensus.cc:493] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:36.976619  1060 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.980623  1060 raft_consensus.cc:515] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.982043  1060 leader_election.cc:290] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:36.982786  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:36.983052  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:36.983263  1134 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.983507  1209 raft_consensus.cc:3055] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.983821  1209 raft_consensus.cc:740] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:36.984414  1209 consensus_queue.cc:260] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.985209  1209 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.988682  1134 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:36.989645  1024 leader_election.cc:304] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:36.990320  1322 raft_consensus.cc:2804] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:36.990710  1322 raft_consensus.cc:697] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:36.990840  1209 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:36.991528  1322 consensus_queue.cc:237] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:36.994442  1274 raft_consensus.cc:993] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae: : Instructing follower 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:36.994853  1274 raft_consensus.cc:1081] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Signalling peer 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:36.996148  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f315ce1ede9b438d89c54a90758aa691"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:55296
I20260709 12:58:36.996541  1060 raft_consensus.cc:493] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:36.996817  1060 raft_consensus.cc:3060] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.000507   957 catalog_manager.cc:5697] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 1 to 2, leader changed from c5d2d678e76d4d3aad49521856989aae (127.0.107.195) to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.000980  1060 raft_consensus.cc:515] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:37.002556  1060 leader_election.cc:290] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:37.003058  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f315ce1ede9b438d89c54a90758aa691" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:37.003415  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f315ce1ede9b438d89c54a90758aa691" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:37.003965  1209 raft_consensus.cc:3055] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.003600  1134 raft_consensus.cc:3060] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.004245  1209 raft_consensus.cc:740] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:37.005044  1209 consensus_queue.cc:260] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:37.006071  1209 raft_consensus.cc:3060] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.008895  1134 raft_consensus.cc:2468] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:37.009693  1024 leader_election.cc:304] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:37.010246  1322 raft_consensus.cc:2804] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:37.010664  1322 raft_consensus.cc:697] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:37.011235  1209 raft_consensus.cc:2468] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:37.011504  1322 consensus_queue.cc:237] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:37.017709   957 catalog_manager.cc:5697] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 1 to 2, leader changed from c5d2d678e76d4d3aad49521856989aae (127.0.107.195) to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.051678  1209 raft_consensus.cc:1275] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Refusing update from remote peer d83adaaffefb48b88b90baf6fc91bfc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.052781  1255 consensus_queue.cc:1048] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.059372  1060 raft_consensus.cc:1275] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Refusing update from remote peer d83adaaffefb48b88b90baf6fc91bfc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.061421  1284 consensus_queue.cc:1048] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.208202  1209 raft_consensus.cc:1275] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.209450  1322 consensus_queue.cc:1048] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.219713  1134 raft_consensus.cc:1275] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.221081  1322 consensus_queue.cc:1048] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:37.232576  1134 raft_consensus.cc:1275] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.233788  1322 consensus_queue.cc:1048] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.238790  1209 raft_consensus.cc:1275] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.240059  1339 consensus_queue.cc:1048] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.464920  1209 raft_consensus.cc:1275] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Refusing update from remote peer d83adaaffefb48b88b90baf6fc91bfc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.466166  1284 consensus_queue.cc:1048] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.466413  1209 raft_consensus.cc:1275] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.467618  1339 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.475747  1060 raft_consensus.cc:1275] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Refusing update from remote peer d83adaaffefb48b88b90baf6fc91bfc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.478545  1325 consensus_queue.cc:1048] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.482946  1134 raft_consensus.cc:1275] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.484990  1322 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.556455  1209 raft_consensus.cc:1275] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.557391  1134 raft_consensus.cc:1275] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.557513  1322 consensus_queue.cc:1048] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.558501  1330 consensus_queue.cc:1048] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.574673   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:58:39.575453   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:39.592273  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
mode: GRACEFUL
new_leader_uuid: "c5d2d678e76d4d3aad49521856989aae"
 from {username='slave'} at 127.0.0.1:55326
I20260709 12:58:39.592696  1060 raft_consensus.cc:606] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Received request to transfer leadership to TS c5d2d678e76d4d3aad49521856989aae
I20260709 12:58:39.594625  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98a657945a214a778f926b5eca233f93"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
mode: GRACEFUL
new_leader_uuid: "c5d2d678e76d4d3aad49521856989aae"
 from {username='slave'} at 127.0.0.1:55326
I20260709 12:58:39.595050  1060 raft_consensus.cc:606] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Received request to transfer leadership to TS c5d2d678e76d4d3aad49521856989aae
I20260709 12:58:39.595832   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:39.596217   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:39.935635  1349 raft_consensus.cc:993] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733: : Instructing follower c5d2d678e76d4d3aad49521856989aae to start an election
I20260709 12:58:39.936049  1330 raft_consensus.cc:1081] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Signalling peer c5d2d678e76d4d3aad49521856989aae to start an election
I20260709 12:58:39.937290  1209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98a657945a214a778f926b5eca233f93"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
 from {username='slave'} at 127.0.0.1:53226
I20260709 12:58:39.937687  1209 raft_consensus.cc:493] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:39.937940  1209 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.941699  1209 raft_consensus.cc:515] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:39.943034  1209 leader_election.cc:290] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 3 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:39.943778  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:39.944089  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:39.944325  1060 raft_consensus.cc:3055] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:39.944599  1134 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.944629  1060 raft_consensus.cc:740] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:39.945461  1060 consensus_queue.cc:260] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:39.946485  1060 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.950930  1134 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 3.
I20260709 12:58:39.952114  1173 leader_election.cc:304] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:39.952206  1060 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 3.
I20260709 12:58:39.952841  1256 raft_consensus.cc:2804] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:39.953644  1256 raft_consensus.cc:697] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:39.954411  1256 consensus_queue.cc:237] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:39.961930   956 catalog_manager.cc:5697] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 2 to 3, leader changed from 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193) to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:40.054819  1349 raft_consensus.cc:993] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733: : Instructing follower c5d2d678e76d4d3aad49521856989aae to start an election
I20260709 12:58:40.055341  1330 raft_consensus.cc:1081] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Signalling peer c5d2d678e76d4d3aad49521856989aae to start an election
I20260709 12:58:40.056674  1209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
 from {username='slave'} at 127.0.0.1:53226
I20260709 12:58:40.057083  1209 raft_consensus.cc:493] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:40.057341  1209 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.066525  1209 raft_consensus.cc:515] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.068223  1209 leader_election.cc:290] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 3 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:40.068915  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:40.069345  1060 raft_consensus.cc:3055] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:40.069568  1060 raft_consensus.cc:740] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:40.069651  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:40.070139  1134 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.070155  1060 consensus_queue.cc:260] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.071137  1060 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.074072  1134 raft_consensus.cc:2468] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 3.
I20260709 12:58:40.074769  1060 raft_consensus.cc:2468] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 3.
I20260709 12:58:40.074914  1173 leader_election.cc:304] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:40.075809  1256 raft_consensus.cc:2804] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:40.076260  1256 raft_consensus.cc:697] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:40.076930  1256 consensus_queue.cc:237] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.085677   955 catalog_manager.cc:5697] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 2 to 3, leader changed from 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193) to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:40.481624  1134 raft_consensus.cc:1275] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Refusing update from remote peer c5d2d678e76d4d3aad49521856989aae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:40.482847  1256 consensus_queue.cc:1048] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.491673  1060 raft_consensus.cc:1275] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Refusing update from remote peer c5d2d678e76d4d3aad49521856989aae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:40.493921  1134 raft_consensus.cc:1275] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Refusing update from remote peer c5d2d678e76d4d3aad49521856989aae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:40.494230  1256 consensus_queue.cc:1048] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.495327  1352 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.507328  1060 raft_consensus.cc:1275] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Refusing update from remote peer c5d2d678e76d4d3aad49521856989aae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:40.508610  1361 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.596971   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:40.610548  1209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
mode: GRACEFUL
new_leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:53232
I20260709 12:58:40.611032  1209 raft_consensus.cc:606] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Received request to transfer leadership to TS 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:40.616892  1209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98a657945a214a778f926b5eca233f93"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
mode: GRACEFUL
new_leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:53232
I20260709 12:58:40.617265  1209 raft_consensus.cc:606] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Received request to transfer leadership to TS 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:40.633054  1134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15"
dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
mode: GRACEFUL
new_leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:58:40.633477  1134 raft_consensus.cc:606] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 LEADER]: Received request to transfer leadership to TS 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:40.637472  1134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201"
dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
mode: GRACEFUL
new_leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:58:40.637898  1134 raft_consensus.cc:606] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Received request to transfer leadership to TS 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:40.641892  1134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6"
dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
mode: GRACEFUL
new_leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:58:40.642274  1134 raft_consensus.cc:606] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Received request to transfer leadership to TS 642f6bc0ca614b1e9b7264c3bc8b2733
I20260709 12:58:40.699564  1325 raft_consensus.cc:993] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4: : Instructing follower 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:40.699985  1370 raft_consensus.cc:1081] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 LEADER]: Signalling peer 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:40.701264  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:55306
I20260709 12:58:40.701660  1060 raft_consensus.cc:493] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:40.701937  1060 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.705622  1060 raft_consensus.cc:515] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.706946  1060 leader_election.cc:290] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 3 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:40.707487  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:40.707787  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:40.707948  1134 raft_consensus.cc:3055] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:40.708261  1209 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.708276  1134 raft_consensus.cc:740] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Running, Role: LEADER
I20260709 12:58:40.708972  1134 consensus_queue.cc:260] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.709713  1134 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.711864  1209 raft_consensus.cc:2468] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 3.
I20260709 12:58:40.712713  1024 leader_election.cc:304] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: 
I20260709 12:58:40.713284  1349 raft_consensus.cc:2804] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:40.713445  1134 raft_consensus.cc:2468] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 3.
I20260709 12:58:40.713652  1349 raft_consensus.cc:697] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:40.714433  1349 consensus_queue.cc:237] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.720589   956 catalog_manager.cc:5697] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 2 to 3, leader changed from d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194) to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.781422  1325 raft_consensus.cc:993] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4: : Instructing follower 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:40.781849  1370 raft_consensus.cc:1081] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Signalling peer 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:40.783159  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:55306
I20260709 12:58:40.783555  1060 raft_consensus.cc:493] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:40.783803  1060 raft_consensus.cc:3060] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.787341  1060 raft_consensus.cc:515] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.788689  1060 leader_election.cc:290] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:40.789213  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:40.789501  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075bf95529704009a9ad40b1d34d0201" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:40.789678  1134 raft_consensus.cc:3055] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:40.789954  1209 raft_consensus.cc:3060] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.789953  1134 raft_consensus.cc:740] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Running, Role: LEADER
I20260709 12:58:40.790771  1134 consensus_queue.cc:260] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.791781  1134 raft_consensus.cc:3060] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.795506  1209 raft_consensus.cc:2468] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:40.796396  1024 leader_election.cc:304] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: 
I20260709 12:58:40.796962  1349 raft_consensus.cc:2804] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:40.797045  1134 raft_consensus.cc:2468] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:40.797466  1349 raft_consensus.cc:697] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:40.798192  1349 consensus_queue.cc:237] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.803864   956 catalog_manager.cc:5697] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 1 to 2, leader changed from d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194) to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.951727  1361 raft_consensus.cc:993] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae: : Instructing follower 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:40.952220  1256 raft_consensus.cc:1081] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Signalling peer 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:40.953665  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:55296
I20260709 12:58:40.954073  1060 raft_consensus.cc:493] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:40.954339  1060 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:40.958282  1060 raft_consensus.cc:515] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.959820  1060 leader_election.cc:290] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 4 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:40.960470  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:40.960680  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb3e309ac8241b3926a0057a4a7b944" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:40.960985  1134 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:40.961158  1209 raft_consensus.cc:3055] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:40.961476  1209 raft_consensus.cc:740] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:40.962008  1209 consensus_queue.cc:260] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.962819  1209 raft_consensus.cc:3060] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:40.964931  1134 raft_consensus.cc:2468] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 4.
I20260709 12:58:40.965821  1024 leader_election.cc:304] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:40.966432  1349 raft_consensus.cc:2804] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:40.966954  1349 raft_consensus.cc:697] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:40.967711  1209 raft_consensus.cc:2468] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 4.
I20260709 12:58:40.967828  1349 consensus_queue.cc:237] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.970953  1325 raft_consensus.cc:993] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4: : Instructing follower 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:40.971369  1370 raft_consensus.cc:1081] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Signalling peer 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:40.972783  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:55306
I20260709 12:58:40.973333  1060 raft_consensus.cc:493] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:40.973636  1060 raft_consensus.cc:3060] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.974627   956 catalog_manager.cc:5697] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 3 to 4, leader changed from c5d2d678e76d4d3aad49521856989aae (127.0.107.195) to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.978942  1060 raft_consensus.cc:515] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.980605  1060 leader_election.cc:290] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:40.981552  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:40.983894  1209 raft_consensus.cc:3060] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.981701  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:40.986920  1134 raft_consensus.cc:3055] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:40.987171  1134 raft_consensus.cc:740] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Running, Role: LEADER
I20260709 12:58:40.987617  1209 raft_consensus.cc:2468] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:40.987674  1134 consensus_queue.cc:260] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.988479  1024 leader_election.cc:304] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: 
I20260709 12:58:40.988662  1134 raft_consensus.cc:3060] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.989128  1349 raft_consensus.cc:2804] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:40.989532  1349 raft_consensus.cc:697] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:40.990181  1349 consensus_queue.cc:237] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:40.992794  1134 raft_consensus.cc:2468] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 2.
I20260709 12:58:40.996265   956 catalog_manager.cc:5697] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 1 to 2, leader changed from d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194) to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.099236  1134 raft_consensus.cc:1275] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:41.100535  1349 consensus_queue.cc:1048] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.101735  1361 raft_consensus.cc:993] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae: : Instructing follower 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:41.102164  1361 raft_consensus.cc:1081] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Signalling peer 642f6bc0ca614b1e9b7264c3bc8b2733 to start an election
I20260709 12:58:41.103698  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98a657945a214a778f926b5eca233f93"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
 from {username='slave'} at 127.0.0.1:55296
I20260709 12:58:41.104233  1060 raft_consensus.cc:493] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:41.105374  1060 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:41.112488  1060 raft_consensus.cc:515] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:41.114576  1209 raft_consensus.cc:1275] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:41.116503  1330 consensus_queue.cc:1048] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.118259  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:41.118867  1134 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:41.122278  1060 leader_election.cc:290] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 4 election: Requested vote from peers d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:41.122893  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:41.123415  1208 raft_consensus.cc:3055] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:41.123703  1208 raft_consensus.cc:740] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:41.124581  1208 consensus_queue.cc:260] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:41.125278  1134 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 4.
I20260709 12:58:41.125756  1208 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:41.126327  1024 leader_election.cc:304] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:41.126948  1381 raft_consensus.cc:2804] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:41.127480  1381 raft_consensus.cc:697] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 LEADER]: Becoming Leader. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:41.128407  1381 consensus_queue.cc:237] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:41.131960  1208 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642f6bc0ca614b1e9b7264c3bc8b2733 in term 4.
I20260709 12:58:41.136559   956 catalog_manager.cc:5697] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 reported cstate change: term changed from 3 to 4, leader changed from c5d2d678e76d4d3aad49521856989aae (127.0.107.195) to 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.206450  1208 raft_consensus.cc:1275] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:41.207690  1381 consensus_queue.cc:1048] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:41.216148  1134 raft_consensus.cc:1275] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:41.217432  1381 consensus_queue.cc:1048] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:41.383234  1208 raft_consensus.cc:1275] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:41.384828  1381 consensus_queue.cc:1048] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.391352  1134 raft_consensus.cc:1275] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:41.393553  1381 consensus_queue.cc:1048] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.540297  1208 raft_consensus.cc:1275] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:41.541360  1381 consensus_queue.cc:1048] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:41.549082  1134 raft_consensus.cc:1275] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:41.550460  1330 consensus_queue.cc:1048] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:41.638012  1134 raft_consensus.cc:1275] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:41.639096  1330 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.647045  1208 raft_consensus.cc:1275] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Refusing update from remote peer 642f6bc0ca614b1e9b7264c3bc8b2733: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:41.648296  1330 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:43.648120   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:43.655686  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
mode: GRACEFUL
new_leader_uuid: "c5d2d678e76d4d3aad49521856989aae"
 from {username='slave'} at 127.0.0.1:55326
I20260709 12:58:43.656265  1060 raft_consensus.cc:606] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Received request to transfer leadership to TS c5d2d678e76d4d3aad49521856989aae
I20260709 12:58:43.658464  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
mode: GRACEFUL
new_leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
 from {username='slave'} at 127.0.0.1:55326
I20260709 12:58:43.658901  1060 raft_consensus.cc:606] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 LEADER]: Received request to transfer leadership to TS d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:43.660982  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98a657945a214a778f926b5eca233f93"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
mode: GRACEFUL
new_leader_uuid: "c5d2d678e76d4d3aad49521856989aae"
 from {username='slave'} at 127.0.0.1:55326
I20260709 12:58:43.661441  1060 raft_consensus.cc:606] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 LEADER]: Received request to transfer leadership to TS c5d2d678e76d4d3aad49521856989aae
I20260709 12:58:43.663599  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6"
dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
mode: GRACEFUL
new_leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
 from {username='slave'} at 127.0.0.1:55326
I20260709 12:58:43.664021  1060 raft_consensus.cc:606] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Received request to transfer leadership to TS d83adaaffefb48b88b90baf6fc91bfc4
I20260709 12:58:43.664942   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:58:43.665297   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:43.744369  1330 raft_consensus.cc:993] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733: : Instructing follower c5d2d678e76d4d3aad49521856989aae to start an election
I20260709 12:58:43.744882  1391 raft_consensus.cc:1081] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 LEADER]: Signalling peer c5d2d678e76d4d3aad49521856989aae to start an election
I20260709 12:58:43.746147  1209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98a657945a214a778f926b5eca233f93"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
 from {username='slave'} at 127.0.0.1:53226
I20260709 12:58:43.746591  1209 raft_consensus.cc:493] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:43.746954  1209 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:43.751724  1209 raft_consensus.cc:515] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:43.753521  1209 leader_election.cc:290] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 5 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:43.754076  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:43.754839  1060 raft_consensus.cc:3055] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:43.754807  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a657945a214a778f926b5eca233f93" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:43.755254  1060 raft_consensus.cc:740] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:43.755460  1134 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:43.756062  1060 consensus_queue.cc:260] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:43.756927  1060 raft_consensus.cc:3060] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:43.760144  1134 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 5.
I20260709 12:58:43.761229  1173 leader_election.cc:304] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:43.761586  1060 raft_consensus.cc:2468] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 5.
I20260709 12:58:43.761971  1361 raft_consensus.cc:2804] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:43.762899  1361 raft_consensus.cc:697] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 5 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:43.763851  1361 consensus_queue.cc:237] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:43.771276   956 catalog_manager.cc:5697] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 4 to 5, leader changed from 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193) to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 5 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.964143  1330 raft_consensus.cc:993] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733: : Instructing follower d83adaaffefb48b88b90baf6fc91bfc4 to start an election
I20260709 12:58:43.964581  1391 raft_consensus.cc:1081] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 LEADER]: Signalling peer d83adaaffefb48b88b90baf6fc91bfc4 to start an election
I20260709 12:58:43.966078  1134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15"
dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
 from {username='slave'} at 127.0.0.1:48208
I20260709 12:58:43.966586  1134 raft_consensus.cc:493] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:43.966917  1134 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:43.967878  1330 raft_consensus.cc:993] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733: : Instructing follower c5d2d678e76d4d3aad49521856989aae to start an election
I20260709 12:58:43.968268  1391 raft_consensus.cc:1081] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Signalling peer c5d2d678e76d4d3aad49521856989aae to start an election
I20260709 12:58:43.969619  1209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5"
dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
 from {username='slave'} at 127.0.0.1:53226
I20260709 12:58:43.970188  1209 raft_consensus.cc:493] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:43.970469  1209 raft_consensus.cc:3060] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:43.971448  1134 raft_consensus.cc:515] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:43.973054  1134 leader_election.cc:290] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 4 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:43.974133  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:43.974215  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdcb3a1058b42a5aaee93f47c7cbc15" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:43.974622  1208 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:43.974713  1060 raft_consensus.cc:3055] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:43.975081  1060 raft_consensus.cc:740] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:43.975921  1060 consensus_queue.cc:260] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:43.976769  1060 raft_consensus.cc:3060] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:43.979664  1208 raft_consensus.cc:2468] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 4.
I20260709 12:58:43.980770  1060 raft_consensus.cc:2468] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 4.
I20260709 12:58:43.980794  1099 leader_election.cc:304] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:43.981287  1209 raft_consensus.cc:515] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:43.981783  1370 raft_consensus.cc:2804] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:43.982955  1209 leader_election.cc:290] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 3 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279)
I20260709 12:58:43.983081  1370 raft_consensus.cc:697] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 LEADER]: Becoming Leader. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Running, Role: LEADER
I20260709 12:58:43.984097  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
I20260709 12:58:43.984036  1370 consensus_queue.cc:237] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:43.984593  1134 raft_consensus.cc:3060] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:43.984577  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cbbeddcdb4f6b9d11c2c7719276d5" candidate_uuid: "c5d2d678e76d4d3aad49521856989aae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:43.986873  1060 raft_consensus.cc:3055] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:43.987179  1060 raft_consensus.cc:740] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:43.987752  1060 consensus_queue.cc:260] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:43.988580  1060 raft_consensus.cc:3060] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:43.992100  1060 raft_consensus.cc:2468] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 3.
I20260709 12:58:43.992988  1173 leader_election.cc:304] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f6bc0ca614b1e9b7264c3bc8b2733, c5d2d678e76d4d3aad49521856989aae; no voters: 
I20260709 12:58:43.993854  1361 raft_consensus.cc:2804] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:43.994305  1361 raft_consensus.cc:697] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Becoming Leader. State: Replica: c5d2d678e76d4d3aad49521856989aae, State: Running, Role: LEADER
I20260709 12:58:43.995112  1361 consensus_queue.cc:237] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:43.996644  1134 raft_consensus.cc:2468] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d2d678e76d4d3aad49521856989aae in term 3.
I20260709 12:58:43.997078   956 catalog_manager.cc:5697] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 reported cstate change: term changed from 3 to 4, leader changed from 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193) to d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.002810   955 catalog_manager.cc:5697] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae reported cstate change: term changed from 2 to 3, leader changed from 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193) to c5d2d678e76d4d3aad49521856989aae (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c5d2d678e76d4d3aad49521856989aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:44.101558  1330 raft_consensus.cc:993] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733: : Instructing follower d83adaaffefb48b88b90baf6fc91bfc4 to start an election
I20260709 12:58:44.101984  1391 raft_consensus.cc:1081] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Signalling peer d83adaaffefb48b88b90baf6fc91bfc4 to start an election
I20260709 12:58:44.103412  1134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6"
dest_uuid: "d83adaaffefb48b88b90baf6fc91bfc4"
 from {username='slave'} at 127.0.0.1:48208
I20260709 12:58:44.103830  1134 raft_consensus.cc:493] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:44.104113  1134 raft_consensus.cc:3060] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.108021  1134 raft_consensus.cc:515] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:44.109330  1134 leader_election.cc:290] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 3 election: Requested vote from peers 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611), c5d2d678e76d4d3aad49521856989aae (127.0.107.195:36839)
I20260709 12:58:44.109972  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733"
I20260709 12:58:44.110240  1209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4696b682cb1442cae3322616fe744a6" candidate_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5d2d678e76d4d3aad49521856989aae"
I20260709 12:58:44.110491  1060 raft_consensus.cc:3055] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.110734  1209 raft_consensus.cc:3060] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.110834  1060 raft_consensus.cc:740] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 642f6bc0ca614b1e9b7264c3bc8b2733, State: Running, Role: LEADER
I20260709 12:58:44.111590  1060 consensus_queue.cc:260] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:44.112666  1060 raft_consensus.cc:3060] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.116369  1209 raft_consensus.cc:2468] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 3.
I20260709 12:58:44.117262  1099 leader_election.cc:304] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5d2d678e76d4d3aad49521856989aae, d83adaaffefb48b88b90baf6fc91bfc4; no voters: 
I20260709 12:58:44.117851  1370 raft_consensus.cc:2804] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.118325  1370 raft_consensus.cc:697] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 LEADER]: Becoming Leader. State: Replica: d83adaaffefb48b88b90baf6fc91bfc4, State: Running, Role: LEADER
I20260709 12:58:44.118368  1060 raft_consensus.cc:2468] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d83adaaffefb48b88b90baf6fc91bfc4 in term 3.
I20260709 12:58:44.119244  1370 consensus_queue.cc:237] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } }
I20260709 12:58:44.125069   955 catalog_manager.cc:5697] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 reported cstate change: term changed from 2 to 3, leader changed from 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193) to d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.205493  1134 raft_consensus.cc:1275] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 5 FOLLOWER]: Refusing update from remote peer c5d2d678e76d4d3aad49521856989aae: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:44.206473  1361 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:44.219018  1060 raft_consensus.cc:1275] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 5 FOLLOWER]: Refusing update from remote peer c5d2d678e76d4d3aad49521856989aae: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:44.220216  1392 consensus_queue.cc:1048] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:44.381152  1209 raft_consensus.cc:1275] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Refusing update from remote peer d83adaaffefb48b88b90baf6fc91bfc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:44.382198  1370 consensus_queue.cc:1048] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:44.389816  1060 raft_consensus.cc:1275] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Refusing update from remote peer d83adaaffefb48b88b90baf6fc91bfc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:44.391974  1408 consensus_queue.cc:1048] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:44.451293  1134 raft_consensus.cc:1275] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Refusing update from remote peer c5d2d678e76d4d3aad49521856989aae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.452400  1392 consensus_queue.cc:1048] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "d83adaaffefb48b88b90baf6fc91bfc4" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.460319  1060 raft_consensus.cc:1275] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Refusing update from remote peer c5d2d678e76d4d3aad49521856989aae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.461366  1361 consensus_queue.cc:1048] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.539171  1060 raft_consensus.cc:1275] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Refusing update from remote peer d83adaaffefb48b88b90baf6fc91bfc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.540217  1408 consensus_queue.cc:1048] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f6bc0ca614b1e9b7264c3bc8b2733" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.548362  1209 raft_consensus.cc:1275] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Refusing update from remote peer d83adaaffefb48b88b90baf6fc91bfc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.550034  1370 consensus_queue.cc:1048] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d2d678e76d4d3aad49521856989aae" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.666129   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:44.673864   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:44.693600   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:44.694240   431 tablet_replica.cc:333] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.694782   431 raft_consensus.cc:2243] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.695181   431 raft_consensus.cc:2272] T cf8a70f259284b0b97306da8ccf75758 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.696812   431 tablet_replica.cc:333] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.697350   431 raft_consensus.cc:2243] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.697721   431 raft_consensus.cc:2272] T 616cbbeddcdb4f6b9d11c2c7719276d5 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.699491   431 tablet_replica.cc:333] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.700022   431 raft_consensus.cc:2243] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.700382   431 raft_consensus.cc:2272] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.702783   431 tablet_replica.cc:333] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.703240   431 raft_consensus.cc:2243] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.703595   431 raft_consensus.cc:2272] T 98a657945a214a778f926b5eca233f93 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.705289   431 tablet_replica.cc:333] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.705739   431 raft_consensus.cc:2243] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.706127   431 raft_consensus.cc:2272] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.708390   431 tablet_replica.cc:333] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.708973   431 raft_consensus.cc:2243] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.709729   431 raft_consensus.cc:2272] T 1cb3e309ac8241b3926a0057a4a7b944 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.711145   431 tablet_replica.cc:333] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.711520   431 raft_consensus.cc:2243] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.712141   431 raft_consensus.cc:2272] T 05b30b02204b4588bc5517f0c63e8c33 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.713732   431 tablet_replica.cc:333] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.714262   431 raft_consensus.cc:2243] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.714767   431 raft_consensus.cc:2272] T e4696b682cb1442cae3322616fe744a6 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.716612   431 tablet_replica.cc:333] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.717072   431 raft_consensus.cc:2243] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.717711   431 raft_consensus.cc:2272] T 075bf95529704009a9ad40b1d34d0201 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.719221   431 tablet_replica.cc:333] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733: stopping tablet replica
I20260709 12:58:44.719630   431 raft_consensus.cc:2243] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.720290   431 raft_consensus.cc:2272] T f315ce1ede9b438d89c54a90758aa691 P 642f6bc0ca614b1e9b7264c3bc8b2733 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.746724   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:58:44.766314   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 12:58:44.791090  1173 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44611: connect: Connection refused (error 111) [suppressed 5 similar messages]
I20260709 12:58:44.792699   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:44.793525   431 tablet_replica.cc:333] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.794423   431 raft_consensus.cc:2243] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:58:44.794986  1173 consensus_peers.cc:597] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae -> Peer 642f6bc0ca614b1e9b7264c3bc8b2733 (127.0.107.193:44611): Couldn't send request to peer 642f6bc0ca614b1e9b7264c3bc8b2733. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:44.795348   431 raft_consensus.cc:2272] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.797330   431 tablet_replica.cc:333] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.797806   431 raft_consensus.cc:2243] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.798142   431 raft_consensus.cc:2272] T 05b30b02204b4588bc5517f0c63e8c33 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.799546   431 tablet_replica.cc:333] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.800025   431 raft_consensus.cc:2243] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.800428   431 raft_consensus.cc:2272] T 98a657945a214a778f926b5eca233f93 P d83adaaffefb48b88b90baf6fc91bfc4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.802086   431 tablet_replica.cc:333] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.802553   431 raft_consensus.cc:2243] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.803238   431 raft_consensus.cc:2272] T e4696b682cb1442cae3322616fe744a6 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.804966   431 tablet_replica.cc:333] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.805378   431 raft_consensus.cc:2243] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.805742   431 raft_consensus.cc:2272] T 075bf95529704009a9ad40b1d34d0201 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.807226   431 tablet_replica.cc:333] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.807650   431 raft_consensus.cc:2243] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.808000   431 raft_consensus.cc:2272] T f315ce1ede9b438d89c54a90758aa691 P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.809427   431 tablet_replica.cc:333] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.809850   431 raft_consensus.cc:2243] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.810200   431 raft_consensus.cc:2272] T 616cbbeddcdb4f6b9d11c2c7719276d5 P d83adaaffefb48b88b90baf6fc91bfc4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.811887   431 tablet_replica.cc:333] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.812371   431 raft_consensus.cc:2243] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.812747   431 raft_consensus.cc:2272] T cf8a70f259284b0b97306da8ccf75758 P d83adaaffefb48b88b90baf6fc91bfc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.814203   431 tablet_replica.cc:333] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.814633   431 raft_consensus.cc:2243] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.815304   431 raft_consensus.cc:2272] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P d83adaaffefb48b88b90baf6fc91bfc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.816879   431 tablet_replica.cc:333] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4: stopping tablet replica
I20260709 12:58:44.817289   431 raft_consensus.cc:2243] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.817701   431 raft_consensus.cc:2272] T 1cb3e309ac8241b3926a0057a4a7b944 P d83adaaffefb48b88b90baf6fc91bfc4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:44.836647  1173 consensus_peers.cc:597] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae -> Peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Couldn't send request to peer d83adaaffefb48b88b90baf6fc91bfc4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:44.842988   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:58:44.860365   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:44.884163   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:44.884869   431 tablet_replica.cc:333] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.885396   431 raft_consensus.cc:2243] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.885807   431 raft_consensus.cc:2272] T e4696b682cb1442cae3322616fe744a6 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.887750   431 tablet_replica.cc:333] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.888250   431 raft_consensus.cc:2243] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.888870   431 raft_consensus.cc:2272] T 98a657945a214a778f926b5eca233f93 P c5d2d678e76d4d3aad49521856989aae [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.890491   431 tablet_replica.cc:333] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.891004   431 raft_consensus.cc:2243] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.891350   431 raft_consensus.cc:2272] T 8cdcb3a1058b42a5aaee93f47c7cbc15 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.893085   431 tablet_replica.cc:333] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.893697   431 raft_consensus.cc:2243] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.894081   431 raft_consensus.cc:2272] T 075bf95529704009a9ad40b1d34d0201 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.895946   431 tablet_replica.cc:333] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.896351   431 raft_consensus.cc:2243] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.896849   431 raft_consensus.cc:2272] T f315ce1ede9b438d89c54a90758aa691 P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:44.898528  1173 consensus_peers.cc:597] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae -> Peer d83adaaffefb48b88b90baf6fc91bfc4 (127.0.107.194:40279): Couldn't send request to peer d83adaaffefb48b88b90baf6fc91bfc4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:44.898937   431 tablet_replica.cc:333] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.899407   431 raft_consensus.cc:2243] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.899730   431 raft_consensus.cc:2272] T 1cb3e309ac8241b3926a0057a4a7b944 P c5d2d678e76d4d3aad49521856989aae [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.901190   431 tablet_replica.cc:333] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.901575   431 raft_consensus.cc:2243] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.901901   431 raft_consensus.cc:2272] T 281f1b7e5b6d4ba8b2fc37b845d77e1c P c5d2d678e76d4d3aad49521856989aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.903321   431 tablet_replica.cc:333] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.903715   431 raft_consensus.cc:2243] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.904353   431 raft_consensus.cc:2272] T cf8a70f259284b0b97306da8ccf75758 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.905779   431 tablet_replica.cc:333] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.906134   431 raft_consensus.cc:2243] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.906730   431 raft_consensus.cc:2272] T 616cbbeddcdb4f6b9d11c2c7719276d5 P c5d2d678e76d4d3aad49521856989aae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.908334   431 tablet_replica.cc:333] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae: stopping tablet replica
I20260709 12:58:44.908699   431 raft_consensus.cc:2243] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.909016   431 raft_consensus.cc:2272] T 05b30b02204b4588bc5517f0c63e8c33 P c5d2d678e76d4d3aad49521856989aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.933929   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:44.949586   431 master.cc:562] Master@127.0.107.254:45273 shutting down...
I20260709 12:58:44.966939   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:44.967409   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.967711   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P a1766ff9636f4843b2220abc11f803bd: stopping tablet replica
I20260709 12:58:44.986341   431 master.cc:584] Master@127.0.107.254:45273 shutdown complete.
642f6bc0ca614b1e9b7264c3bc8b2733  5
c5d2d678e76d4d3aad49521856989aae  1
d83adaaffefb48b88b90baf6fc91bfc4  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10474 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:58:45.025696   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:40935
I20260709 12:58:45.026774   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:45.032281  1418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:45.032312  1419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:45.033252   431 server_base.cc:1061] running on GCE node
W20260709 12:58:45.033308  1421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:45.034181   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:45.034348   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:45.034536   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601925034504 us; error 0 us; skew 500 ppm
I20260709 12:58:45.035202   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:45.037333   431 webserver.cc:533] Webserver started at http://127.0.107.254:36075/ using document root <none> and password file <none>
I20260709 12:58:45.037832   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:45.038026   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:45.038303   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:45.039384   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/master-0-root/instance:
uuid: "0c5fc33855324cbf8fc0fd695f8cc99b"
format_stamp: "Formatted at 2026-07-09 12:58:45 on dist-test-slave-szgt"
I20260709 12:58:45.043335   431 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.004s
I20260709 12:58:45.046310  1426 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.046986   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:45.047252   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/master-0-root
uuid: "0c5fc33855324cbf8fc0fd695f8cc99b"
format_stamp: "Formatted at 2026-07-09 12:58:45 on dist-test-slave-szgt"
I20260709 12:58:45.047497   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:45.059665   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:45.060768   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:45.099542   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:40935
I20260709 12:58:45.099642  1477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:40935 every 8 connection(s)
I20260709 12:58:45.103169  1478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.111943  1478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Bootstrap starting.
I20260709 12:58:45.116182  1478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.119875  1478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: No bootstrap required, opened a new log
I20260709 12:58:45.121717  1478 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5fc33855324cbf8fc0fd695f8cc99b" member_type: VOTER }
I20260709 12:58:45.122056  1478 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.122221  1478 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5fc33855324cbf8fc0fd695f8cc99b, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.122758  1478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5fc33855324cbf8fc0fd695f8cc99b" member_type: VOTER }
I20260709 12:58:45.123148  1478 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:45.123337  1478 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:45.123536  1478 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.127069  1478 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5fc33855324cbf8fc0fd695f8cc99b" member_type: VOTER }
I20260709 12:58:45.127476  1478 leader_election.cc:304] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c5fc33855324cbf8fc0fd695f8cc99b; no voters: 
I20260709 12:58:45.128396  1478 leader_election.cc:290] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:45.128723  1481 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:45.129920  1481 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 1 LEADER]: Becoming Leader. State: Replica: 0c5fc33855324cbf8fc0fd695f8cc99b, State: Running, Role: LEADER
I20260709 12:58:45.130651  1481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5fc33855324cbf8fc0fd695f8cc99b" member_type: VOTER }
I20260709 12:58:45.131443  1478 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:45.135524  1483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c5fc33855324cbf8fc0fd695f8cc99b. Latest consensus state: current_term: 1 leader_uuid: "0c5fc33855324cbf8fc0fd695f8cc99b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5fc33855324cbf8fc0fd695f8cc99b" member_type: VOTER } }
I20260709 12:58:45.136142  1482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c5fc33855324cbf8fc0fd695f8cc99b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c5fc33855324cbf8fc0fd695f8cc99b" member_type: VOTER } }
I20260709 12:58:45.136327  1483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:45.136638  1482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:45.137974  1488 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:45.142657  1488 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:45.145820   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:45.151149  1488 catalog_manager.cc:1383] Generated new cluster ID: 420167cf5e444434a250a24d4e380c7a
I20260709 12:58:45.151400  1488 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:45.180837  1488 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:45.181932  1488 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:45.199411  1488 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Generated new TSK 0
I20260709 12:58:45.199932  1488 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:45.212054   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:45.217373  1499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:45.218289  1500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:45.220885  1502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:45.222005   431 server_base.cc:1061] running on GCE node
I20260709 12:58:45.223124   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:45.223313   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:45.223485   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601925223466 us; error 0 us; skew 500 ppm
I20260709 12:58:45.223997   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:45.225970   431 webserver.cc:533] Webserver started at http://127.0.107.193:43311/ using document root <none> and password file <none>
I20260709 12:58:45.226402   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:45.226603   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:45.226920   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:45.227866   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/instance:
uuid: "0cccd9c43f9747529680a8e7463961c9"
format_stamp: "Formatted at 2026-07-09 12:58:45 on dist-test-slave-szgt"
I20260709 12:58:45.232046   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:45.235057  1507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.235702   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260709 12:58:45.235980   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "0cccd9c43f9747529680a8e7463961c9"
format_stamp: "Formatted at 2026-07-09 12:58:45 on dist-test-slave-szgt"
I20260709 12:58:45.236236   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:45.258175   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:45.259361   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:45.260813   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:45.262917   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:45.263127   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.263363   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:45.263540   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.300518   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42041
I20260709 12:58:45.300599  1569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42041 every 8 connection(s)
I20260709 12:58:45.305306   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:45.312340  1574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:45.314354  1575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:45.315338  1577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:45.316587   431 server_base.cc:1061] running on GCE node
I20260709 12:58:45.317955   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:45.318161   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:45.318342   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601925318322 us; error 0 us; skew 500 ppm
I20260709 12:58:45.318395  1570 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40935
I20260709 12:58:45.318794  1570 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:45.319024   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:45.319572  1570 heartbeater.cc:507] Master 127.0.107.254:40935 requested a full tablet report, sending...
I20260709 12:58:45.321358   431 webserver.cc:533] Webserver started at http://127.0.107.194:37397/ using document root <none> and password file <none>
I20260709 12:58:45.321879   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:45.321789  1443 ts_manager.cc:194] Registered new tserver with Master: 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:58:45.322173   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:45.322479   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:45.323571   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/instance:
uuid: "e12d7b3551014757ba7dda3e83605b83"
format_stamp: "Formatted at 2026-07-09 12:58:45 on dist-test-slave-szgt"
I20260709 12:58:45.323678  1443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38628
I20260709 12:58:45.327728   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:45.330981  1582 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.331610   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:58:45.331871   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root
uuid: "e12d7b3551014757ba7dda3e83605b83"
format_stamp: "Formatted at 2026-07-09 12:58:45 on dist-test-slave-szgt"
I20260709 12:58:45.332134   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:45.340286   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:45.341408   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:45.342648   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:45.344846   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:45.345073   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.345293   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:45.345454   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.381809   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:46485
I20260709 12:58:45.381894  1644 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:46485 every 8 connection(s)
I20260709 12:58:45.386409   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:45.393612  1649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:45.394218  1648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:45.396489  1645 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40935
I20260709 12:58:45.397015  1645 heartbeater.cc:461] Registering TS with master...
W20260709 12:58:45.397203  1651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:45.397784   431 server_base.cc:1061] running on GCE node
I20260709 12:58:45.397974  1645 heartbeater.cc:507] Master 127.0.107.254:40935 requested a full tablet report, sending...
I20260709 12:58:45.398651   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:45.398932   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:45.399123   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601925399105 us; error 0 us; skew 500 ppm
I20260709 12:58:45.399844   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:45.400080  1443 ts_manager.cc:194] Registered new tserver with Master: e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:45.401532  1443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38640
I20260709 12:58:45.402097   431 webserver.cc:533] Webserver started at http://127.0.107.195:38931/ using document root <none> and password file <none>
I20260709 12:58:45.402725   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:45.402942   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:45.403221   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:45.404266   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/instance:
uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
format_stamp: "Formatted at 2026-07-09 12:58:45 on dist-test-slave-szgt"
I20260709 12:58:45.408161   431 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:58:45.410823  1656 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.411525   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:45.411799   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root
uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
format_stamp: "Formatted at 2026-07-09 12:58:45 on dist-test-slave-szgt"
I20260709 12:58:45.412077   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:45.429540   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:45.431174   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:45.433691   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:45.437480   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:45.437702   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.438092   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:45.438338   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:45.485488   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35447
I20260709 12:58:45.485589  1718 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35447 every 8 connection(s)
I20260709 12:58:45.498287  1719 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40935
I20260709 12:58:45.498608  1719 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:45.499300  1719 heartbeater.cc:507] Master 127.0.107.254:40935 requested a full tablet report, sending...
I20260709 12:58:45.501022  1443 ts_manager.cc:194] Registered new tserver with Master: e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:45.501739   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013059052s
I20260709 12:58:45.502267  1443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38652
I20260709 12:58:45.524565  1443 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38662:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:45.530104  1443 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:45.718068  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 60ed567c64f3422894e8776f5815e0b8 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:45.728588  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ed567c64f3422894e8776f5815e0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.729151  1601 tablet_service.cc:1511] Processing CreateTablet for tablet f81118a8e62c4910be3913ae0e3f240d (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:45.730343  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81118a8e62c4910be3913ae0e3f240d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.719769  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 8a483be3e3ee4d5381336b0877760ca9 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:45.721437  1604 tablet_service.cc:1511] Processing CreateTablet for tablet d9be6d7fbe2348e4a1be13e50f487f82 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:45.732172  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9be6d7fbe2348e4a1be13e50f487f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.723021  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 044356f91b2d4fe4a34deeb351b2fbac (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:45.735329  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044356f91b2d4fe4a34deeb351b2fbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.724624  1608 tablet_service.cc:1511] Processing CreateTablet for tablet b37b7f2c08b145c6b88f543822a1cf5c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:45.739750  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37b7f2c08b145c6b88f543822a1cf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.724627  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 0644dffc23e84f7da7f8c0aac9e1c859 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:45.725741  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 82622e43412243cb95bf17b246050060 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:45.726904  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 69b3c7e5df794f4baecc6be830fb8f80 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:45.743808  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0644dffc23e84f7da7f8c0aac9e1c859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.744530  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b3c7e5df794f4baecc6be830fb8f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.745771  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a483be3e3ee4d5381336b0877760ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.727237  1605 tablet_service.cc:1511] Processing CreateTablet for tablet ece2ab6676aa475ba1e5a5d1b13fc569 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:45.747454  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece2ab6676aa475ba1e5a5d1b13fc569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.751024  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82622e43412243cb95bf17b246050060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.771914  1734 tablet_bootstrap.cc:492] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:45.775046  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 4c492e0f519d422fb3a26617a5a4dbe6 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:45.779160  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c492e0f519d422fb3a26617a5a4dbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.791684  1734 tablet_bootstrap.cc:654] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.816936  1606 tablet_service.cc:1511] Processing CreateTablet for tablet c48135c32120406e945bec13a16ae327 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:45.812103  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 3485ff8d284d46bea80fa498e5f6d34a (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:45.821640  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48135c32120406e945bec13a16ae327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.822983  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3485ff8d284d46bea80fa498e5f6d34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.824542  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 5fb2b0bb91ba4b59bba638c371a86a1e (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:45.826035  1605 tablet_service.cc:1511] Processing CreateTablet for tablet d53120c1adf947fd992e5950edf26301 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:45.829383  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 7a24aaf5c9514244ae333d411f1fb4f5 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:45.835808  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb2b0bb91ba4b59bba638c371a86a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.813669  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef93a23494e4934beefa28be227bc72 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:45.855356  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53120c1adf947fd992e5950edf26301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.806622  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5e0874051d4aa6807636e553d51e6c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:45.860184  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 4a0105ba6bf14860a95121a73725f62e (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:45.860647  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 60ed567c64f3422894e8776f5815e0b8 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:45.862762  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 69b3c7e5df794f4baecc6be830fb8f80 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:45.861222  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a24aaf5c9514244ae333d411f1fb4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.862298  1608 tablet_service.cc:1511] Processing CreateTablet for tablet b3d6c15d42494c1cbf1914151dcfb5ac (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:45.864033  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ed567c64f3422894e8776f5815e0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.864395  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d6c15d42494c1cbf1914151dcfb5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.865468  1533 tablet_service.cc:1511] Processing CreateTablet for tablet b37b7f2c08b145c6b88f543822a1cf5c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:45.862589  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3db709fac1489b928f0a9df67f0426 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:45.859856  1603 tablet_service.cc:1511] Processing CreateTablet for tablet f6fc10a7f7a84904a1cc02696513828e (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:45.866745  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37b7f2c08b145c6b88f543822a1cf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.867311  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3db709fac1489b928f0a9df67f0426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.868767  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 8a483be3e3ee4d5381336b0877760ca9 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:45.869589  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fc10a7f7a84904a1cc02696513828e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.870956  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0105ba6bf14860a95121a73725f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.871796  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 044356f91b2d4fe4a34deeb351b2fbac (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:45.873921  1530 tablet_service.cc:1511] Processing CreateTablet for tablet ece2ab6676aa475ba1e5a5d1b13fc569 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:45.876072  1529 tablet_service.cc:1511] Processing CreateTablet for tablet d9be6d7fbe2348e4a1be13e50f487f82 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:45.876065  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 1669ae3f986d428ca0a51760ca20bc70 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:45.879842  1526 tablet_service.cc:1511] Processing CreateTablet for tablet f81118a8e62c4910be3913ae0e3f240d (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:45.880806  1734 tablet_bootstrap.cc:492] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:45.879654  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef93a23494e4934beefa28be227bc72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.878482  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 82622e43412243cb95bf17b246050060 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:45.883309  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5e0874051d4aa6807636e553d51e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.883841  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1669ae3f986d428ca0a51760ca20bc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.885831  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 60ed567c64f3422894e8776f5815e0b8 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:45.887224  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ed567c64f3422894e8776f5815e0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.894994  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9be6d7fbe2348e4a1be13e50f487f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.894826  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 69b3c7e5df794f4baecc6be830fb8f80 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:45.896023  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b3c7e5df794f4baecc6be830fb8f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.901620  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b3c7e5df794f4baecc6be830fb8f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.903719  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 0de7551eb2ca4d369ae826fcaebd0301 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:45.904857  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de7551eb2ca4d369ae826fcaebd0301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.905862  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a483be3e3ee4d5381336b0877760ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.906622  1682 tablet_service.cc:1511] Processing CreateTablet for tablet b37b7f2c08b145c6b88f543822a1cf5c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:45.907325  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82622e43412243cb95bf17b246050060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.907866  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37b7f2c08b145c6b88f543822a1cf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.877187  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 0644dffc23e84f7da7f8c0aac9e1c859 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:45.911011  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044356f91b2d4fe4a34deeb351b2fbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.912045  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece2ab6676aa475ba1e5a5d1b13fc569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.881232  1734 ts_tablet_manager.cc:1403] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.110s	user 0.019s	sys 0.028s
I20260709 12:58:45.949354  1734 raft_consensus.cc:359] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:45.950019  1734 raft_consensus.cc:385] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.950299  1734 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.950835  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 044356f91b2d4fe4a34deeb351b2fbac (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:45.952106  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044356f91b2d4fe4a34deeb351b2fbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.920459  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 8a483be3e3ee4d5381336b0877760ca9 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:45.953393  1678 tablet_service.cc:1511] Processing CreateTablet for tablet d9be6d7fbe2348e4a1be13e50f487f82 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:45.953979  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a483be3e3ee4d5381336b0877760ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.954663  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9be6d7fbe2348e4a1be13e50f487f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.955695  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 0644dffc23e84f7da7f8c0aac9e1c859 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:45.951745  1679 tablet_service.cc:1511] Processing CreateTablet for tablet ece2ab6676aa475ba1e5a5d1b13fc569 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:45.957778  1675 tablet_service.cc:1511] Processing CreateTablet for tablet f81118a8e62c4910be3913ae0e3f240d (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:45.957893  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 82622e43412243cb95bf17b246050060 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:45.930564  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 7aeb3a1da10b4e5a8070d908a280055c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:45.966513  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aeb3a1da10b4e5a8070d908a280055c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.969521  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0644dffc23e84f7da7f8c0aac9e1c859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.970878  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece2ab6676aa475ba1e5a5d1b13fc569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.971482  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82622e43412243cb95bf17b246050060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.972448  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81118a8e62c4910be3913ae0e3f240d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.974200  1609 tablet_service.cc:1511] Processing CreateTablet for tablet c330c505ed4e4efda5c94a1811c68633 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:45.975425  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c330c505ed4e4efda5c94a1811c68633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.914402  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0644dffc23e84f7da7f8c0aac9e1c859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.975308  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9fcd10c7c244bf918f2218237f5b3a (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:45.976912  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9fcd10c7c244bf918f2218237f5b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.977994  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81118a8e62c4910be3913ae0e3f240d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.980285  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 48f214986b534c7ea670b8ff7960e691 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:45.981469  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f214986b534c7ea670b8ff7960e691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:45.988431  1734 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:45.950829  1604 tablet_service.cc:1511] Processing CreateTablet for tablet c21865842c3d4eafba995dd02f14b489 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:45.990717  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21865842c3d4eafba995dd02f14b489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.003679  1601 tablet_service.cc:1511] Processing CreateTablet for tablet c0cd29b6c17d47e6bfaba57728b3b725 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:46.004860  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0cd29b6c17d47e6bfaba57728b3b725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.007243  1603 tablet_service.cc:1511] Processing CreateTablet for tablet ccb59a831c424786ae1c9dfd1db1f6d3 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:46.026942  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccb59a831c424786ae1c9dfd1db1f6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.039352  1734 ts_tablet_manager.cc:1434] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.002s
I20260709 12:58:46.040096  1645 heartbeater.cc:499] Master 127.0.107.254:40935 was elected leader, sending a full tablet report...
I20260709 12:58:46.045084  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5e0874051d4aa6807636e553d51e6c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:46.053184  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 4c492e0f519d422fb3a26617a5a4dbe6 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:46.059971  1736 tablet_bootstrap.cc:492] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:46.071163  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5e0874051d4aa6807636e553d51e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.072678  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3947e120494929a5b22c639f5d830c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:46.075693  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 4c492e0f519d422fb3a26617a5a4dbe6 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:46.076426  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 3485ff8d284d46bea80fa498e5f6d34a (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:46.076809  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c492e0f519d422fb3a26617a5a4dbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.077468  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3485ff8d284d46bea80fa498e5f6d34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.096344  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3947e120494929a5b22c639f5d830c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.096760  1738 tablet_bootstrap.cc:492] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:46.098372  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c492e0f519d422fb3a26617a5a4dbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.055018  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5e0874051d4aa6807636e553d51e6c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:46.099148  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 3485ff8d284d46bea80fa498e5f6d34a (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:46.107458  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5e0874051d4aa6807636e553d51e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.107542  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3485ff8d284d46bea80fa498e5f6d34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.102829  1603 tablet_service.cc:1511] Processing CreateTablet for tablet cba7ca1546e44219b4872d2d3ae34040 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:46.103931  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 90bfe669a290453597d79375d2aadae5 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:46.109565  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bfe669a290453597d79375d2aadae5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:46.109913  1430 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 44326.4us
I20260709 12:58:46.112087  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef93a23494e4934beefa28be227bc72 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:46.113585  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef93a23494e4934beefa28be227bc72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.114405  1734 tablet_bootstrap.cc:492] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:46.114614  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba7ca1546e44219b4872d2d3ae34040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.131300  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 4e51c69bdb8c4616a20162792bc3e235 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:46.132907  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e51c69bdb8c4616a20162792bc3e235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.134508  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 5e675a1020ff48279e061c44c1a368ae (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:46.141217  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e675a1020ff48279e061c44c1a368ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.136747  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3b81d89af143c88a2c3179213662ff (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 12:58:46.147913  1491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:46.148849  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 5fb2b0bb91ba4b59bba638c371a86a1e (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:46.149989  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb2b0bb91ba4b59bba638c371a86a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.154955  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3b81d89af143c88a2c3179213662ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.155442  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef93a23494e4934beefa28be227bc72 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:46.156558  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef93a23494e4934beefa28be227bc72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.158773  1535 tablet_service.cc:1511] Processing CreateTablet for tablet d53120c1adf947fd992e5950edf26301 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:46.159917  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53120c1adf947fd992e5950edf26301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.174160  1529 tablet_service.cc:1511] Processing CreateTablet for tablet f6fc10a7f7a84904a1cc02696513828e (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:46.187201  1526 tablet_service.cc:1511] Processing CreateTablet for tablet c48135c32120406e945bec13a16ae327 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:46.188418  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fc10a7f7a84904a1cc02696513828e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.189728  1738 tablet_bootstrap.cc:654] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.212141  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 5fb2b0bb91ba4b59bba638c371a86a1e (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:46.190608  1610 tablet_service.cc:1511] Processing CreateTablet for tablet b2590e3864b048c4b1d12cec239acf7a (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:46.192687  1601 tablet_service.cc:1511] Processing CreateTablet for tablet f99348e8926940e29e1f3d35bef36868 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:46.193660  1607 tablet_service.cc:1511] Processing CreateTablet for tablet ce9fc6a855e249298263a94d04de35a4 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:46.197247  1734 tablet_bootstrap.cc:654] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.198848  1736 tablet_bootstrap.cc:654] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.198441  1608 tablet_service.cc:1511] Processing CreateTablet for tablet dbe29c0d913c42cfb39d487a69abfd46 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:46.203456  1684 tablet_service.cc:1511] Processing CreateTablet for tablet c48135c32120406e945bec13a16ae327 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:46.214216  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 7a24aaf5c9514244ae333d411f1fb4f5 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:46.214787  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2590e3864b048c4b1d12cec239acf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.215893  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb2b0bb91ba4b59bba638c371a86a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.220870  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48135c32120406e945bec13a16ae327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.237679  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a24aaf5c9514244ae333d411f1fb4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.241309  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 4a0105ba6bf14860a95121a73725f62e (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:46.242439  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0105ba6bf14860a95121a73725f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.244998  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48135c32120406e945bec13a16ae327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.224828  1605 tablet_service.cc:1511] Processing CreateTablet for tablet b25acf355940411ba0ffd6483b7467c3 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:46.250622  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99348e8926940e29e1f3d35bef36868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.251439  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe29c0d913c42cfb39d487a69abfd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.253364  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9fc6a855e249298263a94d04de35a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.262284  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25acf355940411ba0ffd6483b7467c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.262316  1675 tablet_service.cc:1511] Processing CreateTablet for tablet d53120c1adf947fd992e5950edf26301 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:46.265424  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53120c1adf947fd992e5950edf26301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.272238  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 1669ae3f986d428ca0a51760ca20bc70 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:46.274593  1737 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.275811  1530 tablet_service.cc:1511] Processing CreateTablet for tablet b3d6c15d42494c1cbf1914151dcfb5ac (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:46.283383  1736 tablet_bootstrap.cc:492] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:46.284039  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3db709fac1489b928f0a9df67f0426 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:46.286635  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 8d969afe49dd43c2902adb01b5aa223b (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:46.304455  1737 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.289327  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 0de7551eb2ca4d369ae826fcaebd0301 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:46.226351  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 35e8bc6e059f4dc3b59e584357979e78 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:46.297595  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 9f61c89956d24976b4d464550172cd55 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:46.306548  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3db709fac1489b928f0a9df67f0426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.309697  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e8bc6e059f4dc3b59e584357979e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.307439  1736 ts_tablet_manager.cc:1403] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.248s	user 0.006s	sys 0.014s
I20260709 12:58:46.310037  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d6c15d42494c1cbf1914151dcfb5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.312644  1736 raft_consensus.cc:359] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.313279  1738 tablet_bootstrap.cc:492] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:46.313324  1736 raft_consensus.cc:385] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.313833  1738 ts_tablet_manager.cc:1403] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.217s	user 0.008s	sys 0.009s
I20260709 12:58:46.314661  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d969afe49dd43c2902adb01b5aa223b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.315053  1737 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:46.315852  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f61c89956d24976b4d464550172cd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.316730  1738 raft_consensus.cc:359] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:58:46.317425  1738 raft_consensus.cc:385] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.317706  1738 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.313751  1736 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.319440  1736 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.308321  1602 tablet_service.cc:1511] Processing CreateTablet for tablet daa50dd25c7f47639f933e047d81de75 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:46.322166  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa50dd25c7f47639f933e047d81de75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.323354  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de7551eb2ca4d369ae826fcaebd0301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.325204  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1669ae3f986d428ca0a51760ca20bc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.325934  1570 heartbeater.cc:499] Master 127.0.107.254:40935 was elected leader, sending a full tablet report...
I20260709 12:58:46.318378  1738 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:58:46.298239  1531 tablet_service.cc:1511] Processing CreateTablet for tablet c21865842c3d4eafba995dd02f14b489 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:46.331786  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21865842c3d4eafba995dd02f14b489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.356782  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 4a0105ba6bf14860a95121a73725f62e (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:46.359674  1680 tablet_service.cc:1511] Processing CreateTablet for tablet f6fc10a7f7a84904a1cc02696513828e (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:46.360457  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab387e7d0b0401eb317a86421cc1f80 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:46.362155  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 7a24aaf5c9514244ae333d411f1fb4f5 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:46.365885  1683 tablet_service.cc:1511] Processing CreateTablet for tablet b3d6c15d42494c1cbf1914151dcfb5ac (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:46.361685  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab387e7d0b0401eb317a86421cc1f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.371737  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 1f35127b66604c1685f1fbe404840774 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:46.372964  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f35127b66604c1685f1fbe404840774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.304611  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 7aeb3a1da10b4e5a8070d908a280055c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:46.376013  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aeb3a1da10b4e5a8070d908a280055c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.381932  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 96e20996757d4784ade11fe9799f7a13 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:46.385030  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 17c95b4249214135b23fe0bcbdcf8ad3 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:46.391964  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 48f214986b534c7ea670b8ff7960e691 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:46.396597  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c95b4249214135b23fe0bcbdcf8ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.389567  1534 tablet_service.cc:1511] Processing CreateTablet for tablet c330c505ed4e4efda5c94a1811c68633 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:46.420877  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e20996757d4784ade11fe9799f7a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.423081  1738 ts_tablet_manager.cc:1434] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.109s	user 0.020s	sys 0.010s
I20260709 12:58:46.423780  1719 heartbeater.cc:499] Master 127.0.107.254:40935 was elected leader, sending a full tablet report...
I20260709 12:58:46.428586  1736 ts_tablet_manager.cc:1434] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.118s	user 0.023s	sys 0.017s
I20260709 12:58:46.431684  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 48f214986b534c7ea670b8ff7960e691 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:46.433256  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3db709fac1489b928f0a9df67f0426 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:46.435138  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3db709fac1489b928f0a9df67f0426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.435570  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 5b4609f4058b459f804e03408773bd69 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:46.436724  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4609f4058b459f804e03408773bd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.440438  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 1669ae3f986d428ca0a51760ca20bc70 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:46.441556  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1669ae3f986d428ca0a51760ca20bc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.443645  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d6c15d42494c1cbf1914151dcfb5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.446985  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f214986b534c7ea670b8ff7960e691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.447628  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fc10a7f7a84904a1cc02696513828e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.448202  1738 tablet_bootstrap.cc:492] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:46.450735  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a24aaf5c9514244ae333d411f1fb4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.450971  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 0de7551eb2ca4d369ae826fcaebd0301 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:46.451710  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0105ba6bf14860a95121a73725f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.453660  1681 tablet_service.cc:1511] Processing CreateTablet for tablet c21865842c3d4eafba995dd02f14b489 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:46.455394  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21865842c3d4eafba995dd02f14b489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.458921  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de7551eb2ca4d369ae826fcaebd0301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.461448  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 1532fbff9860493fa0fbdf5eb1b21242 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:46.462592  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 486718b388ed49eaafdc2e13d168a057 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:46.480476  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 83a99308299b4d05a3b45157d06ba9bd (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:46.489315  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 7aeb3a1da10b4e5a8070d908a280055c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:46.490583  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aeb3a1da10b4e5a8070d908a280055c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.496515  1679 tablet_service.cc:1511] Processing CreateTablet for tablet c330c505ed4e4efda5c94a1811c68633 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:46.497697  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c330c505ed4e4efda5c94a1811c68633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.499017  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9fcd10c7c244bf918f2218237f5b3a (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:46.500166  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9fcd10c7c244bf918f2218237f5b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.503239  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f214986b534c7ea670b8ff7960e691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.504127  1738 tablet_bootstrap.cc:654] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.504320  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9fcd10c7c244bf918f2218237f5b3a (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:46.505486  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9fcd10c7c244bf918f2218237f5b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.507942  1535 tablet_service.cc:1511] Processing CreateTablet for tablet c0cd29b6c17d47e6bfaba57728b3b725 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:46.508996  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0cd29b6c17d47e6bfaba57728b3b725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.510327  1745 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.510778  1745 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:58:46.512449  1529 tablet_service.cc:1511] Processing CreateTablet for tablet ccb59a831c424786ae1c9dfd1db1f6d3 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:46.512562  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3947e120494929a5b22c639f5d830c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:46.513235  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c330c505ed4e4efda5c94a1811c68633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.514350  1736 tablet_bootstrap.cc:492] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:46.516511  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 90bfe669a290453597d79375d2aadae5 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:46.517891  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bfe669a290453597d79375d2aadae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.520376  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 4e51c69bdb8c4616a20162792bc3e235 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:46.521699  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e51c69bdb8c4616a20162792bc3e235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.529976  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3947e120494929a5b22c639f5d830c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.537635  1745 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:58:46.538550  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 5e675a1020ff48279e061c44c1a368ae (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:46.539113  1734 tablet_bootstrap.cc:492] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:46.539523  1734 ts_tablet_manager.cc:1403] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.425s	user 0.027s	sys 0.009s
I20260709 12:58:46.523025  1527 tablet_service.cc:1511] Processing CreateTablet for tablet cba7ca1546e44219b4872d2d3ae34040 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:46.547147  1734 raft_consensus.cc:359] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.547837  1734 raft_consensus.cc:385] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.548123  1734 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.549065  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccb59a831c424786ae1c9dfd1db1f6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.551047  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 165cabe60a114b9ca5fda64711bd3163 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:46.551204  1603 tablet_service.cc:1511] Processing CreateTablet for tablet ea97e615db7549b797908560563dd608 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:46.552081  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165cabe60a114b9ca5fda64711bd3163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.553514  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd03248480b4bfd8a76471850708909 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:46.555974  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0b1eaf4f774ec3b24c196f0234dff9 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:46.554642  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd03248480b4bfd8a76471850708909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.558964  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a99308299b4d05a3b45157d06ba9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.558908  1734 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.559818  1678 tablet_service.cc:1511] Processing CreateTablet for tablet c0cd29b6c17d47e6bfaba57728b3b725 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:46.560267  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1532fbff9860493fa0fbdf5eb1b21242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.561038  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0cd29b6c17d47e6bfaba57728b3b725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.561532  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486718b388ed49eaafdc2e13d168a057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.563541  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba7ca1546e44219b4872d2d3ae34040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.579419  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0b1eaf4f774ec3b24c196f0234dff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.579746  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 96e20996757d4784ade11fe9799f7a13 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:46.580943  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e20996757d4784ade11fe9799f7a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.594795  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea97e615db7549b797908560563dd608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.595479  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3b81d89af143c88a2c3179213662ff (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:46.598819  1734 ts_tablet_manager.cc:1434] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:58:46.600016  1734 tablet_bootstrap.cc:492] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:46.606566  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 8f45eebdd49441fa87ca7768bae03d64 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:46.607738  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f45eebdd49441fa87ca7768bae03d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.608064  1677 tablet_service.cc:1511] Processing CreateTablet for tablet ccb59a831c424786ae1c9dfd1db1f6d3 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:46.609529  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccb59a831c424786ae1c9dfd1db1f6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.615744  1738 tablet_bootstrap.cc:492] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:46.616163  1738 ts_tablet_manager.cc:1403] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.168s	user 0.010s	sys 0.016s
I20260709 12:58:46.620707  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 90bfe669a290453597d79375d2aadae5 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:46.621850  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bfe669a290453597d79375d2aadae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.620628  1738 raft_consensus.cc:359] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.622812  1738 raft_consensus.cc:385] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.623153  1738 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.623800  1738 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.625180  1737 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.616662  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3947e120494929a5b22c639f5d830c (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:46.625648  1737 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.626276  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e675a1020ff48279e061c44c1a368ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.627547  1737 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:46.626030  1738 ts_tablet_manager.cc:1434] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:58:46.628145  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3b81d89af143c88a2c3179213662ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.628568  1738 tablet_bootstrap.cc:492] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:46.634472  1738 tablet_bootstrap.cc:654] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.638754  1681 tablet_service.cc:1511] Processing CreateTablet for tablet cba7ca1546e44219b4872d2d3ae34040 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:46.639986  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba7ca1546e44219b4872d2d3ae34040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.642663  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:46.644098  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:46.645529  1584 leader_election.cc:343] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:46.646095  1584 leader_election.cc:343] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.647357  1736 tablet_bootstrap.cc:654] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.648409  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3947e120494929a5b22c639f5d830c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.653838  1532 tablet_service.cc:1511] Processing CreateTablet for tablet b2590e3864b048c4b1d12cec239acf7a (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:46.660396  1526 tablet_service.cc:1511] Processing CreateTablet for tablet f99348e8926940e29e1f3d35bef36868 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:46.663949  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2590e3864b048c4b1d12cec239acf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.667484  1744 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.667941  1744 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.667934  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99348e8926940e29e1f3d35bef36868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.684350  1744 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:46.670375  1535 tablet_service.cc:1511] Processing CreateTablet for tablet ce9fc6a855e249298263a94d04de35a4 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:46.724274  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 4e51c69bdb8c4616a20162792bc3e235 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:46.729799  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 5e675a1020ff48279e061c44c1a368ae (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:46.726569  1734 tablet_bootstrap.cc:654] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.747211  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:46.763582  1529 tablet_service.cc:1511] Processing CreateTablet for tablet dbe29c0d913c42cfb39d487a69abfd46 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:46.764988  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e51c69bdb8c4616a20162792bc3e235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.766467  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 35e8bc6e059f4dc3b59e584357979e78 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:46.763010  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9fc6a855e249298263a94d04de35a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.772089  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:46.773568  1530 tablet_service.cc:1511] Processing CreateTablet for tablet b25acf355940411ba0ffd6483b7467c3 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:46.774819  1736 tablet_bootstrap.cc:492] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:46.776371  1738 tablet_bootstrap.cc:492] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:46.776875  1738 ts_tablet_manager.cc:1403] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.148s	user 0.014s	sys 0.000s
I20260709 12:58:46.779364  1738 raft_consensus.cc:359] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.780086  1738 raft_consensus.cc:385] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.780355  1738 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.781262  1738 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:46.765226  1658 leader_election.cc:343] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.786612  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3b81d89af143c88a2c3179213662ff (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:46.787804  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3b81d89af143c88a2c3179213662ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.788574  1683 tablet_service.cc:1511] Processing CreateTablet for tablet b2590e3864b048c4b1d12cec239acf7a (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:46.789353  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 9f61c89956d24976b4d464550172cd55 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:46.789736  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2590e3864b048c4b1d12cec239acf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.794165  1679 tablet_service.cc:1511] Processing CreateTablet for tablet f99348e8926940e29e1f3d35bef36868 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:46.803419  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99348e8926940e29e1f3d35bef36868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.805356  1682 tablet_service.cc:1511] Processing CreateTablet for tablet dbe29c0d913c42cfb39d487a69abfd46 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:46.795230  1738 ts_tablet_manager.cc:1434] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:58:46.797008  1676 tablet_service.cc:1511] Processing CreateTablet for tablet ce9fc6a855e249298263a94d04de35a4 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:46.808537  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 35e8bc6e059f4dc3b59e584357979e78 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:46.811470  1738 tablet_bootstrap.cc:492] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
W20260709 12:58:46.811609  1660 leader_election.cc:343] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.809957  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 8d969afe49dd43c2902adb01b5aa223b (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:46.817540  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:46.811466  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9fc6a855e249298263a94d04de35a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.818107  1535 tablet_service.cc:1511] Processing CreateTablet for tablet daa50dd25c7f47639f933e047d81de75 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:46.818861  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e675a1020ff48279e061c44c1a368ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.820693  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe29c0d913c42cfb39d487a69abfd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.784705  1736 ts_tablet_manager.cc:1403] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.271s	user 0.019s	sys 0.009s
I20260709 12:58:46.818336  1745 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:46.821059  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 55986.1us
I20260709 12:58:46.783389  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25acf355940411ba0ffd6483b7467c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.797991  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 9f61c89956d24976b4d464550172cd55 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:46.823616  1681 tablet_service.cc:1511] Processing CreateTablet for tablet b25acf355940411ba0ffd6483b7467c3 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:46.829985  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 1f35127b66604c1685f1fbe404840774 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:46.830622  1745 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.831080  1745 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.831525  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab387e7d0b0401eb317a86421cc1f80 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:46.833003  1745 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:46.835505  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:46.836745  1660 leader_election.cc:343] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.831086  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e8bc6e059f4dc3b59e584357979e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.841573  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 96e20996757d4784ade11fe9799f7a13 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:46.843231  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f61c89956d24976b4d464550172cd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.845131  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:46.845892  1736 raft_consensus.cc:359] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 12:58:46.846510  1511 leader_election.cc:343] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.846645  1736 raft_consensus.cc:385] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.846984  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25acf355940411ba0ffd6483b7467c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.847100  1736 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.850924  1736 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:58:46.852249  1738 tablet_bootstrap.cc:654] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.883178  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 83a99308299b4d05a3b45157d06ba9bd (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:46.884455  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a99308299b4d05a3b45157d06ba9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.886484  1736 ts_tablet_manager.cc:1434] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.062s	user 0.001s	sys 0.004s
I20260709 12:58:46.887527  1736 tablet_bootstrap.cc:492] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:46.853731  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 8d969afe49dd43c2902adb01b5aa223b (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:46.856340  1678 tablet_service.cc:1511] Processing CreateTablet for tablet daa50dd25c7f47639f933e047d81de75 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:46.858107  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa50dd25c7f47639f933e047d81de75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.897051  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa50dd25c7f47639f933e047d81de75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.859227  1734 tablet_bootstrap.cc:492] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:46.859237  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab387e7d0b0401eb317a86421cc1f80 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:46.860270  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 5b4609f4058b459f804e03408773bd69 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:46.899036  1734 ts_tablet_manager.cc:1403] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.299s	user 0.010s	sys 0.010s
I20260709 12:58:46.899488  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab387e7d0b0401eb317a86421cc1f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.899561  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4609f4058b459f804e03408773bd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.901842  1734 raft_consensus.cc:359] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:58:46.862206  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:46.902518  1734 raft_consensus.cc:385] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.902938  1544 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:46.868103  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:46.867969  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:46.871449  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:46.904635  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:46.905115  1692 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
W20260709 12:58:46.906108  1584 leader_election.cc:343] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.906301  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d969afe49dd43c2902adb01b5aa223b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.906498  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:46.906556  1509 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:46.906951  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f35127b66604c1685f1fbe404840774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.907445  1745 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:46.907629  1744 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:46.907786  1745 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.908000  1744 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.908171  1745 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.908350  1744 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.909551  1737 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:46.910358  1584 leader_election.cc:343] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.910779  1584 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:46.911092  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe29c0d913c42cfb39d487a69abfd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.911684  1737 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.913100  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 17c95b4249214135b23fe0bcbdcf8ad3 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:46.914327  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c95b4249214135b23fe0bcbdcf8ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.915370  1744 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.917896  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:46.918228  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:46.919009  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d969afe49dd43c2902adb01b5aa223b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:46.919284  1511 leader_election.cc:343] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.921943  1745 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:46.922932  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e8bc6e059f4dc3b59e584357979e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.923118  1692 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:58:46.925498  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f61c89956d24976b4d464550172cd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.926048  1509 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:46.902817  1734 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.927589  1734 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:58:46.929872  1736 tablet_bootstrap.cc:654] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.933993  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 5b4609f4058b459f804e03408773bd69 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:46.935583  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 486718b388ed49eaafdc2e13d168a057 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:46.935902  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:46.936589  1544 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:46.932953  1734 ts_tablet_manager.cc:1434] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:58:46.938875  1734 tablet_bootstrap.cc:492] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:46.939539  1745 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:46.937836  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:46.918918  1744 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:46.941030  1744 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.882521  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 1f35127b66604c1685f1fbe404840774 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:58:46.941951  1660 leader_election.cc:343] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.942365  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:46.945713  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 8f45eebdd49441fa87ca7768bae03d64 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:46.930344  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e20996757d4784ade11fe9799f7a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.937814  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4609f4058b459f804e03408773bd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.946820  1745 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.929719  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 1532fbff9860493fa0fbdf5eb1b21242 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:46.954309  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab387e7d0b0401eb317a86421cc1f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.954927  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f35127b66604c1685f1fbe404840774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.961315  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 165cabe60a114b9ca5fda64711bd3163 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:46.963865  1734 tablet_bootstrap.cc:654] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.965166  1681 tablet_service.cc:1511] Processing CreateTablet for tablet ea97e615db7549b797908560563dd608 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:46.973583  1758 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.974834  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165cabe60a114b9ca5fda64711bd3163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.974951  1758 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:58:46.976081  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea97e615db7549b797908560563dd608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.965166  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd03248480b4bfd8a76471850708909 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:46.978521  1758 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:46.979414  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:46.979643  1534 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 41) took 1014 ms. Trace:
I20260709 12:58:46.980024  1620 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:46.980093  1534 rpcz_store.cc:276] 0709 12:58:45.964939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.765606 (+800667us) service_pool.cc:224] Handling call
0709 12:58:46.767347 (+  1741us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.767427 (+    80us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:46.965344 (+197917us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:46.979228 (+ 13884us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:46.979586 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:46.982043  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:46.982920  1758 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:46.983520  1758 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.983289  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 17c95b4249214135b23fe0bcbdcf8ad3 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:46.983949  1758 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.984474  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c95b4249214135b23fe0bcbdcf8ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.986760  1738 tablet_bootstrap.cc:492] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:46.982859  1528 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 43) took 1014 ms. Trace:
I20260709 12:58:46.987309  1738 ts_tablet_manager.cc:1403] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.176s	user 0.015s	sys 0.003s
I20260709 12:58:46.987188  1528 rpcz_store.cc:276] 0709 12:58:45.968401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.788438 (+820037us) service_pool.cc:224] Handling call
0709 12:58:46.798411 (+  9973us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.798576 (+   165us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:46.967725 (+169149us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:46.973412 (+  5687us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:46.982786 (+  9374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:46.994414  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 83a99308299b4d05a3b45157d06ba9bd (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:46.996538  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:46.998170  1692 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:46.990947  1758 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:58:47.004235  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486718b388ed49eaafdc2e13d168a057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.004911  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd03248480b4bfd8a76471850708909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.010934  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1532fbff9860493fa0fbdf5eb1b21242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.015303  1736 tablet_bootstrap.cc:492] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.011128  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a99308299b4d05a3b45157d06ba9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.015734  1736 ts_tablet_manager.cc:1403] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.128s	user 0.023s	sys 0.031s
I20260709 12:58:47.016479  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:47.013240  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 8f45eebdd49441fa87ca7768bae03d64 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:47.016996  1620 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.017520  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f45eebdd49441fa87ca7768bae03d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.023874  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f45eebdd49441fa87ca7768bae03d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.026177  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0b1eaf4f774ec3b24c196f0234dff9 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:47.029210  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.027388  1620 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.027808  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 486718b388ed49eaafdc2e13d168a057 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:47.033703  1692 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.029276  1758 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.035036  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486718b388ed49eaafdc2e13d168a057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.036770  1529 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 40) took 1072 ms. Trace:
I20260709 12:58:47.039090  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:47.018651  1736 raft_consensus.cc:359] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.043828  1736 raft_consensus.cc:385] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.043967  1758 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.044168  1736 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.044482  1758 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:47.045498  1527 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 44) took 1073 ms. Trace:
I20260709 12:58:47.045385  1758 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:58:47.045856  1527 rpcz_store.cc:276] 0709 12:58:45.972148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.804056 (+831908us) service_pool.cc:224] Handling call
0709 12:58:46.817520 (+ 13464us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.817597 (+    77us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.012488 (+194891us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.031355 (+ 18867us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.045445 (+ 14090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.047899  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 165cabe60a114b9ca5fda64711bd3163 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:47.049010  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165cabe60a114b9ca5fda64711bd3163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.043373  1529 rpcz_store.cc:276] 0709 12:58:45.964099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.750961 (+786862us) service_pool.cc:224] Handling call
0709 12:58:46.764406 (+ 13445us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.764510 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:46.963947 (+199437us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.035980 (+ 72033us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.036720 (+   740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.055280  1529 tablet_service.cc:1511] Processing CreateTablet for tablet ea97e615db7549b797908560563dd608 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:47.029464  1738 raft_consensus.cc:359] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.058060  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 1532fbff9860493fa0fbdf5eb1b21242 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:47.060423  1738 raft_consensus.cc:385] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.060825  1738 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.061101  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1532fbff9860493fa0fbdf5eb1b21242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.066012  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea97e615db7549b797908560563dd608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.065946  1738 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.070602  1738 ts_tablet_manager.cc:1434] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.083s	user 0.011s	sys 0.000s
I20260709 12:58:47.071439  1738 tablet_bootstrap.cc:492] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.071802  1736 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.075527  1692 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.033326  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0b1eaf4f774ec3b24c196f0234dff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.077175  1535 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 54) took 1012 ms. Trace:
I20260709 12:58:47.077474  1535 rpcz_store.cc:276] 0709 12:58:46.064850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.012277 (+947427us) service_pool.cc:224] Handling call
0709 12:58:47.017099 (+  4822us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:47.017182 (+    83us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.030614 (+ 13432us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.076741 (+ 46127us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.077131 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.080340  1734 tablet_bootstrap.cc:492] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.080782  1734 ts_tablet_manager.cc:1403] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.005s
I20260709 12:58:47.082037  1531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 52) took 1017 ms. Trace:
I20260709 12:58:47.082403  1531 rpcz_store.cc:276] 0709 12:58:46.064189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.003789 (+939600us) service_pool.cc:224] Handling call
0709 12:58:47.033969 (+ 30180us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:47.034057 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.042537 (+  8480us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.081607 (+ 39070us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.081989 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.085014  1526 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 48) took 1031 ms. Trace:
I20260709 12:58:47.085348  1526 rpcz_store.cc:276] 0709 12:58:46.053873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.840692 (+786819us) service_pool.cc:224] Handling call
0709 12:58:46.842277 (+  1585us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.842443 (+   166us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.039348 (+196905us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.084602 (+ 45254us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.084962 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.087672  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd03248480b4bfd8a76471850708909 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:47.088575  1736 ts_tablet_manager.cc:1434] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.002s
I20260709 12:58:47.091923  1745 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.092195  1734 raft_consensus.cc:359] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.092386  1745 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.092941  1734 raft_consensus.cc:385] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.093284  1734 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.093814  1738 tablet_bootstrap.cc:654] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.094410  1745 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:47.095983  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.098475  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd03248480b4bfd8a76471850708909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.098939  1532 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 46) took 1045 ms. Trace:
W20260709 12:58:47.099546  1660 leader_election.cc:343] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.099848  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.099565  1736 tablet_bootstrap.cc:492] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.100394  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0b1eaf4f774ec3b24c196f0234dff9 (DEFAULT_TABLE table=test-workload [id=283a38c2957e452fa4a15a6485bdf23d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 12:58:47.101166  1658 leader_election.cc:343] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.101410  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0b1eaf4f774ec3b24c196f0234dff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.101586  1658 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:47.102843  1745 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.099272  1532 rpcz_store.cc:276] 0709 12:58:46.053310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.812148 (+758838us) service_pool.cc:224] Handling call
0709 12:58:46.832195 (+ 20047us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.832272 (+    77us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.044206 (+211934us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.090883 (+ 46677us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.098885 (+  8002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.107645  1734 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.108145  1736 tablet_bootstrap.cc:654] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.111457  1530 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 42) took 1143 ms. Trace:
I20260709 12:58:47.112684  1534 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 49) took 1058 ms. Trace:
I20260709 12:58:47.116925  1676 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52940 (request call id 47) took 1065 ms. Trace:
I20260709 12:58:47.117801  1530 rpcz_store.cc:276] 0709 12:58:45.967615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.772668 (+805053us) service_pool.cc:224] Handling call
0709 12:58:46.774316 (+  1648us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.774405 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:46.999970 (+225565us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.091617 (+ 91647us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.111405 (+ 19788us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":425}
I20260709 12:58:47.124120  1734 ts_tablet_manager.cc:1434] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 12:58:47.087777  1679 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52940 (request call id 49) took 1028 ms. Trace:
I20260709 12:58:47.138067  1684 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52940 (request call id 51) took 1066 ms. Trace:
I20260709 12:58:47.139432  1679 rpcz_store.cc:276] 0709 12:58:46.070844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.882085 (+811241us) service_pool.cc:224] Handling call
0709 12:58:46.913889 (+ 31804us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.913991 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.041332 (+127341us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.087359 (+ 46027us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.087726 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.139488  1684 rpcz_store.cc:276] 0709 12:58:46.071452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.896090 (+824638us) service_pool.cc:224] Handling call
0709 12:58:46.934828 (+ 38738us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.935000 (+   172us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:46.993167 (+ 58167us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.137598 (+144431us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.138014 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.141616  1734 tablet_bootstrap.cc:492] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.147662  1533 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 53) took 1083 ms. Trace:
I20260709 12:58:47.148082  1533 rpcz_store.cc:276] 0709 12:58:46.064537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.993327 (+928790us) service_pool.cc:224] Handling call
0709 12:58:47.060638 (+ 67311us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:47.060735 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.117221 (+ 56486us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.147212 (+ 29991us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.147598 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:47.150305  1491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:47.126623  1534 rpcz_store.cc:276] 0709 12:58:46.062993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.982372 (+919379us) service_pool.cc:224] Handling call
0709 12:58:46.984055 (+  1683us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.984156 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.066392 (+ 82236us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.112248 (+ 45856us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.112634 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.142479  1442 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:47.153796  1680 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52940 (request call id 53) took 1057 ms. Trace:
I20260709 12:58:47.154328  1680 rpcz_store.cc:276] 0709 12:58:46.096526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.928931 (+832405us) service_pool.cc:224] Handling call
0709 12:58:46.994802 (+ 65871us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.994919 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.124689 (+129770us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.153246 (+ 28557us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.153727 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.132310  1676 rpcz_store.cc:276] 0709 12:58:46.051416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.881474 (+830058us) service_pool.cc:224] Handling call
0709 12:58:46.942292 (+ 60818us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:46.942383 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:46.986678 (+ 44295us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.116517 (+129839us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.116874 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.157927  1528 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38012 (request call id 50) took 1094 ms. Trace:
I20260709 12:58:47.158314  1528 rpcz_store.cc:276] 0709 12:58:46.063427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.993542 (+930115us) service_pool.cc:224] Handling call
0709 12:58:47.002864 (+  9322us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:58:47.010802 (+  7938us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:58:47.088838 (+ 78036us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:47.150780 (+ 61942us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:47.157871 (+  7091us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.163004  1738 tablet_bootstrap.cc:492] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.163455  1738 ts_tablet_manager.cc:1403] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.019s
I20260709 12:58:47.163503  1734 tablet_bootstrap.cc:654] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.169890  1738 raft_consensus.cc:359] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.170579  1738 raft_consensus.cc:385] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.170887  1738 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.171599  1738 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.172502  1736 tablet_bootstrap.cc:492] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.173306  1734 tablet_bootstrap.cc:492] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.174321  1736 ts_tablet_manager.cc:1403] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.003s
I20260709 12:58:47.174325  1734 ts_tablet_manager.cc:1403] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.006s
I20260709 12:58:47.177206  1736 raft_consensus.cc:359] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.177476  1734 raft_consensus.cc:359] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.178026  1736 raft_consensus.cc:385] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.178223  1734 raft_consensus.cc:385] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.178577  1734 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.178624  1736 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.179463  1734 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.180370  1736 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.180931  1738 ts_tablet_manager.cc:1434] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:58:47.183689  1736 ts_tablet_manager.cc:1434] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:47.184139  1734 ts_tablet_manager.cc:1434] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:47.184556  1736 tablet_bootstrap.cc:492] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.184993  1734 tablet_bootstrap.cc:492] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.185626  1738 tablet_bootstrap.cc:492] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.192384  1738 tablet_bootstrap.cc:654] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.192755  1736 tablet_bootstrap.cc:654] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.196887  1738 tablet_bootstrap.cc:492] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.196904  1734 tablet_bootstrap.cc:654] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.197501  1738 ts_tablet_manager.cc:1403] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.006s
I20260709 12:58:47.200770  1738 raft_consensus.cc:359] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.201443  1738 raft_consensus.cc:385] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.201716  1738 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.202919  1734 tablet_bootstrap.cc:492] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.202781  1738 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.203372  1734 ts_tablet_manager.cc:1403] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.007s
I20260709 12:58:47.205042  1738 ts_tablet_manager.cc:1434] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:58:47.205967  1738 tablet_bootstrap.cc:492] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.207408  1734 raft_consensus.cc:359] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.208250  1734 raft_consensus.cc:385] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.208600  1734 raft_consensus.cc:740] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.209403  1734 consensus_queue.cc:260] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.211444  1734 ts_tablet_manager.cc:1434] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:58:47.212352  1734 tablet_bootstrap.cc:492] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.212900  1738 tablet_bootstrap.cc:654] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.217906  1734 tablet_bootstrap.cc:654] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.226506  1738 tablet_bootstrap.cc:492] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.226608  1734 tablet_bootstrap.cc:492] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.226907  1738 ts_tablet_manager.cc:1403] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:58:47.227169  1734 ts_tablet_manager.cc:1403] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.010s
I20260709 12:58:47.229529  1738 raft_consensus.cc:359] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.229790  1736 tablet_bootstrap.cc:492] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.230007  1738 raft_consensus.cc:385] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.230213  1736 ts_tablet_manager.cc:1403] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.002s
I20260709 12:58:47.230325  1738 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.230038  1734 raft_consensus.cc:359] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.230988  1738 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.231262  1734 raft_consensus.cc:385] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.231637  1734 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.232354  1734 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.232890  1738 ts_tablet_manager.cc:1434] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:47.234624  1734 ts_tablet_manager.cc:1434] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:58:47.236191  1734 tablet_bootstrap.cc:492] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.237330  1738 tablet_bootstrap.cc:492] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.242341  1758 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.242458  1734 tablet_bootstrap.cc:654] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.242832  1758 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.244760  1758 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.245826  1738 tablet_bootstrap.cc:654] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.246061  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.246583  1620 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.233166  1736 raft_consensus.cc:359] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.247452  1736 raft_consensus.cc:385] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.247840  1736 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.248211  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.248715  1736 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.251149  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:58:47.252647  1509 leader_election.cc:343] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.255231  1736 ts_tablet_manager.cc:1434] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 12:58:47.256351  1736 tablet_bootstrap.cc:492] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.258591  1737 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.259004  1737 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.262665  1744 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.263183  1744 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.263597  1744 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.267046  1758 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.267652  1758 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.272858  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.273320  1776 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.273744  1776 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:47.274288  1584 leader_election.cc:343] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.276209  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.276988  1738 tablet_bootstrap.cc:492] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.277448  1738 ts_tablet_manager.cc:1403] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.007s
I20260709 12:58:47.277385  1744 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:47.277591  1584 leader_election.cc:343] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.278066  1737 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.278251  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:47.278967  1737 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.279960  1738 raft_consensus.cc:359] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.280652  1738 raft_consensus.cc:385] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.280970  1734 tablet_bootstrap.cc:492] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.281154  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.281431  1734 ts_tablet_manager.cc:1403] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.014s
I20260709 12:58:47.276877  1736 tablet_bootstrap.cc:654] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.281733  1692 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.280906  1738 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.282771  1776 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.283207  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.283370  1738 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.284209  1776 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.284103  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.284528  1758 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.284708  1692 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.284929  1734 raft_consensus.cc:359] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.285530  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.285653  1776 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.285673  1734 raft_consensus.cc:385] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.286091  1776 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.286242  1734 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.286229  1509 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.286934  1620 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.287577  1734 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.287993  1758 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.288326  1758 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.288477  1738 ts_tablet_manager.cc:1434] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:58:47.289259  1738 tablet_bootstrap.cc:492] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.289793  1734 ts_tablet_manager.cc:1434] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:47.290904  1734 tablet_bootstrap.cc:492] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.296016  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:47.297791  1511 leader_election.cc:343] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.298738  1736 tablet_bootstrap.cc:492] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.298918  1734 tablet_bootstrap.cc:654] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.299207  1736 ts_tablet_manager.cc:1403] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.009s
I20260709 12:58:47.300745  1776 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.288632  1758 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.294595  1738 tablet_bootstrap.cc:654] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.302548  1736 raft_consensus.cc:359] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.307058  1736 raft_consensus.cc:385] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.307361  1736 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.308005  1736 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.303815  1776 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.310491  1736 ts_tablet_manager.cc:1434] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:58:47.311621  1736 tablet_bootstrap.cc:492] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.312553  1758 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.304148  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.313844  1692 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.314325  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:47.314832  1620 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.316978  1736 tablet_bootstrap.cc:654] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.305961  1734 tablet_bootstrap.cc:492] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.318955  1734 ts_tablet_manager.cc:1403] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.006s
I20260709 12:58:47.321393  1620 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.321583  1734 raft_consensus.cc:359] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.322193  1511 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:47.322571  1734 raft_consensus.cc:385] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.322882  1734 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.323491  1734 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.323964  1780 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.324457  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.324615  1780 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 12:58:47.325704  1509 leader_election.cc:343] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.325387  1780 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.326711  1738 tablet_bootstrap.cc:492] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.326885  1744 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.327080  1738 ts_tablet_manager.cc:1403] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:58:47.327556  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:47.328066  1620 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.332146  1734 ts_tablet_manager.cc:1434] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:58:47.330190  1738 raft_consensus.cc:359] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.332659  1738 raft_consensus.cc:385] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.332952  1738 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.334067  1692 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.333771  1738 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.335060  1734 tablet_bootstrap.cc:492] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.339511  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.340045  1692 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.340710  1738 ts_tablet_manager.cc:1434] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:58:47.346585  1692 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.347797  1738 tablet_bootstrap.cc:492] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.348323  1737 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.348753  1737 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.350533  1737 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.343663  1620 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.344086  1758 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.347621  1509 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.351370  1780 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.351874  1780 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:47.352639  1780 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.353578  1738 tablet_bootstrap.cc:654] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.354031  1441 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.359321  1745 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.360054  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.360203  1745 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.341044  1734 tablet_bootstrap.cc:654] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.362130  1745 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:47.361104  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.362803  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:58:47.363788  1584 leader_election.cc:343] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.364076  1736 tablet_bootstrap.cc:492] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
W20260709 12:58:47.364425  1584 leader_election.cc:343] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.364612  1736 ts_tablet_manager.cc:1403] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.006s
I20260709 12:58:47.364853  1584 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:47.362828  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.365816  1737 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.342743  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:58:47.366910  1658 leader_election.cc:343] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.366973  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.367858  1736 raft_consensus.cc:359] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:47.368779  1660 leader_election.cc:343] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.370566  1736 raft_consensus.cc:385] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.369211  1758 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.371260  1736 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
W20260709 12:58:47.368947  1511 leader_election.cc:343] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.371382  1758 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:47.372330  1736 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.372890  1758 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.370600  1660 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:47.375358  1745 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.375418  1441 catalog_manager.cc:5697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.375599  1736 ts_tablet_manager.cc:1434] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:58:47.377887  1736 tablet_bootstrap.cc:492] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.381803  1738 tablet_bootstrap.cc:492] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.382587  1738 ts_tablet_manager.cc:1403] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.016s
I20260709 12:58:47.385366  1738 raft_consensus.cc:359] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.386734  1738 raft_consensus.cc:385] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.386935  1736 tablet_bootstrap.cc:654] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.386979  1738 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.389362  1738 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.390394  1734 tablet_bootstrap.cc:492] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.390853  1734 ts_tablet_manager.cc:1403] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.006s
I20260709 12:58:47.392071  1738 ts_tablet_manager.cc:1434] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:58:47.392841  1738 tablet_bootstrap.cc:492] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.393122  1734 raft_consensus.cc:359] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.393693  1734 raft_consensus.cc:385] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.393923  1734 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.394503  1734 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.396301  1734 ts_tablet_manager.cc:1434] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:47.397042  1734 tablet_bootstrap.cc:492] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.396852  1441 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.398761  1738 tablet_bootstrap.cc:654] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.402869  1734 tablet_bootstrap.cc:654] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.403743  1736 tablet_bootstrap.cc:492] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.404183  1736 ts_tablet_manager.cc:1403] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.006s
I20260709 12:58:47.407483  1736 raft_consensus.cc:359] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.408336  1736 raft_consensus.cc:385] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.408715  1736 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.409669  1736 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.412196  1736 ts_tablet_manager.cc:1434] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:47.413049  1736 tablet_bootstrap.cc:492] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.413816  1734 tablet_bootstrap.cc:492] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.414204  1734 ts_tablet_manager.cc:1403] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.010s
I20260709 12:58:47.416843  1734 raft_consensus.cc:359] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.417451  1734 raft_consensus.cc:385] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.417691  1734 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.417784  1758 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.418171  1758 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.418457  1734 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.420082  1758 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.421396  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.421819  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.422708  1692 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
W20260709 12:58:47.423051  1511 leader_election.cc:343] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.423825  1509 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:47.424678  1736 tablet_bootstrap.cc:654] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.425876  1758 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.426322  1758 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.426770  1758 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.431053  1734 ts_tablet_manager.cc:1434] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:58:47.435768  1736 tablet_bootstrap.cc:492] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.436210  1736 ts_tablet_manager.cc:1403] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 12:58:47.438957  1736 raft_consensus.cc:359] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.439507  1734 tablet_bootstrap.cc:492] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.439608  1736 raft_consensus.cc:385] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.439981  1736 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.440717  1736 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.440989  1758 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.442517  1736 ts_tablet_manager.cc:1434] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:47.444665  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:47.444981  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.445449  1692 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:47.445886  1511 leader_election.cc:343] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.447839  1734 tablet_bootstrap.cc:654] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.450975  1736 tablet_bootstrap.cc:492] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.453688  1692 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.455597  1509 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:47.456640  1780 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.457183  1780 raft_consensus.cc:697] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:47.458133  1780 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.462193  1736 tablet_bootstrap.cc:654] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.454281  1758 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.474637  1758 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:47.476631  1738 tablet_bootstrap.cc:492] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.476631  1734 tablet_bootstrap.cc:492] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.476490  1443 catalog_manager.cc:5697] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.477214  1738 ts_tablet_manager.cc:1403] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.085s	user 0.036s	sys 0.042s
I20260709 12:58:47.477258  1734 ts_tablet_manager.cc:1403] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.017s
I20260709 12:58:47.480618  1738 raft_consensus.cc:359] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.480734  1734 raft_consensus.cc:359] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.481264  1738 raft_consensus.cc:385] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.481446  1734 raft_consensus.cc:385] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.481551  1738 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.481871  1734 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.482204  1738 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.482623  1734 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.484119  1738 ts_tablet_manager.cc:1434] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:47.484915  1738 tablet_bootstrap.cc:492] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.490155  1736 tablet_bootstrap.cc:492] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.490384  1738 tablet_bootstrap.cc:654] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.490549  1736 ts_tablet_manager.cc:1403] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.005s
I20260709 12:58:47.492403  1734 ts_tablet_manager.cc:1434] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 12:58:47.493470  1736 raft_consensus.cc:359] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.494119  1736 raft_consensus.cc:385] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.494383  1736 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.494988  1736 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.502666  1734 tablet_bootstrap.cc:492] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.508237  1736 ts_tablet_manager.cc:1434] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:58:47.518627  1736 tablet_bootstrap.cc:492] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.519248  1744 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.519701  1744 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.521733  1744 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.523392  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.524204  1620 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.521751  1734 tablet_bootstrap.cc:654] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.526414  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.527105  1694 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.527230  1737 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.527637  1737 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.529376  1737 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.529263  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.530903  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:47.531987  1584 leader_election.cc:343] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.533187  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:58:47.534603  1584 leader_election.cc:343] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.534904  1736 tablet_bootstrap.cc:654] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.535621  1744 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:47.537786  1738 tablet_bootstrap.cc:492] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.534988  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:47.530094  1758 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.538156  1758 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.538511  1737 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.538489  1758 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.547917  1758 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.547917  1738 ts_tablet_manager.cc:1403] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.063s	user 0.032s	sys 0.012s
I20260709 12:58:47.550397  1736 tablet_bootstrap.cc:492] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.550834  1736 ts_tablet_manager.cc:1403] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.005s
I20260709 12:58:47.551349  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:47.551957  1619 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.551693  1738 raft_consensus.cc:359] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.552415  1738 raft_consensus.cc:385] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.552487  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.552697  1738 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.553041  1692 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.553223  1736 raft_consensus.cc:359] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.553443  1738 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.553898  1736 raft_consensus.cc:385] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.554148  1736 raft_consensus.cc:740] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.556399  1744 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.557750  1744 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.558301  1738 ts_tablet_manager.cc:1434] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:58:47.559130  1738 tablet_bootstrap.cc:492] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.559649  1744 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.560437  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:47.562578  1511 leader_election.cc:343] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.562608  1736 consensus_queue.cc:260] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.563325  1619 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.563462  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.564002  1694 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.564361  1511 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:47.565116  1744 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.565191  1509 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:47.565878  1744 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:47.566232  1780 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.566560  1780 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.566879  1780 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.567081  1744 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.568435  1736 ts_tablet_manager.cc:1434] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:58:47.569252  1736 tablet_bootstrap.cc:492] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.574427  1736 tablet_bootstrap.cc:654] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.574496  1692 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.574994  1758 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.578344  1737 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.578747  1737 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.580526  1737 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.581248  1734 tablet_bootstrap.cc:492] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.581720  1734 ts_tablet_manager.cc:1403] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.025s
I20260709 12:58:47.584473  1734 raft_consensus.cc:359] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.585069  1734 raft_consensus.cc:385] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.585426  1734 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.586047  1734 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.586190  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.587083  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.587252  1545 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:47.587755  1692 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:58:47.588095  1734 ts_tablet_manager.cc:1434] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:58:47.588912  1734 tablet_bootstrap.cc:492] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.594169  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:47.576207  1745 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.594427  1734 tablet_bootstrap.cc:654] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.594343  1780 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.594931  1745 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.596978  1745 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:47.577911  1738 tablet_bootstrap.cc:654] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.597503  1780 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.598308  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.598894  1692 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.598944  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:47.601946  1660 leader_election.cc:343] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.603968  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:47.605822  1658 leader_election.cc:343] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.606422  1658 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:47.607856  1737 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.607914  1745 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.608451  1737 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.610579  1806 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.610626  1737 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.611956  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.612515  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.613350  1694 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:47.615231  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:58:47.616631  1511 leader_election.cc:343] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.617259  1737 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.617197  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:47.617861  1737 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.619968  1737 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.620566  1737 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.623811  1692 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.624873  1509 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:47.626436  1744 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.626749  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.627293  1806 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.628268  1694 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:47.627883  1744 raft_consensus.cc:697] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:47.630199  1744 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.630997  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.630676  1441 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.633450  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.635063  1806 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:47.635325  1584 leader_election.cc:343] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.635440  1806 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.635848  1806 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.642849  1806 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.644682  1806 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.645697  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.646232  1692 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.646961  1736 tablet_bootstrap.cc:492] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.647380  1736 ts_tablet_manager.cc:1403] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.021s
I20260709 12:58:47.649471  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:58:47.650888  1584 leader_election.cc:343] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.651463  1736 raft_consensus.cc:359] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.651918  1736 raft_consensus.cc:385] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.652139  1736 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.652724  1736 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.653069  1443 catalog_manager.cc:5697] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.654345  1736 ts_tablet_manager.cc:1434] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:58:47.655103  1736 tablet_bootstrap.cc:492] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.658964  1736 tablet_bootstrap.cc:654] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.668133  1736 tablet_bootstrap.cc:492] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.669569  1734 tablet_bootstrap.cc:492] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.669971  1734 ts_tablet_manager.cc:1403] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.018s
I20260709 12:58:47.670593  1736 ts_tablet_manager.cc:1403] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:58:47.668135  1738 tablet_bootstrap.cc:492] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.671108  1738 ts_tablet_manager.cc:1403] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.020s
I20260709 12:58:47.670253  1737 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.673040  1734 raft_consensus.cc:359] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.673804  1734 raft_consensus.cc:385] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.674162  1734 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.673914  1736 raft_consensus.cc:359] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.674623  1736 raft_consensus.cc:385] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.674942  1736 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.674958  1734 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.675675  1692 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:47.675639  1736 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.676864  1734 ts_tablet_manager.cc:1434] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:58:47.676839  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:47.677192  1738 raft_consensus.cc:359] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.677780  1738 raft_consensus.cc:385] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.678004  1806 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.678596  1806 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:47.678877  1736 ts_tablet_manager.cc:1434] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:47.678005  1738 raft_consensus.cc:740] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.679425  1806 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.679963  1734 tablet_bootstrap.cc:492] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.679687  1738 consensus_queue.cc:260] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.682727  1736 tablet_bootstrap.cc:492] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.683773  1738 ts_tablet_manager.cc:1434] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:58:47.692067  1736 tablet_bootstrap.cc:654] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.693989  1734 tablet_bootstrap.cc:654] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.700066  1738 tablet_bootstrap.cc:492] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.703378  1806 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.703951  1806 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.705482  1744 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.706633  1738 tablet_bootstrap.cc:654] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.711789  1745 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.712323  1745 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.714025  1738 tablet_bootstrap.cc:492] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.714345  1738 ts_tablet_manager.cc:1403] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:58:47.714426  1745 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:47.706215  1744 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.715231  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.711705  1441 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.716197  1545 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:47.715408  1806 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.717957  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.716698  1744 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.718497  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.718569  1619 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:47.719141  1692 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.719745  1736 tablet_bootstrap.cc:492] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:47.720234  1736 ts_tablet_manager.cc:1403] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.008s
I20260709 12:58:47.720291  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.718552  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.721457  1509 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.720894  1619 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.720230  1660 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.721457  1545 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:47.722997  1738 raft_consensus.cc:359] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.725980  1744 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.726197  1738 raft_consensus.cc:385] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.726488  1738 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.726641  1584 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:47.725390  1734 tablet_bootstrap.cc:492] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.727492  1806 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.724013  1736 raft_consensus.cc:359] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.727864  1734 ts_tablet_manager.cc:1403] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.006s
I20260709 12:58:47.727934  1806 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.731328  1736 raft_consensus.cc:385] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.731683  1806 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.731863  1736 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.732666  1736 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.723585  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.728014  1744 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.734388  1744 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.734163  1734 raft_consensus.cc:359] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.734906  1734 raft_consensus.cc:385] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.735229  1734 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.727240  1738 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.737095  1734 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.739665  1734 ts_tablet_manager.cc:1434] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:47.735080  1736 ts_tablet_manager.cc:1434] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 12:58:47.741783  1780 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:47.724448  1745 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.743054  1692 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:47.743844  1736 tablet_bootstrap.cc:492] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:47.744221  1745 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.746134  1745 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.746572  1806 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.748751  1806 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.751771  1734 tablet_bootstrap.cc:492] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.753875  1744 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.755585  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.758610  1734 tablet_bootstrap.cc:654] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.761296  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:47.762543  1545 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:47.766517  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:47.766798  1780 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.767395  1619 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:47.767597  1780 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.770078  1780 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.772183  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.773051  1693 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.774789  1509 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.775959  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.777050  1780 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.777784  1780 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:47.778272  1511 leader_election.cc:343] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.778329  1780 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.786793  1758 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:47.794026  1816 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.794661  1816 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.798105  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:47.799894  1658 leader_election.cc:343] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.808907  1758 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:47.817237  1806 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.817870  1806 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.820540  1806 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.821285  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:47.823346  1584 leader_election.cc:343] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.824185  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.828689  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.816947  1745 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.831624  1509 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:47.832001  1694 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:58:47.833954  1822 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.834870  1758 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.834941  1822 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.835438  1758 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.837239  1744 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.838202  1744 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.838884  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.840698  1822 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.841969  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.843809  1738 ts_tablet_manager.cc:1434] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.129s	user 0.043s	sys 0.054s
I20260709 12:58:47.862236  1694 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.845346  1758 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.863039  1738 tablet_bootstrap.cc:492] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.847414  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.863579  1619 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:47.850510  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.846433  1816 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:47.864434  1509 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.802903  1780 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.855311  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:47.855927  1806 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.866034  1744 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.866245  1660 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:47.866622  1744 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.862336  1691 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.845852  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:47.867820  1545 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:47.864534  1620 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.866052  1806 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.871088  1806 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.871678  1745 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:47.872360  1745 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.872761  1745 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.873147  1745 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.873301  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.867113  1744 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.874891  1758 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.874845  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:47.875454  1758 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.875767  1620 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:47.875911  1758 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.876976  1660 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:47.862258  1822 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.878624  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.878870  1822 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.879209  1691 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.882198  1822 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.882488  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.883301  1694 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:47.884640  1738 tablet_bootstrap.cc:654] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.884888  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.885864  1822 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.886402  1822 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.886831  1822 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.886878  1816 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:58:47.851828  1584 leader_election.cc:343] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.887910  1584 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:47.888592  1806 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.856171  1736 tablet_bootstrap.cc:654] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.924950  1780 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.925916  1780 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:47.927361  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 75578.6us
I20260709 12:58:47.928282  1584 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:47.928159  1745 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.928663  1691 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.930637  1509 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:47.931412  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:47.931955  1738 tablet_bootstrap.cc:492] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:47.932531  1806 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:58:47.932966  1658 leader_election.cc:343] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.933635  1738 ts_tablet_manager.cc:1403] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.010s
I20260709 12:58:47.936748  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.939172  1738 raft_consensus.cc:359] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.938678  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.940387  1806 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.939967  1734 tablet_bootstrap.cc:492] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:47.941329  1734 ts_tablet_manager.cc:1403] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.190s	user 0.091s	sys 0.082s
I20260709 12:58:47.941635  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:47.942163  1620 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.943722  1734 raft_consensus.cc:359] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.943815  1822 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.944414  1734 raft_consensus.cc:385] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.944666  1734 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.945228  1734 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.946599  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:47.940852  1806 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.947228  1691 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.947396  1734 ts_tablet_manager.cc:1434] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:47.948203  1734 tablet_bootstrap.cc:492] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:47.948823  1806 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.951395  1620 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:47.952356  1660 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:47.953784  1734 tablet_bootstrap.cc:654] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.953711  1816 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.954344  1816 raft_consensus.cc:697] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:47.955452  1816 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.957486  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:47.958244  1545 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:47.940745  1745 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:47.939952  1738 raft_consensus.cc:385] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.960716  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:47.960893  1738 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.961879  1738 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:47.967263  1776 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.968355  1738 ts_tablet_manager.cc:1434] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 12:58:47.969682  1738 tablet_bootstrap.cc:492] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:47.964037  1822 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:47.926578  1780 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:47.975019  1584 leader_election.cc:343] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:47.993979  1584 leader_election.cc:343] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.999430  1776 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:48.002183  1822 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:58:48.010445  1758 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:48.021129  1511 leader_election.cc:343] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.022496  1758 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.027956  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:48.028529  1690 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.028165  1441 catalog_manager.cc:5697] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:48.029448  1509 consensus_peers.cc:597] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:48.000771  1744 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.000617  1776 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.036441  1744 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.037830  1736 tablet_bootstrap.cc:492] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:48.038363  1736 ts_tablet_manager.cc:1403] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.295s	user 0.009s	sys 0.005s
I20260709 12:58:48.038743  1690 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:47.994506  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.010847  1824 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 12:58:48.045279  1734 tablet_bootstrap.cc:492] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:48.045063  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:48.042515  1780 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.046867  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.047864  1693 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:48.048533  1806 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:48.040414  1691 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:48.047140  1780 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:48.051318  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:58:48.051954  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 58031.3us
I20260709 12:58:48.052619  1584 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.054782  1824 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:48.055258  1824 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:48.057221  1806 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.057832  1734 ts_tablet_manager.cc:1403] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.042s
I20260709 12:58:48.058357  1736 raft_consensus.cc:359] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.059069  1736 raft_consensus.cc:385] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.059351  1736 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.059948  1736 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.062163  1736 ts_tablet_manager.cc:1434] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 12:58:48.062054  1734 raft_consensus.cc:359] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.062850  1734 raft_consensus.cc:385] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.063014  1736 tablet_bootstrap.cc:492] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:48.063112  1734 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.063751  1734 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.065560  1734 ts_tablet_manager.cc:1434] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.002s
I20260709 12:58:48.066711  1734 tablet_bootstrap.cc:492] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:48.058243  1780 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:48.068619  1780 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.069682  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:48.074529  1690 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.056180  1824 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.084057  1806 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:48.090190  1690 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:48.104733  1816 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.109561  1816 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.111238  1509 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:48.112185  1776 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:48.112799  1776 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:48.113691  1776 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.114516  1734 tablet_bootstrap.cc:654] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.123392  1738 tablet_bootstrap.cc:654] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.124179  1441 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:48.127952  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:48.138310  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:48.139724  1658 leader_election.cc:343] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.145110  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:48.145649  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:48.145942  1618 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:48.146454  1620 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:48.148645  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:48.149971  1745 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:48.150417  1745 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.150851  1745 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.137807  1816 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:58:48.156467  1491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:48.161257  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:48.173759  1780 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.190413  1736 tablet_bootstrap.cc:654] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.190236  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:48.191004  1619 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.191406  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:48.192800  1620 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.193863  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:48.194556  1617 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.197150  1780 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:48.199554  1511 leader_election.cc:343] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.201186  1780 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.201611  1780 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.202492  1545 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.204165  1780 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.207988  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:58:48.209575  1509 leader_election.cc:343] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:48.220538  1511 consensus_peers.cc:597] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:48.227561  1734 tablet_bootstrap.cc:492] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:48.227937  1734 ts_tablet_manager.cc:1403] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.161s	user 0.037s	sys 0.018s
I20260709 12:58:48.230010  1734 raft_consensus.cc:359] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.230659  1734 raft_consensus.cc:385] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.231585  1734 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.232228  1734 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.234131  1734 ts_tablet_manager.cc:1434] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:58:48.234400  1511 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.234472  1776 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.235011  1734 tablet_bootstrap.cc:492] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:48.236479  1744 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.243441  1734 tablet_bootstrap.cc:654] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.243983  1738 tablet_bootstrap.cc:492] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:48.244395  1738 ts_tablet_manager.cc:1403] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.275s	user 0.010s	sys 0.007s
I20260709 12:58:48.247319  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:48.247954  1615 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:48.248885  1737 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.251336  1441 catalog_manager.cc:5697] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:48.253927  1441 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:48.255759  1441 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:48.258646  1745 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.260195  1806 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.260710  1745 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:48.260624  1806 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.262519  1736 tablet_bootstrap.cc:492] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:48.262966  1736 ts_tablet_manager.cc:1403] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.200s	user 0.010s	sys 0.017s
I20260709 12:58:48.263068  1825 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:48.264982  1806 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.265388  1736 raft_consensus.cc:359] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.265971  1736 raft_consensus.cc:385] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.266227  1736 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.266822  1736 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.268649  1736 ts_tablet_manager.cc:1434] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:48.269461  1736 tablet_bootstrap.cc:492] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:48.269461  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:48.270107  1620 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.271976  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:58:48.273547  1658 leader_election.cc:343] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.275616  1736 tablet_bootstrap.cc:654] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.285086  1738 raft_consensus.cc:359] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.286216  1738 raft_consensus.cc:385] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.287153  1738 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.288480  1738 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.293293  1738 ts_tablet_manager.cc:1434] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:58:48.296774  1738 tablet_bootstrap.cc:492] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:48.302070  1736 tablet_bootstrap.cc:492] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:48.302774  1736 ts_tablet_manager.cc:1403] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 12:58:48.300693  1734 tablet_bootstrap.cc:492] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:48.303854  1734 ts_tablet_manager.cc:1403] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.008s
I20260709 12:58:48.308599  1736 raft_consensus.cc:359] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.309268  1736 raft_consensus.cc:385] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.309432  1738 tablet_bootstrap.cc:654] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:48.309902  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 63332.3us
I20260709 12:58:48.312377  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:48.312739  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.314424  1823 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:48.314790  1823 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.315112  1823 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.314967  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.315768  1734 raft_consensus.cc:359] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.316461  1734 raft_consensus.cc:385] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.316713  1734 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.317409  1734 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.318818  1825 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.319084  1736 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.320303  1737 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.319832  1736 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.325096  1736 ts_tablet_manager.cc:1434] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:58:48.326471  1736 tablet_bootstrap.cc:492] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:48.328573  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.329116  1734 ts_tablet_manager.cc:1434] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:58:48.331365  1734 tablet_bootstrap.cc:492] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:48.338516  1738 tablet_bootstrap.cc:492] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:48.339191  1738 ts_tablet_manager.cc:1403] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.011s
I20260709 12:58:48.349261  1617 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:48.349956  1619 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:48.349359  1618 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:48.352348  1776 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.353019  1776 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.350346  1823 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.355016  1776 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.356617  1823 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.356765  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.359153  1842 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.360988  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:48.362118  1618 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:58:48.362018  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:48.362917  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:48.363085  1738 raft_consensus.cc:359] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.363765  1738 raft_consensus.cc:385] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.364027  1738 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.363448  1619 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.364709  1738 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.366365  1738 ts_tablet_manager.cc:1434] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.000s
I20260709 12:58:48.367224  1738 tablet_bootstrap.cc:492] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
W20260709 12:58:48.367316  1509 leader_election.cc:343] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.376392  1745 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.377913  1734 tablet_bootstrap.cc:654] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.382354  1736 tablet_bootstrap.cc:654] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.382452  1511 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.391229  1823 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.404433  1736 tablet_bootstrap.cc:492] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:48.405037  1736 ts_tablet_manager.cc:1403] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.004s
I20260709 12:58:48.406765  1738 tablet_bootstrap.cc:654] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.409622  1776 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.410137  1776 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.423573  1776 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.423648  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:48.424345  1614 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:48.425416  1511 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:48.425616  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.421339  1736 raft_consensus.cc:359] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.426162  1825 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:48.426350  1736 raft_consensus.cc:385] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.426599  1825 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.426812  1736 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.427003  1825 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.426208  1690 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:48.427484  1736 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.429049  1620 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:48.429978  1823 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:48.430806  1619 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:48.436201  1736 ts_tablet_manager.cc:1434] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.006s
I20260709 12:58:48.437019  1736 tablet_bootstrap.cc:492] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:48.436947  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:48.442561  1820 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:48.440536  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.443048  1820 raft_consensus.cc:697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:48.443357  1823 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:48.443903  1823 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:48.443863  1820 consensus_queue.cc:237] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.444799  1823 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.447093  1744 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.448175  1745 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.466959  1734 tablet_bootstrap.cc:492] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:48.467561  1734 ts_tablet_manager.cc:1403] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.136s	user 0.011s	sys 0.007s
I20260709 12:58:48.469270  1738 tablet_bootstrap.cc:492] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:48.469831  1738 ts_tablet_manager.cc:1403] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.001s
I20260709 12:58:48.470412  1734 raft_consensus.cc:359] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.471328  1734 raft_consensus.cc:385] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.471659  1734 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.472478  1734 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.474907  1734 ts_tablet_manager.cc:1434] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:48.476218  1734 tablet_bootstrap.cc:492] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:48.477218  1744 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.478919  1738 raft_consensus.cc:359] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.479801  1738 raft_consensus.cc:385] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.480026  1738 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.480669  1738 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.488147  1738 ts_tablet_manager.cc:1434] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:58:48.488760  1442 catalog_manager.cc:5697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.494218  1738 tablet_bootstrap.cc:492] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:48.503239  1736 tablet_bootstrap.cc:654] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.507678  1734 tablet_bootstrap.cc:654] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.505750  1842 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.519876  1842 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.524930  1806 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.527230  1806 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.529167  1806 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.529253  1693 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.529805  1825 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.531481  1825 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.532812  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:48.533905  1618 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.535554  1806 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.534804  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.536026  1806 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.536924  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:48.537443  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:48.544078  1806 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:58:48.542949  1584 leader_election.cc:343] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.548418  1842 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:58:48.549026  1584 leader_election.cc:343] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.549355  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.538337  1692 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.549913  1842 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:48.555807  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:48.556104  1823 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.555032  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:48.560650  1620 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:48.561784  1584 leader_election.cc:343] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.558706  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.564153  1690 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:48.564265  1831 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:48.565310  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:48.569043  1758 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.574848  1842 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:48.575436  1734 tablet_bootstrap.cc:492] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:48.578032  1734 ts_tablet_manager.cc:1403] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.010s
I20260709 12:58:48.579787  1736 tablet_bootstrap.cc:492] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:48.582021  1736 ts_tablet_manager.cc:1403] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.145s	user 0.016s	sys 0.003s
I20260709 12:58:48.582710  1842 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.585582  1842 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.587814  1441 catalog_manager.cc:5697] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:48.589378  1734 raft_consensus.cc:359] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.604727  1734 raft_consensus.cc:385] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.604939  1734 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.604324  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.607666  1734 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.610507  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.611819  1734 ts_tablet_manager.cc:1434] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:58:48.619379  1734 tablet_bootstrap.cc:492] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:48.619972  1736 raft_consensus.cc:359] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.623183  1736 raft_consensus.cc:385] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.623468  1736 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.624493  1738 tablet_bootstrap.cc:654] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.635731  1736 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.637598  1734 tablet_bootstrap.cc:654] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.637511  1737 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:48.648511  1831 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.649111  1736 ts_tablet_manager.cc:1434] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.004s
I20260709 12:58:48.649992  1736 tablet_bootstrap.cc:492] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:48.650457  1825 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.655229  1831 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.657083  1736 tablet_bootstrap.cc:654] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.672097  1738 tablet_bootstrap.cc:492] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:48.673745  1738 ts_tablet_manager.cc:1403] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.185s	user 0.013s	sys 0.004s
I20260709 12:58:48.676754  1738 raft_consensus.cc:359] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.677440  1738 raft_consensus.cc:385] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.678911  1738 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.679555  1738 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.686190  1738 ts_tablet_manager.cc:1434] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 12:58:48.687167  1738 tablet_bootstrap.cc:492] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:48.693665  1738 tablet_bootstrap.cc:654] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.709544  1738 tablet_bootstrap.cc:492] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:48.709964  1738 ts_tablet_manager.cc:1403] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.001s
I20260709 12:58:48.712172  1738 raft_consensus.cc:359] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.712800  1738 raft_consensus.cc:385] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.713048  1738 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.713657  1738 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.715570  1738 ts_tablet_manager.cc:1434] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:58:48.716496  1738 tablet_bootstrap.cc:492] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:48.724778  1618 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:48.724778  1692 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:48.726016  1511 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:48.727455  1825 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:48.728379  1825 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:48.729225  1825 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.730079  1823 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.730464  1823 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.732925  1823 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.733575  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:48.734037  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.734817  1618 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:58:48.735782  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.736527  1823 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.738267  1441 catalog_manager.cc:5697] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:48.746924  1738 tablet_bootstrap.cc:654] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.748359  1734 tablet_bootstrap.cc:492] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:48.748787  1734 ts_tablet_manager.cc:1403] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.130s	user 0.009s	sys 0.015s
I20260709 12:58:48.750576  1736 tablet_bootstrap.cc:492] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:48.750984  1736 ts_tablet_manager.cc:1403] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.013s
I20260709 12:58:48.751137  1734 raft_consensus.cc:359] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.751784  1734 raft_consensus.cc:385] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.752025  1734 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.753291  1736 raft_consensus.cc:359] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.753929  1736 raft_consensus.cc:385] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.754174  1736 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.754782  1736 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.755893  1734 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.757076  1738 tablet_bootstrap.cc:492] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:48.757501  1738 ts_tablet_manager.cc:1403] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 12:58:48.757788  1734 ts_tablet_manager.cc:1434] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:48.760515  1738 raft_consensus.cc:359] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.761168  1738 raft_consensus.cc:385] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.761415  1738 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.762009  1738 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.762909  1736 ts_tablet_manager.cc:1434] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:58:48.763744  1736 tablet_bootstrap.cc:492] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:48.764165  1738 ts_tablet_manager.cc:1434] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:48.765753  1734 tablet_bootstrap.cc:492] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:48.767616  1738 tablet_bootstrap.cc:492] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:48.769161  1736 tablet_bootstrap.cc:654] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.773682  1738 tablet_bootstrap.cc:654] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.778633  1736 tablet_bootstrap.cc:492] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:48.781368  1736 ts_tablet_manager.cc:1403] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 12:58:48.783301  1736 raft_consensus.cc:359] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.783932  1736 raft_consensus.cc:385] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.784168  1736 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.784685  1736 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.785859  1734 tablet_bootstrap.cc:654] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.786794  1736 ts_tablet_manager.cc:1434] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:58:48.787588  1736 tablet_bootstrap.cc:492] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:48.791277  1736 tablet_bootstrap.cc:654] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.797487  1736 tablet_bootstrap.cc:492] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:48.797937  1736 ts_tablet_manager.cc:1403] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:58:48.799944  1825 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.800416  1825 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.800913  1734 tablet_bootstrap.cc:492] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:48.801332  1734 ts_tablet_manager.cc:1403] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.006s
I20260709 12:58:48.801370  1736 raft_consensus.cc:359] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.802176  1736 raft_consensus.cc:385] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.802361  1825 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.802510  1736 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.803277  1736 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.805117  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.803756  1734 raft_consensus.cc:359] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.805830  1734 raft_consensus.cc:385] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.803820  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:48.806248  1734 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.806860  1820 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.806802  1738 tablet_bootstrap.cc:492] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:48.806924  1734 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:48.807494  1511 leader_election.cc:343] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.807808  1738 ts_tablet_manager.cc:1403] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.023s
I20260709 12:58:48.809000  1734 ts_tablet_manager.cc:1434] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:48.806143  1736 ts_tablet_manager.cc:1434] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:58:48.807513  1820 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.809993  1736 tablet_bootstrap.cc:492] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:48.810174  1738 raft_consensus.cc:359] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.810766  1738 raft_consensus.cc:385] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.805789  1692 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:48.811084  1738 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.811292  1820 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:48.811679  1738 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.813181  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:48.813640  1738 ts_tablet_manager.cc:1434] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:48.813735  1545 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:48.814491  1738 tablet_bootstrap.cc:492] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:48.815184  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:48.815546  1736 tablet_bootstrap.cc:654] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.816159  1745 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:48.816490  1745 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.816776  1745 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.818476  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:48.819067  1620 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:48.822593  1509 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:48.822546  1738 tablet_bootstrap.cc:654] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.824177  1825 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:48.824523  1825 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.824854  1825 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.827137  1734 tablet_bootstrap.cc:492] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:48.830549  1842 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.833828  1842 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.834627  1823 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:48.838143  1734 tablet_bootstrap.cc:654] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.843168  1738 tablet_bootstrap.cc:492] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:48.842978  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:48.838304  1820 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.843685  1738 ts_tablet_manager.cc:1403] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 12:58:48.846458  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:48.846789  1738 raft_consensus.cc:359] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.850123  1738 raft_consensus.cc:385] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.850914  1738 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.851457  1737 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.851922  1737 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.852226  1738 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.854018  1737 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.856113  1738 ts_tablet_manager.cc:1434] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:58:48.857436  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.858637  1738 tablet_bootstrap.cc:492] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:48.843731  1692 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:48.856166  1584 leader_election.cc:343] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:48.861606  1584 leader_election.cc:343] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.866550  1738 tablet_bootstrap.cc:654] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.877087  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:48.880661  1584 leader_election.cc:343] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.881186  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:48.882091  1842 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:48.890269  1734 tablet_bootstrap.cc:492] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:48.890748  1734 ts_tablet_manager.cc:1403] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.014s
I20260709 12:58:48.893690  1734 raft_consensus.cc:359] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.894366  1734 raft_consensus.cc:385] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.894697  1734 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.895336  1734 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.896299  1820 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.897038  1736 tablet_bootstrap.cc:492] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:48.897500  1736 ts_tablet_manager.cc:1403] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.088s	user 0.027s	sys 0.035s
I20260709 12:58:48.898514  1734 ts_tablet_manager.cc:1434] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:48.900367  1734 tablet_bootstrap.cc:492] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:48.900204  1736 raft_consensus.cc:359] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.903463  1736 raft_consensus.cc:385] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.903748  1736 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.904383  1736 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.905376  1738 tablet_bootstrap.cc:492] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:48.905853  1738 ts_tablet_manager.cc:1403] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.048s	user 0.004s	sys 0.015s
I20260709 12:58:48.906415  1736 ts_tablet_manager.cc:1434] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:58:48.908033  1736 tablet_bootstrap.cc:492] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:48.908867  1738 raft_consensus.cc:359] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.911054  1831 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.915351  1738 raft_consensus.cc:385] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.917358  1738 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.918004  1738 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.915197  1736 tablet_bootstrap.cc:654] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.919682  1734 tablet_bootstrap.cc:654] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.929690  1825 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.931591  1825 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.932272  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:48.932603  1692 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:48.932854  1618 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.935547  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:48.936401  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:48.936592  1842 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:48.936957  1692 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.937041  1842 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:48.937868  1842 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.939340  1694 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.940302  1737 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.940722  1737 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.946456  1737 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:48.942359  1745 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.951792  1887 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.965689  1738 ts_tablet_manager.cc:1434] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.060s	user 0.012s	sys 0.018s
I20260709 12:58:48.966630  1738 tablet_bootstrap.cc:492] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:48.973778  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:48.974335  1545 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.975174  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:48.975749  1544 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:48.952237  1887 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:48.978705  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:48.978986  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:48.979961  1691 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:48.989579  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:48.990273  1619 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.991379  1737 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:48.991827  1737 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.992219  1737 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.993374  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:48.987653  1745 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:58:48.996320  1658 leader_election.cc:343] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.997539  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:48.999006  1660 leader_election.cc:343] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:48.999588  1887 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.000509  1660 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:49.003046  1887 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:49.004956  1442 catalog_manager.cc:5697] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:49.006770  1734 tablet_bootstrap.cc:492] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:49.007182  1734 ts_tablet_manager.cc:1403] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.107s	user 0.024s	sys 0.020s
I20260709 12:58:49.008459  1738 tablet_bootstrap.cc:654] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.010751  1734 raft_consensus.cc:359] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.011379  1734 raft_consensus.cc:385] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.011620  1734 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.012447  1734 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.014357  1806 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.014755  1734 ts_tablet_manager.cc:1434] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:58:49.014833  1806 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.015594  1734 tablet_bootstrap.cc:492] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:49.017710  1806 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.023620  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:49.026818  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.028196  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:49.030884  1618 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:49.043179  1842 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:49.031452  1692 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:49.032001  1545 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:58:49.045030  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:49.045288  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.046074  1887 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:49.046491  1887 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:49.046960  1758 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:49.047394  1758 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:49.047254  1887 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.048166  1758 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.046593  1736 tablet_bootstrap.cc:492] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:49.051234  1736 ts_tablet_manager.cc:1403] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.005s
I20260709 12:58:49.063086  1734 tablet_bootstrap.cc:654] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.054510  1736 raft_consensus.cc:359] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.067698  1738 tablet_bootstrap.cc:492] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:49.067688  1736 raft_consensus.cc:385] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.068254  1738 ts_tablet_manager.cc:1403] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.102s	user 0.029s	sys 0.030s
I20260709 12:58:49.068198  1736 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.070672  1736 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.072360  1736 ts_tablet_manager.cc:1434] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:58:49.073405  1736 tablet_bootstrap.cc:492] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:49.076581  1734 tablet_bootstrap.cc:492] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:49.077015  1734 ts_tablet_manager.cc:1403] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.002s
I20260709 12:58:49.078059  1738 raft_consensus.cc:359] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.078634  1738 raft_consensus.cc:385] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.078909  1738 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.079120  1736 tablet_bootstrap.cc:654] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.079463  1738 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.080667  1734 raft_consensus.cc:359] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.081338  1734 raft_consensus.cc:385] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.081456  1738 ts_tablet_manager.cc:1434] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:58:49.081606  1734 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.082326  1738 tablet_bootstrap.cc:492] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:49.082425  1734 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.083436  1442 catalog_manager.cc:5697] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 2, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:49.086032  1758 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.086483  1758 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.088723  1738 tablet_bootstrap.cc:654] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.090775  1736 tablet_bootstrap.cc:492] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:49.091187  1736 ts_tablet_manager.cc:1403] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.018s	user 0.002s	sys 0.015s
I20260709 12:58:49.091459  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.092237  1692 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:49.093262  1734 ts_tablet_manager.cc:1434] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 12:58:49.093611  1736 raft_consensus.cc:359] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.094089  1734 tablet_bootstrap.cc:492] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:49.094221  1736 raft_consensus.cc:385] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.094480  1736 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.094713  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.095271  1618 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:49.095296  1736 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.097285  1736 ts_tablet_manager.cc:1434] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:49.099273  1758 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.100507  1738 tablet_bootstrap.cc:492] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:49.100543  1736 tablet_bootstrap.cc:492] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:49.100898  1734 tablet_bootstrap.cc:654] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.101058  1738 ts_tablet_manager.cc:1403] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:58:49.095304  1509 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.104357  1758 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.104723  1758 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.105046  1758 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.107264  1736 tablet_bootstrap.cc:654] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.113054  1738 raft_consensus.cc:359] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.113646  1738 raft_consensus.cc:385] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.113879  1738 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.114486  1738 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.116441  1738 ts_tablet_manager.cc:1434] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:49.116930  1736 tablet_bootstrap.cc:492] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:49.117244  1738 tablet_bootstrap.cc:492] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:49.117323  1736 ts_tablet_manager.cc:1403] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:58:49.120301  1736 raft_consensus.cc:359] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.120903  1736 raft_consensus.cc:385] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.121201  1736 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.121033  1440 catalog_manager.cc:5697] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:49.121919  1736 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.124079  1738 tablet_bootstrap.cc:654] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.124105  1736 ts_tablet_manager.cc:1434] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:49.125098  1736 tablet_bootstrap.cc:492] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:49.131172  1736 tablet_bootstrap.cc:654] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.132159  1737 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.133057  1825 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:49.134126  1737 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.134838  1758 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.138118  1758 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.140127  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:49.140617  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:49.141184  1692 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.141603  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:49.142130  1545 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.140741  1618 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.142741  1736 tablet_bootstrap.cc:492] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:49.143287  1736 ts_tablet_manager.cc:1403] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
I20260709 12:58:49.144541  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:49.145221  1693 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.153959  1780 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:49.160039  1736 raft_consensus.cc:359] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.160651  1736 raft_consensus.cc:385] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.160908  1736 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.161502  1736 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.164453  1736 ts_tablet_manager.cc:1434] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:58:49.165328  1736 tablet_bootstrap.cc:492] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:49.167268  1738 tablet_bootstrap.cc:492] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:49.167671  1738 ts_tablet_manager.cc:1403] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.007s
I20260709 12:58:49.170020  1738 raft_consensus.cc:359] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.171229  1734 tablet_bootstrap.cc:492] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:49.171491  1736 tablet_bootstrap.cc:654] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.171648  1734 ts_tablet_manager.cc:1403] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.009s
I20260709 12:58:49.174311  1734 raft_consensus.cc:359] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.175834  1734 raft_consensus.cc:385] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.176226  1734 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.177062  1734 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.170591  1738 raft_consensus.cc:385] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.178059  1738 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.179733  1734 ts_tablet_manager.cc:1434] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:49.179517  1738 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.186210  1738 ts_tablet_manager.cc:1434] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:58:49.187037  1738 tablet_bootstrap.cc:492] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:49.190955  1823 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:49.192679  1738 tablet_bootstrap.cc:654] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.203372  1734 tablet_bootstrap.cc:492] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:49.207363  1736 tablet_bootstrap.cc:492] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:49.207769  1736 ts_tablet_manager.cc:1403] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.021s
I20260709 12:58:49.215008  1734 tablet_bootstrap.cc:654] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.215406  1736 raft_consensus.cc:359] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.216058  1736 raft_consensus.cc:385] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.216220  1736 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
W20260709 12:58:49.219514  1491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:49.219333  1736 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.220413  1737 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.220857  1737 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.222090  1736 ts_tablet_manager.cc:1434] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:58:49.222663  1737 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.223338  1736 tablet_bootstrap.cc:492] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:49.224591  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.225832  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:49.226256  1584 leader_election.cc:343] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:49.226854  1584 leader_election.cc:343] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.227177  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:49.229646  1737 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:49.230949  1619 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:58:49.231792  1545 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:49.232681  1692 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:49.232774  1693 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:49.234018  1736 tablet_bootstrap.cc:654] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.235325  1887 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.235800  1887 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.237798  1738 tablet_bootstrap.cc:492] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:49.237746  1887 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.238283  1738 ts_tablet_manager.cc:1403] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.013s
I20260709 12:58:49.240104  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.240830  1823 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.240728  1738 raft_consensus.cc:359] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.241706  1738 raft_consensus.cc:385] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.241333  1823 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.241878  1738 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.242388  1738 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.243691  1823 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.244270  1738 ts_tablet_manager.cc:1434] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:49.244539  1734 tablet_bootstrap.cc:492] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:49.244922  1734 ts_tablet_manager.cc:1403] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.064s	user 0.006s	sys 0.004s
I20260709 12:58:49.245110  1738 tablet_bootstrap.cc:492] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:49.246459  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.247150  1737 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:49.246995  1734 raft_consensus.cc:359] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.247539  1736 tablet_bootstrap.cc:492] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:49.247663  1734 raft_consensus.cc:385] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.248229  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:49.248585  1734 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.248683  1736 ts_tablet_manager.cc:1403] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.010s
I20260709 12:58:49.248826  1545 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:49.249285  1734 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.250886  1734 ts_tablet_manager.cc:1434] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:49.250694  1658 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.251510  1887 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:49.251638  1660 leader_election.cc:343] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.251859  1887 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.252209  1887 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.252825  1734 tablet_bootstrap.cc:492] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:49.256570  1509 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.258008  1831 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:49.258431  1831 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:49.252188  1736 raft_consensus.cc:359] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.259219  1831 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.259756  1734 tablet_bootstrap.cc:654] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.260056  1738 tablet_bootstrap.cc:654] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.259990  1736 raft_consensus.cc:385] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.260501  1736 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.261150  1736 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.261667  1825 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.262113  1825 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.263664  1736 ts_tablet_manager.cc:1434] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:58:49.264397  1825 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.264621  1736 tablet_bootstrap.cc:492] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:49.268700  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.269345  1617 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:49.270624  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.271106  1736 tablet_bootstrap.cc:654] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.271270  1693 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:49.272320  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.273902  1738 tablet_bootstrap.cc:492] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:49.274463  1738 ts_tablet_manager.cc:1403] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.006s
I20260709 12:58:49.275382  1511 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:49.247628  1737 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:49.277765  1738 raft_consensus.cc:359] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.278712  1738 raft_consensus.cc:385] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.279066  1738 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.279798  1780 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.280486  1780 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.279819  1738 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.280894  1780 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.277213  1737 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.283073  1738 ts_tablet_manager.cc:1434] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:58:49.284973  1738 tablet_bootstrap.cc:492] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
W20260709 12:58:49.283103  1511 leader_election.cc:343] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.292207  1738 tablet_bootstrap.cc:654] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.293249  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.294035  1693 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:49.295642  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:49.297741  1823 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.298110  1823 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.302203  1823 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.304000  1738 tablet_bootstrap.cc:492] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:49.304539  1738 ts_tablet_manager.cc:1403] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:58:49.307816  1738 raft_consensus.cc:359] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.311185  1806 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.311735  1806 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.314078  1806 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.318629  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.322278  1825 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.322753  1825 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:49.323644  1584 leader_election.cc:343] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.326896  1758 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.326570  1825 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.327376  1758 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.328751  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.329306  1758 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.329344  1619 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:49.330559  1887 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.310523  1738 raft_consensus.cc:385] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.332468  1738 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.332594  1887 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.332784  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.333210  1738 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.335278  1738 ts_tablet_manager.cc:1434] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:58:49.335852  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:49.336352  1545 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.336361  1738 tablet_bootstrap.cc:492] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:49.339696  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:49.341584  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.343343  1511 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:49.344276  1758 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.344645  1758 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.344974  1758 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.344991  1618 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:49.344306  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:58:49.354126  1660 leader_election.cc:343] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:49.355149  1584 leader_election.cc:343] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.354434  1825 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.355554  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:49.355739  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.356287  1806 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:49.356619  1693 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:49.355822  1825 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:49.354497  1509 leader_election.cc:343] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.352082  1618 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.364898  1825 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.366330  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:49.367727  1511 leader_election.cc:343] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.362349  1509 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:49.371137  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.371753  1693 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:49.373294  1509 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:49.346705  1738 tablet_bootstrap.cc:654] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.373238  1825 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.380252  1831 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.381145  1831 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.380733  1440 catalog_manager.cc:5697] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:49.381492  1831 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.384274  1736 tablet_bootstrap.cc:492] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:49.383821  1441 catalog_manager.cc:5697] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:49.385440  1736 ts_tablet_manager.cc:1403] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.121s	user 0.035s	sys 0.030s
I20260709 12:58:49.387630  1734 tablet_bootstrap.cc:492] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:49.388042  1734 ts_tablet_manager.cc:1403] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.135s	user 0.061s	sys 0.042s
I20260709 12:58:49.390146  1736 raft_consensus.cc:359] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.391672  1736 raft_consensus.cc:385] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.392254  1736 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.392607  1734 raft_consensus.cc:359] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.393438  1734 raft_consensus.cc:385] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.393748  1734 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.393553  1736 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.394441  1734 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.396037  1736 ts_tablet_manager.cc:1434] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:58:49.396868  1736 tablet_bootstrap.cc:492] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:49.397203  1734 ts_tablet_manager.cc:1434] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:58:49.397895  1734 tablet_bootstrap.cc:492] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:49.402153  1734 tablet_bootstrap.cc:654] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.404019  1738 tablet_bootstrap.cc:492] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:49.404896  1738 ts_tablet_manager.cc:1403] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.006s
I20260709 12:58:49.405697  1736 tablet_bootstrap.cc:654] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.407886  1738 raft_consensus.cc:359] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.408623  1738 raft_consensus.cc:385] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.408942  1738 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.409687  1738 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.425762  1736 tablet_bootstrap.cc:492] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:49.426179  1736 ts_tablet_manager.cc:1403] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.015s
I20260709 12:58:49.428496  1736 raft_consensus.cc:359] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.429113  1736 raft_consensus.cc:385] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.430521  1780 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.432814  1780 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.429352  1736 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.436969  1736 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.433765  1758 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.439785  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:49.440546  1619 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.442081  1736 ts_tablet_manager.cc:1434] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:58:49.442901  1736 tablet_bootstrap.cc:492] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:49.444622  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:49.445338  1694 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.446732  1737 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:49.451133  1758 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.452011  1888 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.453424  1888 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.454035  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:49.454569  1617 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.457405  1888 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.458452  1736 tablet_bootstrap.cc:654] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.458725  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:49.459357  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:49.456401  1745 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.463465  1738 ts_tablet_manager.cc:1434] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 12:58:49.463531  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.464221  1614 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:49.464665  1738 tablet_bootstrap.cc:492] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:49.465117  1734 tablet_bootstrap.cc:492] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:49.465552  1734 ts_tablet_manager.cc:1403] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.031s
I20260709 12:58:49.468683  1780 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:49.468585  1734 raft_consensus.cc:359] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.469383  1734 raft_consensus.cc:385] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.469642  1734 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.471801  1745 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.473769  1745 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.462872  1544 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
W20260709 12:58:49.475513  1509 leader_election.cc:343] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.488600  1660 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.488879  1758 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.489396  1888 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.489292  1758 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.489709  1888 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.490007  1888 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.496640  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:49.498211  1758 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.499552  1738 tablet_bootstrap.cc:654] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.498196  1734 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.501058  1745 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.501536  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.501503  1745 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.502187  1693 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:49.503408  1806 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.503801  1745 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.504055  1806 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.504989  1509 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:58:49.509861  1658 leader_election.cc:343] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.505314  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.510665  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:49.513288  1614 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
W20260709 12:58:49.514797  1658 leader_election.cc:343] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.506492  1806 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.503443  1758 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:58:49.511343  1543 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:49.508315  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.516073  1692 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:49.517370  1745 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:49.523778  1734 ts_tablet_manager.cc:1434] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.058s	user 0.012s	sys 0.016s
I20260709 12:58:49.523886  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:49.524940  1734 tablet_bootstrap.cc:492] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:49.525110  1745 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.525625  1745 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.526042  1745 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.527693  1584 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.528465  1744 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.535037  1744 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.535382  1744 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.533317  1823 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.540268  1823 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.530344  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:49.532657  1545 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:49.533285  1694 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:49.533887  1619 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:49.534493  1617 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:49.542536  1887 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.548149  1887 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.548393  1658 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:49.543869  1806 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.559827  1806 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.560230  1806 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.564693  1887 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.565354  1887 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:49.565841  1887 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:49.601006  1887 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.603820  1737 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.577184  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.604414  1737 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.605221  1618 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:49.607098  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.609472  1737 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.627604  1738 tablet_bootstrap.cc:492] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:49.628687  1738 ts_tablet_manager.cc:1403] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.164s	user 0.022s	sys 0.073s
I20260709 12:58:49.639289  1825 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:49.639823  1888 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.641891  1888 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.642858  1744 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.664939  1736 tablet_bootstrap.cc:492] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:49.665566  1736 ts_tablet_manager.cc:1403] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.223s	user 0.012s	sys 0.046s
I20260709 12:58:49.663393  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:49.668272  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 119999us
I20260709 12:58:49.668368  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:49.669224  1545 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:49.670405  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:49.671231  1541 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:49.648350  1806 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.673794  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:49.674381  1693 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:49.674568  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.674786  1806 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.676724  1584 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:49.677580  1744 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.678179  1744 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:49.679276  1544 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:49.679483  1924 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:49.651417  1511 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:49.679822  1924 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.680152  1924 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.647533  1831 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.652278  1745 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.678596  1744 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:49.684017  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:49.689203  1618 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:49.689424  1545 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.684196  1825 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:49.695312  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.687804  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:49.702219  1738 raft_consensus.cc:359] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.703157  1738 raft_consensus.cc:385] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.703573  1738 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.704502  1738 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.705343  1736 raft_consensus.cc:359] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.705999  1736 raft_consensus.cc:385] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.706256  1736 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.703648  1745 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.711102  1736 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.696768  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:49.713783  1691 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.698474  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:49.716423  1927 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.716887  1927 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.717206  1927 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.720155  1736 ts_tablet_manager.cc:1434] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.054s	user 0.000s	sys 0.008s
I20260709 12:58:49.720875  1734 tablet_bootstrap.cc:654] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.719558  1693 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.722427  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:49.723904  1736 tablet_bootstrap.cc:492] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:49.727906  1616 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:49.728607  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:49.731206  1619 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.735237  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:49.735438  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:49.735965  1613 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.739497  1831 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.743485  1738 ts_tablet_manager.cc:1434] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.001s
I20260709 12:58:49.745553  1738 tablet_bootstrap.cc:492] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:49.715713  1744 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.779791  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:49.780664  1612 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.753188  1823 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.789572  1823 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.745656  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:49.771610  1825 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 12:58:49.794854  1658 leader_election.cc:343] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.806012  1745 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.825949  1440 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:49.829272  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:49.829890  1611 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:49.815984  1745 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.832378  1745 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.838020  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:49.839134  1616 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:49.813800  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:58:49.808923  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 70604.3us
I20260709 12:58:49.847492  1734 tablet_bootstrap.cc:492] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:49.848624  1734 ts_tablet_manager.cc:1403] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.324s	user 0.018s	sys 0.049s
I20260709 12:58:49.850899  1613 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:49.851480  1823 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.842000  1806 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:58:49.828648  1825 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.863730  1511 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:49.864559  1927 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.868669  1806 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:49.873425  1738 tablet_bootstrap.cc:654] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.874230  1776 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:49.875640  1776 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.876015  1776 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:49.867218  1660 leader_election.cc:343] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:49.882071  1511 leader_election.cc:343] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.874401  1932 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.053s
I20260709 12:58:49.885151  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:49.892970  1540 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:49.933665  1927 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.940018  1734 raft_consensus.cc:359] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.941144  1734 raft_consensus.cc:385] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.941424  1734 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.942211  1734 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.955559  1734 ts_tablet_manager.cc:1434] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.007s
I20260709 12:58:49.956852  1734 tablet_bootstrap.cc:492] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:49.952935  1545 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:49.951833  1691 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:49.954890  1745 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.968433  1745 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:49.944178  1927 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:58:49.953069  1693 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:49.975250  1584 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:49.954429  1924 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.976173  1806 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:49.976600  1806 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:49.977134  1736 tablet_bootstrap.cc:654] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.977406  1806 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.954478  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:49.980803  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:49.990608  1543 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.990727  1927 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:49.991222  1927 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:49.977485  1924 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:49.982223  1842 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:49.991955  1927 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:49.982604  1738 tablet_bootstrap.cc:492] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:49.982945  1658 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:49.995983  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:49.996939  1694 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.998871  1929 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:50.000125  1929 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:50.000483  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:50.001039  1545 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.000924  1929 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:49.997062  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 47632.8us
I20260709 12:58:50.008975  1509 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:50.010147  1932 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.016984  1738 ts_tablet_manager.cc:1403] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.272s	user 0.024s	sys 0.014s
I20260709 12:58:50.021868  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:50.022570  1823 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:50.023073  1823 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:50.023871  1823 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.026705  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:50.027244  1620 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.034917  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:50.047211  1612 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:50.047014  1738 raft_consensus.cc:359] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.047683  1738 raft_consensus.cc:385] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.047972  1738 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.048120  1540 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:50.050442  1738 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.052982  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:50.050848  1619 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:50.054414  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:50.054785  1929 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:50.054992  1693 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.055426  1929 raft_consensus.cc:697] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:50.056172  1929 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.049615  1776 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.060974  1693 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:50.061323  1776 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:50.061172  1442 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:50.062238  1543 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:58:50.063478  1584 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:50.068037  1441 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.070935  1738 ts_tablet_manager.cc:1434] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:58:50.071561  1738 tablet_bootstrap.cc:492] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:50.050912  1694 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:58:50.067864  1842 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:50.074302  1842 raft_consensus.cc:697] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:50.066802  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:50.077919  1776 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:50.077699  1842 consensus_queue.cc:237] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.078385  1776 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:50.082340  1736 tablet_bootstrap.cc:492] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:50.082827  1736 ts_tablet_manager.cc:1403] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.361s	user 0.010s	sys 0.008s
I20260709 12:58:50.079231  1776 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.088497  1545 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:50.091624  1658 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:50.093437  1926 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:50.093899  1926 raft_consensus.cc:697] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:50.095041  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:50.095592  1617 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.095400  1926 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.104156  1734 tablet_bootstrap.cc:654] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.100441  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:50.116709  1620 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:50.136890  1736 raft_consensus.cc:359] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.137804  1736 raft_consensus.cc:385] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.111918  1440 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.137948  1927 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.138139  1736 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.139182  1738 tablet_bootstrap.cc:654] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.139736  1745 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:58:50.175551  1927 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.138861  1440 catalog_manager.cc:5697] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.177343  1927 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:50.172971  1617 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:50.178809  1511 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:50.179111  1736 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.179813  1823 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:50.180244  1823 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:50.180684  1736 ts_tablet_manager.cc:1434] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.001s
I20260709 12:58:50.181473  1736 tablet_bootstrap.cc:492] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:50.184866  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:50.181052  1823 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.186695  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 12:58:50.193455  1658 leader_election.cc:343] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.220624  1441 catalog_manager.cc:5697] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 2, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.238411  1738 tablet_bootstrap.cc:492] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:50.238870  1738 ts_tablet_manager.cc:1403] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.167s	user 0.016s	sys 0.006s
I20260709 12:58:50.246312  1776 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.246785  1776 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.248694  1738 raft_consensus.cc:359] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.249323  1738 raft_consensus.cc:385] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.249567  1738 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.248574  1776 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:50.250125  1738 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.251565  1440 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:50.253189  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:50.254588  1509 leader_election.cc:343] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.258239  1932 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.254784  1738 ts_tablet_manager.cc:1434] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:50.256346  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:50.262398  1617 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:58:50.262461  1734 tablet_bootstrap.cc:492] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:50.263053  1734 ts_tablet_manager.cc:1403] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.306s	user 0.016s	sys 0.017s
I20260709 12:58:50.263382  1440 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:50.264909  1440 catalog_manager.cc:5697] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:50.262337  1738 tablet_bootstrap.cc:492] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
W20260709 12:58:50.275599  1660 leader_election.cc:343] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.276062  1926 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.276544  1926 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:50.277946  1509 leader_election.cc:343] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.279467  1736 tablet_bootstrap.cc:654] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.272544  1932 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:50.281394  1926 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:50.287011  1738 tablet_bootstrap.cc:654] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.288321  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:50.289661  1658 leader_election.cc:343] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.293370  1734 raft_consensus.cc:359] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.294052  1734 raft_consensus.cc:385] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.294313  1734 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.295037  1734 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.296607  1736 tablet_bootstrap.cc:492] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:50.296921  1734 ts_tablet_manager.cc:1434] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.000s
I20260709 12:58:50.297070  1736 ts_tablet_manager.cc:1403] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.116s	user 0.016s	sys 0.006s
I20260709 12:58:50.297843  1734 tablet_bootstrap.cc:492] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:50.303130  1736 raft_consensus.cc:359] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.303691  1736 raft_consensus.cc:385] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.303920  1736 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.304407  1736 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.293890  1441 catalog_manager.cc:5697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.307559  1842 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.307966  1842 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.310066  1842 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:50.311877  1441 catalog_manager.cc:5697] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.315683  1736 ts_tablet_manager.cc:1434] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:58:50.316341  1736 tablet_bootstrap.cc:492] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:50.318786  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:50.314538  1441 catalog_manager.cc:5697] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.323002  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:58:50.324187  1584 leader_election.cc:343] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:50.323014  1491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:58:50.327975  1584 leader_election.cc:343] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.328426  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:50.329207  1842 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:50.329278  1660 leader_election.cc:343] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.333264  1932 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.334307  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:50.335072  1926 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.337865  1734 tablet_bootstrap.cc:654] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.337911  1736 tablet_bootstrap.cc:654] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.341146  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:50.341636  1738 tablet_bootstrap.cc:492] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:50.342204  1738 ts_tablet_manager.cc:1403] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.080s	user 0.028s	sys 0.007s
I20260709 12:58:50.346616  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:50.356539  1738 raft_consensus.cc:359] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.357272  1738 raft_consensus.cc:385] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.357535  1738 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.358700  1738 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.361343  1738 ts_tablet_manager.cc:1434] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.005s
I20260709 12:58:50.362452  1738 tablet_bootstrap.cc:492] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:50.367861  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:50.368466  1738 tablet_bootstrap.cc:654] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.369809  1823 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:50.375365  1660 consensus_peers.cc:597] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:50.375954  1660 leader_election.cc:343] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.376339  1660 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:50.377017  1926 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.381628  1734 tablet_bootstrap.cc:492] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:50.382102  1734 ts_tablet_manager.cc:1403] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.009s
I20260709 12:58:50.382460  1736 tablet_bootstrap.cc:492] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:50.382902  1736 ts_tablet_manager.cc:1403] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 12:58:50.386137  1926 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.386559  1736 raft_consensus.cc:359] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.386587  1926 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.387439  1736 raft_consensus.cc:385] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.387768  1736 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.388373  1736 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.388823  1926 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:50.390393  1736 ts_tablet_manager.cc:1434] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:50.390753  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:50.395133  1736 tablet_bootstrap.cc:492] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:50.391366  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:50.396636  1744 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:50.398857  1509 consensus_peers.cc:597] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:50.392022  1823 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.396921  1616 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:50.400180  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:50.393415  1734 raft_consensus.cc:359] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.402797  1734 raft_consensus.cc:385] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.403061  1734 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.403678  1734 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.406491  1734 ts_tablet_manager.cc:1434] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.004s
I20260709 12:58:50.404120  1745 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.408473  1734 tablet_bootstrap.cc:492] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:50.413926  1734 tablet_bootstrap.cc:654] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.416272  1745 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.419298  1738 tablet_bootstrap.cc:492] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
W20260709 12:58:50.422505  1511 consensus_peers.cc:597] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:50.423637  1738 ts_tablet_manager.cc:1403] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.005s
I20260709 12:58:50.427137  1738 raft_consensus.cc:359] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.427745  1738 raft_consensus.cc:385] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.428004  1738 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.428644  1738 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.435850  1738 ts_tablet_manager.cc:1434] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:58:50.436668  1738 tablet_bootstrap.cc:492] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:50.436754  1926 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.443117  1738 tablet_bootstrap.cc:654] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.449131  1736 tablet_bootstrap.cc:654] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.473131  1823 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.474416  1842 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:50.484604  1738 tablet_bootstrap.cc:492] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:50.485240  1738 ts_tablet_manager.cc:1403] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.022s
I20260709 12:58:50.488149  1926 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.488579  1926 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.505419  1776 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.516804  1734 tablet_bootstrap.cc:492] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:50.594192  1953 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.596608  1734 ts_tablet_manager.cc:1403] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.188s	user 0.024s	sys 0.048s
I20260709 12:58:50.596567  1953 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.598835  1776 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.601168  1776 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:50.598358  1888 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:58:50.601577  1545 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:50.555344  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:50.603070  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:50.543875  1738 raft_consensus.cc:359] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.583300  1825 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.603657  1738 raft_consensus.cc:385] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.603956  1738 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
W20260709 12:58:50.604350  1511 leader_election.cc:343] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.603989  1825 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.604866  1953 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:50.604607  1738 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.606801  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:50.555554  1823 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.052s
I20260709 12:58:50.608043  1738 ts_tablet_manager.cc:1434] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.002s
I20260709 12:58:50.606375  1734 raft_consensus.cc:359] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.614651  1734 raft_consensus.cc:385] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.615023  1734 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.512621  1926 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:50.615949  1734 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.616531  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:50.520212  1736 tablet_bootstrap.cc:492] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:50.617606  1736 ts_tablet_manager.cc:1403] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.223s	user 0.022s	sys 0.007s
I20260709 12:58:50.617844  1734 ts_tablet_manager.cc:1434] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 12:58:50.551855  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:50.611677  1511 leader_election.cc:343] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.618021  1953 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:50.619462  1584 leader_election.cc:343] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.614279  1738 tablet_bootstrap.cc:492] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:50.619375  1842 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.620071  1736 raft_consensus.cc:359] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.541661  1691 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:50.620656  1825 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:58:50.624642  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 71040.5us
I20260709 12:58:50.626956  1842 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.630759  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:50.634095  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:50.634641  1688 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:50.620782  1736 raft_consensus.cc:385] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.643131  1736 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.644418  1734 tablet_bootstrap.cc:492] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:50.649600  1975 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:50.651706  1738 tablet_bootstrap.cc:654] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.654104  1736 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.655205  1926 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.660800  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:50.677435  1736 ts_tablet_manager.cc:1434] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:58:50.678329  1921 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:50.682786  1509 leader_election.cc:343] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.683326  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:50.689359  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:50.690084  1734 tablet_bootstrap.cc:654] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.674172  1806 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:50.697033  1738 tablet_bootstrap.cc:492] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:50.697463  1738 ts_tablet_manager.cc:1403] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.003s
I20260709 12:58:50.690543  1806 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.699599  1806 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.694528  1744 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.711160  1976 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:50.694252  1842 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.706282  1926 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.721760  1738 raft_consensus.cc:359] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.722316  1738 raft_consensus.cc:385] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.722536  1738 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.700904  1823 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:58:50.729884  1738 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.735720  1736 tablet_bootstrap.cc:492] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:50.694303  1921 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.751037  1738 ts_tablet_manager.cc:1434] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:58:50.752233  1738 tablet_bootstrap.cc:492] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:50.720960  1745 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:58:50.719959  1842 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.772656  1842 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:50.773108  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:50.773666  1691 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:50.774324  1618 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.766439  1921 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:50.782091  1617 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.787010  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:50.787756  1688 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
W20260709 12:58:50.793165  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 91425.3us
I20260709 12:58:50.784893  1806 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.806353  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:50.807070  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:50.823659  1509 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:50.828645  1921 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:50.841660  1620 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:50.852962  1734 tablet_bootstrap.cc:492] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:50.854065  1734 ts_tablet_manager.cc:1403] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.210s	user 0.013s	sys 0.029s
I20260709 12:58:50.855075  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:50.866786  1888 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.867082  1745 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.868091  1806 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:50.853571  1921 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.870222  1921 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.871038  1691 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:50.882505  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 54312.8us
I20260709 12:58:50.884274  1776 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:50.894333  1738 tablet_bootstrap.cc:654] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.885845  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:50.895452  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:50.897715  1825 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:50.900187  1584 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:50.900226  1932 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:50.906013  1694 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.911525  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:50.914625  1932 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.926703  1736 tablet_bootstrap.cc:654] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:50.937744  1983 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:58:50.924472  1932 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.968391  1694 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:50.995568  1888 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.001138  1734 raft_consensus.cc:359] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.001974  1734 raft_consensus.cc:385] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.002281  1734 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.013262  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:51.015825  1842 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.021518  1734 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:50.996088  1888 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.024245  1888 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:51.021142  1806 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.067508  1734 ts_tablet_manager.cc:1434] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.213s	user 0.006s	sys 0.002s
I20260709 12:58:51.068346  1734 tablet_bootstrap.cc:492] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:51.062965  1806 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:51.051195  1921 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:51.064020  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 124898us
I20260709 12:58:51.086024  1806 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.086839  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:51.087388  1738 tablet_bootstrap.cc:492] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:51.087811  1738 ts_tablet_manager.cc:1403] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.336s	user 0.012s	sys 0.009s
I20260709 12:58:51.088665  1736 tablet_bootstrap.cc:492] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
W20260709 12:58:51.089043  1995 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:58:51.089079  1736 ts_tablet_manager.cc:1403] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.354s	user 0.019s	sys 0.024s
I20260709 12:58:51.098371  1921 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:58:51.100355  1660 leader_election.cc:343] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.101017  1932 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.095543  1738 raft_consensus.cc:359] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.103363  1738 raft_consensus.cc:385] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.103866  1738 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.102495  1545 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:51.106856  1738 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.109149  1736 raft_consensus.cc:359] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.109716  1736 raft_consensus.cc:385] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.109946  1736 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.110464  1736 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.111018  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:51.116530  1736 ts_tablet_manager.cc:1434] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
W20260709 12:58:51.118953  1658 leader_election.cc:343] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.119851  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:51.122874  1975 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.123006  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:51.123574  1690 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.132191  1690 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:51.134649  1736 tablet_bootstrap.cc:492] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:51.134853  1509 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:51.136396  1738 ts_tablet_manager.cc:1434] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:58:51.142976  1734 tablet_bootstrap.cc:654] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.138120  1921 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.146507  1921 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:51.147258  1921 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.158764  1738 tablet_bootstrap.cc:492] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:51.173528  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:51.183180  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:51.189100  1688 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:51.183717  1932 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.200668  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:51.203143  1440 catalog_manager.cc:5697] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:51.207451  1511 leader_election.cc:343] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.228353  1511 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:51.230736  1823 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.235764  1924 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.236228  1924 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.238003  1924 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.240859  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:51.242046  1584 leader_election.cc:343] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.242971  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:51.243409  1688 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:51.244220  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:51.246726  1736 tablet_bootstrap.cc:654] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.246620  1924 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.247227  1924 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.247598  1924 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.248268  1738 tablet_bootstrap.cc:654] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.251235  1736 tablet_bootstrap.cc:492] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:51.251631  1736 ts_tablet_manager.cc:1403] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.000s
I20260709 12:58:51.252501  1738 tablet_bootstrap.cc:492] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:51.252902  1738 ts_tablet_manager.cc:1403] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.002s
I20260709 12:58:51.253438  1736 raft_consensus.cc:359] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.253932  1736 raft_consensus.cc:385] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.253722  1924 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.254168  1736 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.255129  1736 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.255431  1734 tablet_bootstrap.cc:492] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:51.255173  1738 raft_consensus.cc:359] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.255779  1738 raft_consensus.cc:385] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.256101  1738 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.256897  1736 ts_tablet_manager.cc:1434] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:58:51.256724  1738 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.257666  1736 tablet_bootstrap.cc:492] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:51.258558  1738 ts_tablet_manager.cc:1434] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.002s
I20260709 12:58:51.262157  1738 tablet_bootstrap.cc:492] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:51.255833  1734 ts_tablet_manager.cc:1403] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.188s	user 0.010s	sys 0.002s
I20260709 12:58:51.262784  1736 tablet_bootstrap.cc:654] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.264518  1734 raft_consensus.cc:359] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.265211  1734 raft_consensus.cc:385] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.265470  1734 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.266116  1734 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.267025  1736 tablet_bootstrap.cc:492] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:51.268982  1736 ts_tablet_manager.cc:1403] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:58:51.269061  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:51.269070  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:51.269991  1545 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.271042  1736 raft_consensus.cc:359] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.271631  1736 raft_consensus.cc:385] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.271872  1736 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.272414  1734 ts_tablet_manager.cc:1434] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:58:51.272442  1736 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.273401  1734 tablet_bootstrap.cc:492] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:51.274624  1736 ts_tablet_manager.cc:1434] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:51.275456  1736 tablet_bootstrap.cc:492] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:51.267736  1924 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.269569  1688 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.267436  1738 tablet_bootstrap.cc:654] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.282534  1736 tablet_bootstrap.cc:654] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.292140  1545 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:51.296487  1734 tablet_bootstrap.cc:654] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.289758  1688 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:51.298032  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:51.299504  1924 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.299975  1924 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:51.300707  1924 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.305547  1738 tablet_bootstrap.cc:492] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:51.305979  1738 ts_tablet_manager.cc:1403] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 12:58:51.310122  1441 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.311019  1736 tablet_bootstrap.cc:492] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:51.311445  1736 ts_tablet_manager.cc:1403] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.023s
I20260709 12:58:51.312605  1734 tablet_bootstrap.cc:492] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:51.313023  1734 ts_tablet_manager.cc:1403] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.040s	user 0.004s	sys 0.013s
I20260709 12:58:51.313822  1738 raft_consensus.cc:359] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.314651  1738 raft_consensus.cc:385] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.314930  1738 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.315537  1738 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.316521  1734 raft_consensus.cc:359] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.317116  1734 raft_consensus.cc:385] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.317380  1734 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.317550  1738 ts_tablet_manager.cc:1434] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 12:58:51.317754  1736 raft_consensus.cc:359] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.318038  1734 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.319736  1734 ts_tablet_manager.cc:1434] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:51.320616  1734 tablet_bootstrap.cc:492] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:51.318364  1738 tablet_bootstrap.cc:492] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:51.318328  1736 raft_consensus.cc:385] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.323284  1736 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.323890  1736 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.326499  1736 ts_tablet_manager.cc:1434] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:58:51.327322  1736 tablet_bootstrap.cc:492] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:51.327127  1440 catalog_manager.cc:5697] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.334635  1734 tablet_bootstrap.cc:654] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.339283  1736 tablet_bootstrap.cc:654] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.341928  1738 tablet_bootstrap.cc:654] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.350514  1924 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.354741  1924 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.356657  1924 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.357662  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:51.358404  1688 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:58:51.358875  1734 tablet_bootstrap.cc:492] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:51.359301  1734 ts_tablet_manager.cc:1403] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.004s
I20260709 12:58:51.360301  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:51.361927  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:51.363969  1924 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.365641  1736 tablet_bootstrap.cc:492] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:51.366070  1736 ts_tablet_manager.cc:1403] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.001s
I20260709 12:58:51.368602  1736 raft_consensus.cc:359] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.369359  1736 raft_consensus.cc:385] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.369638  1736 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.370206  1924 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.370276  1736 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.372875  1734 raft_consensus.cc:359] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.373473  1734 raft_consensus.cc:385] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.373719  1734 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.376823  1736 ts_tablet_manager.cc:1434] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:58:51.377782  1736 tablet_bootstrap.cc:492] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:51.383632  1736 tablet_bootstrap.cc:654] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.374312  1734 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:51.388377  1491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:51.388564  1738 tablet_bootstrap.cc:492] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:51.388651  1736 tablet_bootstrap.cc:492] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:51.389129  1738 ts_tablet_manager.cc:1403] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.018s
I20260709 12:58:51.389155  1736 ts_tablet_manager.cc:1403] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 12:58:51.391821  1738 raft_consensus.cc:359] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.390934  1734 ts_tablet_manager.cc:1434] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:58:51.392508  1738 raft_consensus.cc:385] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.393365  1734 tablet_bootstrap.cc:492] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:51.393150  1736 raft_consensus.cc:359] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.392874  1738 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.395787  1738 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.398087  1738 ts_tablet_manager.cc:1434] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:58:51.398846  1738 tablet_bootstrap.cc:492] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:51.400229  1734 tablet_bootstrap.cc:654] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.402284  1736 raft_consensus.cc:385] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.402563  1736 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.403254  1736 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.405104  1736 ts_tablet_manager.cc:1434] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:58:51.405851  1736 tablet_bootstrap.cc:492] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:51.410241  1738 tablet_bootstrap.cc:654] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.428920  1736 tablet_bootstrap.cc:654] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.445784  1612 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.455315  1734 tablet_bootstrap.cc:492] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:51.455812  1738 tablet_bootstrap.cc:492] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:51.455860  1734 ts_tablet_manager.cc:1403] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.016s
I20260709 12:58:51.456359  1738 ts_tablet_manager.cc:1403] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.003s
I20260709 12:58:51.457501  1736 tablet_bootstrap.cc:492] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:51.457949  1736 ts_tablet_manager.cc:1403] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.006s
I20260709 12:58:51.459549  1734 raft_consensus.cc:359] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.460206  1734 raft_consensus.cc:385] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.459837  1738 raft_consensus.cc:359] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.460497  1734 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.460638  1738 raft_consensus.cc:385] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.460994  1738 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.460883  1736 raft_consensus.cc:359] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.461401  1734 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.461769  1738 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.461992  1736 raft_consensus.cc:385] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.463214  1736 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.463557  1734 ts_tablet_manager.cc:1434] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:58:51.464510  1734 tablet_bootstrap.cc:492] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:51.464241  1736 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.467168  1736 ts_tablet_manager.cc:1434] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:51.470345  1975 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.467432  1924 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.471107  1738 ts_tablet_manager.cc:1434] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:58:51.470788  1975 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.471329  1924 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.472059  1738 tablet_bootstrap.cc:492] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:51.473306  1975 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:51.473452  1924 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.471330  1734 tablet_bootstrap.cc:654] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.477154  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:51.477854  1688 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:51.479619  1738 tablet_bootstrap.cc:654] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.481938  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:51.484747  1542 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:51.486104  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:51.486492  1658 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:51.487511  1926 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:51.487649  1660 leader_election.cc:343] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.488003  1734 tablet_bootstrap.cc:492] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:51.487888  1926 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.488402  1734 ts_tablet_manager.cc:1403] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 12:58:51.488353  1926 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.489310  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:51.490029  1924 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.490509  1924 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.490958  1924 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.494590  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:51.496775  1736 tablet_bootstrap.cc:492] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:51.499426  1924 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.502409  1734 raft_consensus.cc:359] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:51.502967  1584 leader_election.cc:343] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.503338  1734 raft_consensus.cc:385] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.503718  1734 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.504492  1734 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.507191  1734 ts_tablet_manager.cc:1434] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:58:51.503262  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:51.507774  1688 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.507985  1734 tablet_bootstrap.cc:492] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:51.509294  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:58:51.510773  1584 leader_election.cc:343] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.510706  1926 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.513276  1926 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:51.514272  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:51.515440  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:51.515486  1806 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:51.516136  1542 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.517134  1806 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.517544  1806 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.519253  1806 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:58:51.520238  1660 leader_election.cc:343] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.522006  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:51.522253  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:51.522938  1545 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:51.524726  1736 tablet_bootstrap.cc:654] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.525226  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:58:51.527284  1584 leader_election.cc:343] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.530431  1542 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:51.527745  1806 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.532485  1806 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.532449  1658 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:51.533730  1806 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.537021  1734 tablet_bootstrap.cc:654] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.537894  1975 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.538584  1929 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.538518  1975 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:51.539119  1929 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.539770  1975 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.541060  1932 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.547017  1932 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.549059  1734 tablet_bootstrap.cc:492] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:51.549492  1734 ts_tablet_manager.cc:1403] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.010s
I20260709 12:58:51.543555  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:51.544157  1929 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:51.538317  1738 tablet_bootstrap.cc:492] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:51.545526  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:51.551048  1738 ts_tablet_manager.cc:1403] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.003s
W20260709 12:58:51.551743  1658 leader_election.cc:343] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:51.552876  1660 leader_election.cc:343] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.553273  1660 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:51.553939  1738 raft_consensus.cc:359] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.550418  1688 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:51.554579  1738 raft_consensus.cc:385] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.554481  1929 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.555015  1738 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.555177  1924 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.555861  1921 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.556447  1921 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.556845  1823 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.557433  1823 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.560722  1921 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.561055  1806 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.561430  1932 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.563073  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:51.563645  1687 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:51.555862  1738 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.565120  1736 tablet_bootstrap.cc:492] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:51.565573  1736 ts_tablet_manager.cc:1403] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.021s
I20260709 12:58:51.566048  1823 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.566530  1806 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.566927  1738 ts_tablet_manager.cc:1434] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:58:51.567764  1738 tablet_bootstrap.cc:492] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:51.568270  1736 raft_consensus.cc:359] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.568930  1736 raft_consensus.cc:385] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.569221  1736 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.569643  1509 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:51.569965  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:51.569828  1736 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.571002  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:51.571362  1823 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.576596  1823 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.576633  1687 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:51.577221  1823 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.582474  1738 tablet_bootstrap.cc:654] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.582773  1736 ts_tablet_manager.cc:1434] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
W20260709 12:58:51.574929  1509 leader_election.cc:343] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.583563  1932 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:51.583732  1509 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:51.584280  1823 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.584780  1932 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.585155  1932 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.585505  1932 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.586485  1442 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:51.587210  1992 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.587620  1992 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.589406  1823 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.589768  1992 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.592207  1932 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.595963  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:51.596261  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:51.596503  1694 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.596786  1688 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.603080  1688 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:51.576001  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:51.559870  1734 raft_consensus.cc:359] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.603889  1734 raft_consensus.cc:385] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.604197  1734 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.604192  1509 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:51.604566  1932 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.605067  1993 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.604986  1734 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.605597  1993 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:51.606360  1993 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.608443  1734 ts_tablet_manager.cc:1434] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
I20260709 12:58:51.608601  1736 tablet_bootstrap.cc:492] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:51.609814  1734 tablet_bootstrap.cc:492] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:51.603464  1694 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:51.611317  1509 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:51.612012  1823 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.612455  1823 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:51.618664  1992 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.618911  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:51.618786  1823 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.619174  1992 raft_consensus.cc:697] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:51.634219  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:51.634419  1992 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.639025  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:51.676369  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:51.678813  1734 tablet_bootstrap.cc:654] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.677124  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:58:51.682576  1584 leader_election.cc:343] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.619474  1614 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:51.683468  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:51.684056  1545 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.684933  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:51.679778  1619 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:51.693491  1511 leader_election.cc:343] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.694027  1511 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:51.696909  1613 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.699010  1921 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.720000  1736 tablet_bootstrap.cc:654] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.698539  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:51.701897  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:51.734107  1540 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
W20260709 12:58:51.761665  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 67554.4us
I20260709 12:58:51.750643  1619 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
W20260709 12:58:51.776774  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 59437.6us
I20260709 12:58:51.778595  1738 tablet_bootstrap.cc:492] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:51.779044  1738 ts_tablet_manager.cc:1403] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.211s	user 0.016s	sys 0.034s
I20260709 12:58:51.793737  1545 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:51.808481  1738 raft_consensus.cc:359] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.809340  1738 raft_consensus.cc:385] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.809661  1738 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.789323  2040 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:58:51.804885  2041 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.814126  2041 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.816617  2041 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:51.817368  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:51.804525  1926 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.820817  1926 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.810431  1738 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:51.838594  1738 ts_tablet_manager.cc:1434] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
W20260709 12:58:51.842012  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 67699.7us
I20260709 12:58:51.835525  2000 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.845320  1738 tablet_bootstrap.cc:492] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:51.870658  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:51.871802  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:51.871565  1442 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.853051  1926 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:58:51.881409  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44715us
I20260709 12:58:51.876353  2040 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.846321  2000 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:51.900032  1584 leader_election.cc:343] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.890796  2040 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.898824  1924 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.927505  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:51.910148  2040 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.941015  1734 tablet_bootstrap.cc:492] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:51.941172  1736 tablet_bootstrap.cc:492] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:51.941452  1734 ts_tablet_manager.cc:1403] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.332s	user 0.012s	sys 0.015s
I20260709 12:58:51.941635  1736 ts_tablet_manager.cc:1403] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.333s	user 0.028s	sys 0.032s
W20260709 12:58:51.940053  1660 leader_election.cc:343] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.902531  1613 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:51.929996  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:51.963521  1658 leader_election.cc:343] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.964536  1658 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:51.975351  1440 catalog_manager.cc:5697] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.945875  2043 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.991909  2043 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.001806  2000 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:51.987149  1545 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:51.971524  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:52.010453  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 109549us
I20260709 12:58:51.984526  1929 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.045152  1734 raft_consensus.cc:359] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.045897  1734 raft_consensus.cc:385] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.046164  1734 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.047142  1734 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.051739  1924 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:52.062155  1734 ts_tablet_manager.cc:1434] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.120s	user 0.004s	sys 0.002s
I20260709 12:58:52.063009  1734 tablet_bootstrap.cc:492] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:52.068241  1658 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:52.063093  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:52.045370  2000 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:58:52.059973  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:58:52.076732  1660 leader_election.cc:343] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.072361  2041 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.085351  1738 tablet_bootstrap.cc:654] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:52.087038  1509 leader_election.cc:343] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.087322  1736 raft_consensus.cc:359] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.088210  1736 raft_consensus.cc:385] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.088551  1736 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.171459  2040 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.086440  2041 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.176919  2041 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.082567  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:52.082151  1924 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.089879  2058 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.131s
W20260709 12:58:52.277071  2055 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 12:58:52.279505  1541 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:52.331005  2043 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:52.343297  1736 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.345753  1738 tablet_bootstrap.cc:492] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:52.346148  1738 ts_tablet_manager.cc:1403] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.507s	user 0.010s	sys 0.003s
I20260709 12:58:52.347997  1736 ts_tablet_manager.cc:1434] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.406s	user 0.004s	sys 0.003s
I20260709 12:58:52.354766  2041 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.357362  1806 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:52.357729  2041 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:52.362061  1736 tablet_bootstrap.cc:492] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:52.362831  2040 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:52.366470  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:52.374544  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:52.375108  1736 tablet_bootstrap.cc:654] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.375274  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:52.387852  1738 raft_consensus.cc:359] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.388590  1738 raft_consensus.cc:385] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.388898  1738 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
W20260709 12:58:52.428527  1584 leader_election.cc:343] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.428717  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:52.433403  1542 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:52.435738  1584 consensus_peers.cc:597] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.445449  1442 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:52.447714  1660 consensus_peers.cc:597] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.445293  1440 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.455806  1542 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
W20260709 12:58:52.456622  1511 leader_election.cc:343] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.457262  1511 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:52.461338  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:52.462141  1541 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.489645  2070 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.500921  1926 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.504894  1734 tablet_bootstrap.cc:654] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.505676  1738 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.508004  1992 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.508652  1992 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.511072  1992 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:52.516705  1926 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.517774  1736 tablet_bootstrap.cc:492] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:52.518724  1736 ts_tablet_manager.cc:1403] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.157s	user 0.018s	sys 0.006s
I20260709 12:58:52.529194  1738 ts_tablet_manager.cc:1434] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.183s	user 0.009s	sys 0.000s
I20260709 12:58:52.533821  1926 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:52.538713  1738 tablet_bootstrap.cc:492] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:52.539290  1541 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:52.545403  2075 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:58:52.545995  1806 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:58:52.549852  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 45195us
I20260709 12:58:52.550498  1736 raft_consensus.cc:359] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.551198  1736 raft_consensus.cc:385] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.551725  1736 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.552345  1736 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.553936  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:52.554739  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:52.557636  1543 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.559649  2042 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.559830  1736 ts_tablet_manager.cc:1434] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.003s
I20260709 12:58:52.561348  1736 tablet_bootstrap.cc:492] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
W20260709 12:58:52.562072  1660 leader_election.cc:343] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.564200  2057 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:52.571990  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:52.573051  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:52.575438  1734 tablet_bootstrap.cc:492] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:52.575886  1734 ts_tablet_manager.cc:1403] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.513s	user 0.021s	sys 0.025s
I20260709 12:58:52.576161  1738 tablet_bootstrap.cc:654] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.570889  1658 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:52.579877  1806 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:52.581163  1806 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:52.580286  2070 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:52.584025  1806 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:52.585366  1658 leader_election.cc:343] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.592092  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:52.586264  2075 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:52.604250  1584 leader_election.cc:343] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.612309  2042 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.627439  1734 raft_consensus.cc:359] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.628453  1734 raft_consensus.cc:385] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.628758  1734 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.628913  2075 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:52.638274  1734 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.640693  1734 ts_tablet_manager.cc:1434] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.002s
W20260709 12:58:52.655118  1584 leader_election.cc:343] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.655547  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:52.656508  2054 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.654340  2070 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:58:52.665757  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:52.666502  1612 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:52.663601  1736 tablet_bootstrap.cc:654] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.682626  2056 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.640743  2075 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.683508  2056 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.701916  1734 tablet_bootstrap.cc:492] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
W20260709 12:58:52.702796  1491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:52.706039  1660 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:52.712255  2070 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:52.710559  1926 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.721503  1926 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.721865  1926 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.757990  2056 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:52.758934  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:58:52.760532  1509 leader_election.cc:343] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.769529  1734 tablet_bootstrap.cc:654] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.782248  1738 tablet_bootstrap.cc:492] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:52.782776  1738 ts_tablet_manager.cc:1403] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.244s	user 0.018s	sys 0.004s
I20260709 12:58:52.787146  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:52.789177  2055 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.086s	user 0.002s	sys 0.002s
I20260709 12:58:52.790535  1926 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.794229  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:52.795275  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:58:52.795655  1511 leader_election.cc:343] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.795851  1616 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.796105  1511 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:58:52.796456  1658 leader_election.cc:343] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.804829  2051 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.794085  1926 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:52.822047  1616 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:52.861496  1736 tablet_bootstrap.cc:492] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:52.862054  1736 ts_tablet_manager.cc:1403] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.301s	user 0.023s	sys 0.039s
I20260709 12:58:52.864341  1736 raft_consensus.cc:359] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.864827  1736 raft_consensus.cc:385] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.865042  1736 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.865638  1736 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.867533  1736 ts_tablet_manager.cc:1434] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:58:52.869143  1738 raft_consensus.cc:359] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.870026  1738 raft_consensus.cc:385] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.870311  1738 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.871351  1738 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.872766  1734 tablet_bootstrap.cc:492] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:52.873279  1734 ts_tablet_manager.cc:1403] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.172s	user 0.005s	sys 0.010s
W20260709 12:58:52.875174  2086 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.009s
I20260709 12:58:52.877398  1734 raft_consensus.cc:359] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.878105  1734 raft_consensus.cc:385] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.878407  1734 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.874471  1738 ts_tablet_manager.cc:1434] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.002s
I20260709 12:58:52.879761  1738 tablet_bootstrap.cc:492] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:52.885613  1738 tablet_bootstrap.cc:654] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.893334  1734 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.896275  1734 ts_tablet_manager.cc:1434] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 12:58:52.896325  2059 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:52.897344  1734 tablet_bootstrap.cc:492] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:52.898506  1738 tablet_bootstrap.cc:492] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:52.899494  1738 ts_tablet_manager.cc:1403] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:58:52.901989  1738 raft_consensus.cc:359] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.902640  1738 raft_consensus.cc:385] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.902966  1738 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.903764  1734 tablet_bootstrap.cc:654] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.903635  1738 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.905999  1738 ts_tablet_manager.cc:1434] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:52.905839  1660 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:52.906883  2075 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:52.907483  2075 raft_consensus.cc:697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:52.908562  2075 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.909735  2059 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:52.913460  1738 tablet_bootstrap.cc:492] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:52.916538  1736 tablet_bootstrap.cc:492] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:52.916317  1440 catalog_manager.cc:5697] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.916348  1441 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.930510  1736 tablet_bootstrap.cc:654] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.978020  1734 tablet_bootstrap.cc:492] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:52.981117  1736 tablet_bootstrap.cc:492] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:52.981556  1736 ts_tablet_manager.cc:1403] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.065s	user 0.003s	sys 0.023s
I20260709 12:58:52.981870  1734 ts_tablet_manager.cc:1403] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.009s
I20260709 12:58:52.983085  1693 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.984149  1736 raft_consensus.cc:359] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.984815  1736 raft_consensus.cc:385] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.984524  1734 raft_consensus.cc:359] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.985073  1736 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.985157  1734 raft_consensus.cc:385] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.985481  1734 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.986057  1734 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.991391  1734 ts_tablet_manager.cc:1434] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:52.991439  2075 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.991955  2075 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:52.992395  1734 tablet_bootstrap.cc:492] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:52.993477  1738 tablet_bootstrap.cc:654] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.996140  2075 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:52.998457  1440 catalog_manager.cc:5697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.999210  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:52.999758  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.000348  1543 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:53.001412  2054 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.005990  1736 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.008314  1736 ts_tablet_manager.cc:1434] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:58:53.009368  1736 tablet_bootstrap.cc:492] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:53.013891  1658 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:53.014659  2075 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:53.015025  2075 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.015338  2075 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.018869  1734 tablet_bootstrap.cc:654] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.031260  2075 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.033070  1689 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:58:53.034976  2075 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.037165  2054 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.038861  2054 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:53.039191  2054 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:53.040112  2054 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.042095  2054 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.043272  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:53.043816  1543 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.048254  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:53.037761  1736 tablet_bootstrap.cc:654] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.062497  1616 raft_consensus.cc:2410] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:58:53.069520  2041 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.069988  2041 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.070906  1738 tablet_bootstrap.cc:492] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:53.071478  1738 ts_tablet_manager.cc:1403] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.158s	user 0.020s	sys 0.024s
I20260709 12:58:53.071933  2041 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.074064  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:53.075420  1660 leader_election.cc:343] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.075107  1738 raft_consensus.cc:359] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.075757  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.075980  1738 raft_consensus.cc:385] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.076323  1541 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:53.076380  1543 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:58:53.077731  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:53.078318  2041 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.078646  2041 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.079167  2041 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.082939  1734 tablet_bootstrap.cc:492] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:53.083355  1734 ts_tablet_manager.cc:1403] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.049s
I20260709 12:58:53.078639  1658 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:53.083781  2050 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.085425  2050 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.086064  1734 raft_consensus.cc:359] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.086419  2075 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:53.086719  1734 raft_consensus.cc:385] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.086997  1734 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.087687  2075 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:53.087601  1734 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.088613  2075 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.089643  1734 ts_tablet_manager.cc:1434] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:58:53.076344  1738 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.090302  2050 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.091029  1734 tablet_bootstrap.cc:492] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:53.090762  1738 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.095322  1738 ts_tablet_manager.cc:1434] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:58:53.095989  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.104573  1734 tablet_bootstrap.cc:654] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.109545  1736 tablet_bootstrap.cc:492] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:53.122581  1736 ts_tablet_manager.cc:1403] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.007s
I20260709 12:58:53.123178  1441 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:53.105152  2041 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.125356  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:53.126807  1693 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:53.127912  2041 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.128726  1736 raft_consensus.cc:359] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.121109  1738 tablet_bootstrap.cc:492] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:53.129365  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:53.130759  1734 tablet_bootstrap.cc:492] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:53.131232  1734 ts_tablet_manager.cc:1403] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.013s
I20260709 12:58:53.132218  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:53.129384  1736 raft_consensus.cc:385] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.133242  1736 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.134137  1736 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:53.136550  1660 leader_election.cc:343] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:53.137498  1584 leader_election.cc:343] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.138705  1734 raft_consensus.cc:359] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.139344  1734 raft_consensus.cc:385] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.130005  1541 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.139657  1734 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.140528  1736 ts_tablet_manager.cc:1434] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:58:53.140358  1734 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.142940  1734 ts_tablet_manager.cc:1434] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:58:53.143754  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:53.144430  2050 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.144683  1736 tablet_bootstrap.cc:492] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:53.144768  2050 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.145141  2050 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.143893  1738 tablet_bootstrap.cc:654] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.146327  1734 tablet_bootstrap.cc:492] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:53.152257  1734 tablet_bootstrap.cc:654] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.151942  2050 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.156875  1736 tablet_bootstrap.cc:654] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.165014  1738 tablet_bootstrap.cc:492] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:53.157985  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:53.157342  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:53.170033  1738 ts_tablet_manager.cc:1403] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.005s
I20260709 12:58:53.160550  2051 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.170749  2051 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.170027  1693 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.172848  2051 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.172959  1738 raft_consensus.cc:359] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.173693  1738 raft_consensus.cc:385] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.173751  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:53.174033  1738 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.175141  1736 tablet_bootstrap.cc:492] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:53.174839  1738 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.175508  1736 ts_tablet_manager.cc:1403] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.005s
I20260709 12:58:53.176201  1689 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:53.177402  1738 ts_tablet_manager.cc:1434] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:53.177821  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:53.178534  2051 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.178746  1738 tablet_bootstrap.cc:492] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:53.178882  2051 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.179311  2051 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.181564  1541 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:53.183019  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:53.183893  1736 raft_consensus.cc:359] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.184599  1736 raft_consensus.cc:385] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.184864  1736 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.185237  1738 tablet_bootstrap.cc:654] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.183893  2041 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.185457  1736 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.185860  2041 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:53.169443  1734 tablet_bootstrap.cc:492] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:53.156275  2050 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.186596  2041 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.187216  1734 ts_tablet_manager.cc:1403] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.041s	user 0.001s	sys 0.013s
I20260709 12:58:53.187489  1736 ts_tablet_manager.cc:1434] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:58:53.190026  1693 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
W20260709 12:58:53.189568  1584 leader_election.cc:343] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.193154  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:53.193361  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.194660  2050 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.194967  1736 tablet_bootstrap.cc:492] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:53.195145  2050 raft_consensus.cc:697] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:53.195982  2050 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:53.199229  1511 leader_election.cc:343] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.200987  1734 raft_consensus.cc:359] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.201577  1734 raft_consensus.cc:385] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.201817  1734 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.202718  1734 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.204784  1734 ts_tablet_manager.cc:1434] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:58:53.205672  1734 tablet_bootstrap.cc:492] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:53.218189  1734 tablet_bootstrap.cc:654] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.212746  2051 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.226146  2051 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.226081  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:58:53.227355  1511 leader_election.cc:343] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.228540  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:53.229187  1689 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.230252  1734 tablet_bootstrap.cc:492] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:53.230659  1734 ts_tablet_manager.cc:1403] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.001s
I20260709 12:58:53.235081  1734 raft_consensus.cc:359] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.238327  1734 raft_consensus.cc:385] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.236336  1738 tablet_bootstrap.cc:492] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:53.239149  1738 ts_tablet_manager.cc:1403] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.006s
I20260709 12:58:53.241032  1689 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:53.241214  1738 raft_consensus.cc:359] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.242295  1738 raft_consensus.cc:385] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.242157  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:53.242583  1738 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.243114  2071 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.243566  2071 raft_consensus.cc:697] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:53.243301  1738 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.244352  2071 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.245323  1738 ts_tablet_manager.cc:1434] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:53.238590  1734 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.246973  1734 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.248442  1734 ts_tablet_manager.cc:1434] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:58:53.249377  1734 tablet_bootstrap.cc:492] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:53.248955  1441 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:53.252024  1738 tablet_bootstrap.cc:492] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:53.254355  1442 catalog_manager.cc:5697] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.259420  1734 tablet_bootstrap.cc:654] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.261310  1736 tablet_bootstrap.cc:654] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.264791  1738 tablet_bootstrap.cc:654] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.265547  1926 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.270536  1926 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.270982  1926 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.272785  1926 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.273694  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.274200  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.275141  2056 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:53.275214  1660 leader_election.cc:343] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.275625  2056 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.277619  2056 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:58:53.279449  1658 leader_election.cc:343] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.279345  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:53.280580  1658 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:53.281699  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:58:53.281780  1509 leader_election.cc:343] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.282436  1926 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.282562  1736 tablet_bootstrap.cc:492] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
W20260709 12:58:53.283270  1511 leader_election.cc:343] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.284751  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:53.285403  2056 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.285713  1736 ts_tablet_manager.cc:1403] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.000s
I20260709 12:58:53.288863  1736 raft_consensus.cc:359] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.289660  1736 raft_consensus.cc:385] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.289968  1736 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.284439  1738 tablet_bootstrap.cc:492] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:53.290963  1738 ts_tablet_manager.cc:1403] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.004s
I20260709 12:58:53.293573  1738 raft_consensus.cc:359] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.294492  1738 raft_consensus.cc:385] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.295058  1738 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.295672  1738 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.297497  1736 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.300495  1736 ts_tablet_manager.cc:1434] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:58:53.301646  1736 tablet_bootstrap.cc:492] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:53.303782  1440 catalog_manager.cc:5697] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.306999  1738 ts_tablet_manager.cc:1434] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:58:53.308218  1738 tablet_bootstrap.cc:492] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:53.308862  1926 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.309347  1926 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.312032  1926 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.312381  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.312741  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:53.313992  1660 leader_election.cc:343] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:53.315047  1658 leader_election.cc:343] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.315582  1658 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:53.316401  1926 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.318017  1543 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.319098  2050 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.319690  2050 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.323335  2050 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.324800  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.325219  1734 tablet_bootstrap.cc:492] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:53.325659  1734 ts_tablet_manager.cc:1403] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.077s	user 0.039s	sys 0.016s
I20260709 12:58:53.326731  1736 tablet_bootstrap.cc:654] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.328953  1738 tablet_bootstrap.cc:654] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.328692  1734 raft_consensus.cc:359] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.330524  1734 raft_consensus.cc:385] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.342021  2075 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.347357  1734 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.344401  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:58:53.345554  1660 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:53.348949  1734 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.352794  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:53.353704  2050 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.346822  1738 tablet_bootstrap.cc:492] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:53.356148  1738 ts_tablet_manager.cc:1403] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.048s	user 0.004s	sys 0.011s
I20260709 12:58:53.359390  1734 ts_tablet_manager.cc:1434] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 12:58:53.360433  1734 tablet_bootstrap.cc:492] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:53.362960  1738 raft_consensus.cc:359] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.363593  1738 raft_consensus.cc:385] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.363823  1738 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.364439  1738 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.367995  1736 tablet_bootstrap.cc:492] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:53.368575  1736 ts_tablet_manager.cc:1403] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.004s
I20260709 12:58:53.368507  2075 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.369066  2075 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.371017  1734 tablet_bootstrap.cc:654] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.371145  1738 ts_tablet_manager.cc:1434] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:58:53.372156  1738 tablet_bootstrap.cc:492] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:53.372480  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.374620  2050 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:53.375058  1660 leader_election.cc:343] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.371083  2075 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.375214  2050 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.378538  2050 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.378753  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.379525  1541 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:58:53.379894  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.380360  1545 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:53.381549  1738 tablet_bootstrap.cc:654] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.385196  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:53.386047  2075 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.386359  2075 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.386650  2075 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.378759  1736 raft_consensus.cc:359] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.387086  1734 tablet_bootstrap.cc:492] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:53.387281  1736 raft_consensus.cc:385] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.387491  1734 ts_tablet_manager.cc:1403] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.006s
I20260709 12:58:53.387521  1736 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.390417  1736 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.391716  1738 tablet_bootstrap.cc:492] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:53.392983  1736 ts_tablet_manager.cc:1434] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:58:53.394182  1736 tablet_bootstrap.cc:492] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:53.394631  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:53.398406  2075 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.399585  1734 raft_consensus.cc:359] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.400172  1734 raft_consensus.cc:385] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.400223  2075 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.398789  1738 ts_tablet_manager.cc:1403] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.009s
I20260709 12:58:53.400484  1734 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.401218  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:53.401211  1734 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:53.402568  1660 leader_election.cc:343] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.403082  1734 ts_tablet_manager.cc:1434] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:58:53.404021  1734 tablet_bootstrap.cc:492] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:53.403245  1738 raft_consensus.cc:359] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.404340  1738 raft_consensus.cc:385] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.404611  1738 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.405176  1738 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.407413  1738 ts_tablet_manager.cc:1434] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:53.408308  1738 tablet_bootstrap.cc:492] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:53.408591  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:53.410364  2050 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.413498  1738 tablet_bootstrap.cc:654] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.417829  2050 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.421838  1736 tablet_bootstrap.cc:654] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.410267  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:53.423810  1734 tablet_bootstrap.cc:654] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.424072  1543 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.429917  2041 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.442518  1738 tablet_bootstrap.cc:492] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:53.442931  1738 ts_tablet_manager.cc:1403] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.003s
I20260709 12:58:53.447526  2051 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.448086  2051 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.450336  2051 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.451774  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:53.452361  1689 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:53.453461  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.455127  1509 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:58:53.456460  1511 leader_election.cc:343] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.457283  2051 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.457679  2051 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.458055  2051 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.478839  2050 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.479487  2050 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.481916  2050 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.483713  1612 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.484229  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.485577  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:58:53.485857  1584 leader_election.cc:343] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.486389  1689 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:53.493916  1738 raft_consensus.cc:359] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.502754  1738 raft_consensus.cc:385] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.503331  1738 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.504276  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:53.508366  2050 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.508818  2050 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.509121  2050 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.513300  1738 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.526650  1738 ts_tablet_manager.cc:1434] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.000s
I20260709 12:58:53.516053  1543 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:53.528740  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:53.529647  1926 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.529755  2050 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.530102  1926 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:53.533914  1620 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:58:53.534282  1620 pending_rounds.cc:85] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 0
I20260709 12:58:53.525895  2042 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.536160  2042 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.540475  2042 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.540818  1806 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.541242  1806 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.534577  1620 pending_rounds.cc:107] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:58:53.550328  1806 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.550570  2051 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.559389  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.565054  1738 tablet_bootstrap.cc:492] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:53.551575  1620 raft_consensus.cc:2889] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:53.566824  1734 tablet_bootstrap.cc:492] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:53.576465  1734 ts_tablet_manager.cc:1403] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.173s	user 0.042s	sys 0.052s
I20260709 12:58:53.566146  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:53.548142  1926 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.714491  1736 tablet_bootstrap.cc:492] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
W20260709 12:58:53.679865  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 114066us
I20260709 12:58:53.719312  1736 ts_tablet_manager.cc:1403] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.325s	user 0.031s	sys 0.049s
I20260709 12:58:53.577755  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:53.726572  1660 leader_election.cc:343] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.729216  1806 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.729633  1806 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.708112  1544 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:53.577170  2050 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.577701  2075 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.582758  2059 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.679175  2135 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.567180  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.732633  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:53.738245  1692 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.740149  1734 raft_consensus.cc:359] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.740787  1734 raft_consensus.cc:385] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.741044  1734 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.741576  1734 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.743422  1734 ts_tablet_manager.cc:1434] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:58:53.714514  2051 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.737771  1806 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.735980  2071 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.746776  2071 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.749066  2071 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.749277  2059 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.750871  1692 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:53.751191  2059 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.751587  2135 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.756328  2050 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.752413  1543 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:53.737112  2075 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.758073  2075 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.758535  2075 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.759964  2050 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.761890  2050 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.762393  1693 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:53.765970  2135 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:53.774909  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:53.775635  1692 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.776340  1738 tablet_bootstrap.cc:654] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:53.810051  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 80883.4us
I20260709 12:58:53.813027  2136 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:53.820137  1491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:53.820168  1734 tablet_bootstrap.cc:492] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:53.821310  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:53.830024  2136 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.836869  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:58:53.851337  1509 leader_election.cc:343] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:53.854104  1658 leader_election.cc:343] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.854509  1658 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:53.840705  2136 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.859208  1692 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:53.858485  1736 raft_consensus.cc:359] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.859776  1736 raft_consensus.cc:385] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.860016  1736 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.860550  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:53.864462  1691 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:53.865147  1611 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.857300  1926 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.861465  1736 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.860590  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:53.866236  2041 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.869318  1544 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.877046  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.877645  1616 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:53.879842  1736 ts_tablet_manager.cc:1434] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.160s	user 0.007s	sys 0.000s
I20260709 12:58:53.887197  1736 tablet_bootstrap.cc:492] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:53.895295  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.916076  2136 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:53.933665  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.933713  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:53.934253  1738 tablet_bootstrap.cc:492] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:53.934520  1543 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:53.934754  1738 ts_tablet_manager.cc:1403] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.398s	user 0.029s	sys 0.024s
I20260709 12:58:53.940924  1509 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:53.942358  1440 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:53.944567  1660 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:53.947378  2070 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.951010  2075 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.964350  1738 raft_consensus.cc:359] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.965029  1738 raft_consensus.cc:385] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.965281  1738 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.948220  2051 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:58:53.965801  1738 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:53.968678  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:53.963812  2075 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.971467  1616 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:53.971647  2075 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.972643  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:53.973500  1736 tablet_bootstrap.cc:654] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.978256  2145 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.978611  2145 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.978940  2145 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.983357  1738 ts_tablet_manager.cc:1434] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:58:53.994565  1738 tablet_bootstrap.cc:492] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:53.995743  1544 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:54.002058  1734 tablet_bootstrap.cc:654] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.002941  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:54.003842  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:54.008241  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:53.995543  2070 raft_consensus.cc:697] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:53.997123  2140 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.019456  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:54.014891  1926 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.021049  1806 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.021481  1806 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:54.021178  1926 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.007129  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:54.022188  1806 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:54.025924  1584 leader_election.cc:343] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.023138  1926 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:58:54.035616  1584 leader_election.cc:343] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.033584  2142 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.011801  2070 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.053445  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:54.043044  2142 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.064647  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:54.066493  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:54.071496  2142 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.047278  2140 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.074213  2140 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.119212  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:54.120069  1540 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
W20260709 12:58:54.122792  1660 leader_election.cc:343] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:54.122879  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 76221.6us
I20260709 12:58:54.127764  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:54.130990  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:54.131732  1539 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:54.132512  1734 tablet_bootstrap.cc:492] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:54.132997  1734 ts_tablet_manager.cc:1403] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.313s	user 0.011s	sys 0.031s
W20260709 12:58:54.134632  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 103004us
W20260709 12:58:54.135550  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 91802.9us
I20260709 12:58:54.143062  2142 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.145293  2142 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.149950  2075 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.152688  2050 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.153159  2050 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.154958  2050 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.133947  1926 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:54.146193  1540 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:54.163802  1511 leader_election.cc:343] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:54.166110  1584 leader_election.cc:343] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.166453  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:54.167009  1806 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.167379  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:54.168802  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:54.170661  2050 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.171106  2050 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.171456  2050 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:54.175840  2148 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.151s	user 0.004s	sys 0.000s
I20260709 12:58:54.179293  1734 raft_consensus.cc:359] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.179915  1734 raft_consensus.cc:385] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.180148  1734 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.180626  1734 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.183055  1734 ts_tablet_manager.cc:1434] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 12:58:54.183876  1738 tablet_bootstrap.cc:654] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.165434  1511 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:58:54.185945  1511 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:54.186619  1511 leader_election.cc:343] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.187088  1511 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:54.187465  1584 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:54.191653  1806 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.192235  2070 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.192492  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:54.192996  1539 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:54.191272  1509 leader_election.cc:343] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.194540  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:54.195406  1736 tablet_bootstrap.cc:492] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:54.195837  1736 ts_tablet_manager.cc:1403] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.309s	user 0.013s	sys 0.007s
I20260709 12:58:54.202407  1736 raft_consensus.cc:359] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.202997  1736 raft_consensus.cc:385] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.203238  1736 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.203755  1736 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.205227  1736 ts_tablet_manager.cc:1434] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:58:54.205873  1736 tablet_bootstrap.cc:492] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:54.207129  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:54.207728  1686 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:54.209173  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:54.209861  1612 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:54.210368  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:54.211126  1689 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 1: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:58:54.212723  1734 tablet_bootstrap.cc:492] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:54.216596  2075 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:54.193322  2050 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:54.218127  1584 leader_election.cc:343] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.215939  1440 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.223165  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:54.224645  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:54.225157  1543 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.228818  1619 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.229856  2163 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:54.234799  1658 leader_election.cc:343] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.238826  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:54.238986  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:54.246326  1658 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:54.239537  1611 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:54.248067  2138 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.248418  2138 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.248776  2138 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.249698  2162 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.250083  2162 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.219269  2050 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.253449  1806 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:54.254738  1584 leader_election.cc:343] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.252671  2162 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.252197  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:54.256083  1539 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:54.258612  2142 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:58:54.289078  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:54.289878  1511 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:54.290207  2157 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.290957  1734 tablet_bootstrap.cc:654] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.290704  2157 raft_consensus.cc:697] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 12:58:54.301515  2169 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:58:54.301803  2157 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.305840  2075 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:54.259285  2145 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.322578  1442 catalog_manager.cc:5697] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.327893  1658 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:54.353180  1738 tablet_bootstrap.cc:492] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:54.353780  1738 ts_tablet_manager.cc:1403] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.367s	user 0.016s	sys 0.004s
I20260709 12:58:54.355777  1736 tablet_bootstrap.cc:654] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.342774  1543 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:54.369400  2135 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.371447  2168 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.371584  2145 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:54.373136  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:54.378486  2162 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.382838  2142 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.383304  2162 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.398134  1738 raft_consensus.cc:359] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.399243  1738 raft_consensus.cc:385] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.399569  1738 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.402539  1738 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.383315  2142 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:54.407665  2142 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.406265  2138 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:54.410881  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 64583.2us
I20260709 12:58:54.420866  2138 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:54.421998  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:54.429940  1738 ts_tablet_manager.cc:1434] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.000s
I20260709 12:58:54.411551  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:58:54.431639  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 98600.8us
I20260709 12:58:54.427525  1614 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:54.452263  1584 leader_election.cc:343] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.458725  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:54.459301  1738 tablet_bootstrap.cc:492] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:54.464847  1734 tablet_bootstrap.cc:492] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:54.465598  1734 ts_tablet_manager.cc:1403] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.270s	user 0.014s	sys 0.008s
I20260709 12:58:54.471493  1734 raft_consensus.cc:359] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.472508  1734 raft_consensus.cc:385] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.472920  1734 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.474028  1734 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.452409  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:54.481859  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:54.485237  1545 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.486225  1734 ts_tablet_manager.cc:1434] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
W20260709 12:58:54.486136  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 46249.5us
I20260709 12:58:54.475173  1687 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.479641  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:54.500993  1545 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:54.502909  1540 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:54.512598  1660 leader_election.cc:343] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.514462  1658 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:54.516208  1736 tablet_bootstrap.cc:492] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:54.516631  1736 ts_tablet_manager.cc:1403] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.311s	user 0.010s	sys 0.008s
I20260709 12:58:54.519167  2137 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:58:54.524710  2183 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:58:54.522363  2145 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.527055  2145 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:54.527318  1738 tablet_bootstrap.cc:654] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.527863  2145 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.535324  2135 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.548055  1540 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:54.550920  1658 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:54.551875  1736 raft_consensus.cc:359] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.552739  1736 raft_consensus.cc:385] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.553031  1736 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.553787  1736 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.561683  2138 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.565104  1736 ts_tablet_manager.cc:1434] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 12:58:54.566016  1736 tablet_bootstrap.cc:492] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:54.569736  2138 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:54.573472  2138 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.575829  1687 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:54.579807  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:58:54.581197  2059 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.581645  2059 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:54.582402  2059 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.584968  1734 tablet_bootstrap.cc:492] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:54.590590  1442 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.597908  1614 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:54.607667  1442 catalog_manager.cc:5697] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.623343  1736 tablet_bootstrap.cc:654] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.631253  1738 tablet_bootstrap.cc:492] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:54.630980  2139 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:54.631706  1738 ts_tablet_manager.cc:1403] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.192s	user 0.014s	sys 0.023s
W20260709 12:58:54.634387  1511 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:54.634492  2157 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:54.635282  1738 raft_consensus.cc:359] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.645145  1738 raft_consensus.cc:385] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.645385  1738 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.646853  2138 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.647579  2138 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.654547  2138 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:54.657619  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:54.657478  1738 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.659420  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:54.659976  1738 ts_tablet_manager.cc:1434] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:58:54.660144  1543 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 1: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:58:54.660938  1738 tablet_bootstrap.cc:492] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Bootstrap starting.
I20260709 12:58:54.664037  1658 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:54.690367  1734 tablet_bootstrap.cc:654] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.699873  1442 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.687019  2145 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.709825  2075 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.710337  2075 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.712375  2075 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:54.714157  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:58:54.716006  1658 leader_election.cc:343] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.726456  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:54.729012  1738 tablet_bootstrap.cc:654] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.733227  1736 tablet_bootstrap.cc:492] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:54.733649  1736 ts_tablet_manager.cc:1403] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.168s	user 0.007s	sys 0.013s
W20260709 12:58:54.734485  1660 leader_election.cc:343] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.736719  2145 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.737128  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:58:54.743692  1736 raft_consensus.cc:359] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.744307  1736 raft_consensus.cc:385] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.744274  2138 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.744692  1736 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.745283  1736 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.749017  1736 ts_tablet_manager.cc:1434] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:58:54.749994  1736 tablet_bootstrap.cc:492] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:54.752619  1734 tablet_bootstrap.cc:492] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:54.753042  1734 ts_tablet_manager.cc:1403] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.168s	user 0.013s	sys 0.018s
I20260709 12:58:54.754331  1736 tablet_bootstrap.cc:654] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.757989  1738 tablet_bootstrap.cc:492] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: No bootstrap required, opened a new log
I20260709 12:58:54.758518  1738 ts_tablet_manager.cc:1403] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.003s
I20260709 12:58:54.762925  1734 raft_consensus.cc:359] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.763595  1734 raft_consensus.cc:385] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.763890  1734 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.764462  1734 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.767539  1734 ts_tablet_manager.cc:1434] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:58:54.768349  1734 tablet_bootstrap.cc:492] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:54.763213  1738 raft_consensus.cc:359] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.769410  1738 raft_consensus.cc:385] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.769812  1738 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.770691  1738 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.773801  1734 tablet_bootstrap.cc:654] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.774915  1738 ts_tablet_manager.cc:1434] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:58:54.780795  1734 tablet_bootstrap.cc:492] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:54.781279  1734 ts_tablet_manager.cc:1403] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:58:54.783294  1736 tablet_bootstrap.cc:492] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:54.784548  1736 ts_tablet_manager.cc:1403] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.004s
I20260709 12:58:54.790096  1736 raft_consensus.cc:359] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.793620  1736 raft_consensus.cc:385] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.793913  1736 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.794624  1736 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.795989  1734 raft_consensus.cc:359] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.796631  1734 raft_consensus.cc:385] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.796907  1734 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.797495  1734 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.798513  2139 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:54.799504  1736 ts_tablet_manager.cc:1434] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:58:54.799625  1734 ts_tablet_manager.cc:1434] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:58:54.800472  1736 tablet_bootstrap.cc:492] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:54.800580  1734 tablet_bootstrap.cc:492] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:54.812713  1736 tablet_bootstrap.cc:654] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.813504  1734 tablet_bootstrap.cc:654] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.817950  1442 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:54.824361  1442 catalog_manager.cc:5697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:54.827032  1736 tablet_bootstrap.cc:492] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:54.827510  1736 ts_tablet_manager.cc:1403] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.001s
I20260709 12:58:54.830725  1736 raft_consensus.cc:359] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.831352  1736 raft_consensus.cc:385] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.831604  1736 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.832221  1736 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.834161  1736 ts_tablet_manager.cc:1434] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:54.835047  1736 tablet_bootstrap.cc:492] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: Bootstrap starting.
I20260709 12:58:54.835965  1734 tablet_bootstrap.cc:492] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:54.836390  1734 ts_tablet_manager.cc:1403] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.015s
I20260709 12:58:54.838575  1734 raft_consensus.cc:359] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.839121  1734 raft_consensus.cc:385] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.839334  1734 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.839898  1734 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.840318  1736 tablet_bootstrap.cc:654] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.841830  1734 ts_tablet_manager.cc:1434] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:58:54.843951  1734 tablet_bootstrap.cc:492] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
W20260709 12:58:54.853088  1720 tablet.cc:2406] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:54.855603  2141 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.855881  1734 tablet_bootstrap.cc:654] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.856108  2141 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.858224  2141 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.859624  2157 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.860136  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:54.860740  1689 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:54.860141  2157 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.877565  2157 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.879439  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:54.880050  1612 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 0.
I20260709 12:58:54.882088  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:54.882669  1689 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:54.884478  1509 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:54.885489  2141 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.886274  2141 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.886592  2141 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.887295  1584 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:54.888204  1806 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.888543  1806 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.888828  1806 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.894976  1806 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.895742  2141 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.896618  1806 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.896096  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:54.897358  1540 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:54.898391  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:54.898972  1686 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.900274  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:54.900849  1614 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.907439  2139 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.910028  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:54.910907  1540 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.913868  1686 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:54.914978  2141 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.916409  1614 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:54.918479  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:58:54.919297  2141 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.920747  2141 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:58:54.921547  2141 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.923653  1584 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:54.924458  2139 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.925313  2059 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.925940  2059 raft_consensus.cc:697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:54.926779  2059 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.928294  2075 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.934432  1736 tablet_bootstrap.cc:492] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: No bootstrap required, opened a new log
I20260709 12:58:54.935019  1736 ts_tablet_manager.cc:1403] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.009s
I20260709 12:58:54.938258  1736 raft_consensus.cc:359] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.939018  1736 raft_consensus.cc:385] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.939297  1736 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.939986  1736 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.942230  1736 ts_tablet_manager.cc:1434] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:54.966159  2139 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.966650  2139 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:54.967042  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:54.967821  1686 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.968852  2139 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:54.971880  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:54.972697  1690 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:54.977814  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:54.978833  2142 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.979295  2142 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.979683  2142 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.990197  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:54.990796  1545 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 0.
I20260709 12:58:55.009306  2138 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:55.010370  1491 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:55.012156  2157 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.013233  2142 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.027966  1734 tablet_bootstrap.cc:492] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:55.031108  1734 ts_tablet_manager.cc:1403] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.187s	user 0.039s	sys 0.081s
I20260709 12:58:55.038990  1441 catalog_manager.cc:5697] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.042930  1540 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:55.049618  1734 raft_consensus.cc:359] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.053308  1734 raft_consensus.cc:385] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.054060  1734 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.057739  1734 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.063145  2075 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.063624  2075 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.069887  2075 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:55.072321  1734 ts_tablet_manager.cc:1434] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 12:58:55.072036  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:58:55.072872  1620 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:55.073355  1734 tablet_bootstrap.cc:492] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83: Bootstrap starting.
I20260709 12:58:55.074124  1660 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:55.074870  2075 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:55.079684  2075 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.083978  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:55.095700  1540 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 0.
I20260709 12:58:55.096619  2143 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.097118  2142 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:55.087026  2075 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.111141  1442 catalog_manager.cc:5697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.112999  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:58:55.129674  1685 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.119264  1544 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.120042  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:55.135003  1543 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.141023  2178 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:55.147737  1685 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:55.149447  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:55.150147  2143 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:55.150590  2143 raft_consensus.cc:697] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:58:55.151575  2143 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:58:55.155741  1660 consensus_peers.cc:597] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:55.165632  1543 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:58:55.126813  1734 tablet_bootstrap.cc:654] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.127389  2075 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.183873  2075 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:55.185192  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:58:55.185788  1538 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.121567  1686 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:58:55.199549  1614 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.204022  1616 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.206502  1442 catalog_manager.cc:5697] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.208461  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:58:55.208992  1620 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.214998  1734 tablet_bootstrap.cc:492] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83: No bootstrap required, opened a new log
I20260709 12:58:55.215448  1734 ts_tablet_manager.cc:1403] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.001s
I20260709 12:58:55.217494  1734 raft_consensus.cc:359] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.217953  1538 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:55.219033  1658 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:58:55.219732  2075 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:55.218112  1734 raft_consensus.cc:385] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.220453  2075 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:58:55.220849  1734 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.221531  1734 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.223589  1734 ts_tablet_manager.cc:1434] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:58:55.221609  2075 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.225620  1620 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:58:55.235734  2142 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.236451  2059 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:58:55.237007  2059 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.248394  2059 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:55.259279  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:55.269022  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:55.271932  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:55.272703  2059 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:55.282734  1440 catalog_manager.cc:5697] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.378075  2059 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.378504  2059 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:58:55.380098  2059 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:58:55.380640  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:58:55.380791  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:58:55.381916  1584 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:58:55.382475  2059 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.426270  2142 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.437626  2142 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.485702  2076 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.501099  2076 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.573999  2059 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.583024  2143 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.639163  1616 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.650025  2075 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.665122  1926 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:56.223791   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:56.252601  2231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:56.253026  2234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:56.253389  2232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:56.254738   431 server_base.cc:1061] running on GCE node
I20260709 12:58:56.256019   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:56.256207   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:56.256347   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601936256337 us; error 0 us; skew 500 ppm
I20260709 12:58:56.256973   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:56.260233   431 webserver.cc:533] Webserver started at http://127.0.107.196:36203/ using document root <none> and password file <none>
I20260709 12:58:56.260846   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:56.261164   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:56.261574   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:56.262905   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-3-root/instance:
uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
format_stamp: "Formatted at 2026-07-09 12:58:56 on dist-test-slave-szgt"
I20260709 12:58:56.271970   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.000s	sys 0.008s
I20260709 12:58:56.275995  2239 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:56.276755   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:58:56.277055   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-3-root
uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
format_stamp: "Formatted at 2026-07-09 12:58:56 on dist-test-slave-szgt"
I20260709 12:58:56.277391   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:56.314446   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:56.315944   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:56.317633   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:56.320830   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:56.321133   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:56.321439   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:56.321682   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:56.384701   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:33801
I20260709 12:58:56.384845  2301 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:33801 every 8 connection(s)
I20260709 12:58:56.391381   431 auto_leader_rebalancer-test.cc:384] add a tserver: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:58:56.400772  2302 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40935
I20260709 12:58:56.401255  2302 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:56.401948  2302 heartbeater.cc:507] Master 127.0.107.254:40935 requested a full tablet report, sending...
I20260709 12:58:56.403774  1442 ts_manager.cc:194] Registered new tserver with Master: 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:58:56.405194  1442 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38400
I20260709 12:58:57.136540  1544 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:57.143857  1693 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.145309  2076 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.147336  1614 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.149132  2154 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:57.158792  2310 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.162165  1686 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.173591  1614 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.181799  1442 catalog_manager.cc:5697] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:57.188475  1510 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f45eebdd49441fa87ca7768bae03d64. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.213725  1616 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:57.226778  1686 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.226977  1544 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.229503  2142 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.230255  2143 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:57.238363  1585 consensus_peers.cc:597] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6fc10a7f7a84904a1cc02696513828e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.239401  2320 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.241559  1544 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.241653  1686 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.253604  1540 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:57.256649  1440 catalog_manager.cc:5697] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:57.262785  1510 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b37b7f2c08b145c6b88f543822a1cf5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.263618  1686 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.265048  1614 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.265070  2315 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:57.266564  2076 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.278705  2076 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.280395  1686 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.291882  1614 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.296973  1540 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:57.298131  1440 catalog_manager.cc:5697] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 12:58:57.313344  1510 consensus_peers.cc:597] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 044356f91b2d4fe4a34deeb351b2fbac. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.314393  1685 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.316851  2076 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.320719  1616 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.322158  2076 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.329452  2315 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.330938  1686 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.332003  1616 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.345757  1440 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:58:57.407344  2302 heartbeater.cc:499] Master 127.0.107.254:40935 was elected leader, sending a full tablet report...
I20260709 12:58:57.663419  2334 ts_tablet_manager.cc:933] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:58:57.663981  2333 ts_tablet_manager.cc:933] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:58:57.720722  2333 tablet_copy_client.cc:323] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:58:57.721002  2334 tablet_copy_client.cc:323] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
W20260709 12:58:57.886822  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 241428us
W20260709 12:58:58.048448  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 154971us
W20260709 12:58:58.087972  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 186618us
I20260709 12:58:58.157693  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet f6fc10a7f7a84904a1cc02696513828e from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:58:58.158413  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet f6fc10a7f7a84904a1cc02696513828e from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-f6fc10a7f7a84904a1cc02696513828e
I20260709 12:58:58.160935  2356 ts_tablet_manager.cc:933] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:58:58.178375  2354 ts_tablet_manager.cc:933] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:58:58.180478  2356 tablet_copy_client.cc:323] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:58:58.203644  1630 tablet_copy_source_session.cc:215] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:58:58.220252  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 98029.4us
I20260709 12:58:58.224864  2333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fc10a7f7a84904a1cc02696513828e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.273969  1555 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 8f45eebdd49441fa87ca7768bae03d64 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:58:58.274565  1555 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 8f45eebdd49441fa87ca7768bae03d64 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-8f45eebdd49441fa87ca7768bae03d64
I20260709 12:58:58.278910  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet b37b7f2c08b145c6b88f543822a1cf5c from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:58:58.279541  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet b37b7f2c08b145c6b88f543822a1cf5c from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-b37b7f2c08b145c6b88f543822a1cf5c
I20260709 12:58:58.287376  1554 tablet_copy_source_session.cc:215] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:58.293954  2356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37b7f2c08b145c6b88f543822a1cf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.290827  1555 tablet_copy_source_session.cc:215] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:58.305248  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f45eebdd49441fa87ca7768bae03d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.308605  2333 tablet_copy_client.cc:806] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.309201  2333 tablet_copy_client.cc:670] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.309320  2354 tablet_copy_client.cc:323] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:58:58.313513  2333 tablet_copy_client.cc:538] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.317191  1555 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 044356f91b2d4fe4a34deeb351b2fbac from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:58:58.317742  1555 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 044356f91b2d4fe4a34deeb351b2fbac from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-044356f91b2d4fe4a34deeb351b2fbac
I20260709 12:58:58.330276  2356 tablet_copy_client.cc:806] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.330927  2356 tablet_copy_client.cc:670] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.331138  1555 tablet_copy_source_session.cc:215] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:58.332929  2333 tablet_bootstrap.cc:492] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:58:58.335886  2354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044356f91b2d4fe4a34deeb351b2fbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.343933  2334 tablet_copy_client.cc:806] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.344475  2334 tablet_copy_client.cc:670] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.348824  2334 tablet_copy_client.cc:538] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.350730  2356 tablet_copy_client.cc:538] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.360849  2356 tablet_bootstrap.cc:492] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:58:58.365073  2354 tablet_copy_client.cc:806] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.369634  2354 tablet_copy_client.cc:670] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.385000  2354 tablet_copy_client.cc:538] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.395004  2354 tablet_bootstrap.cc:492] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:58:58.398402  2334 tablet_bootstrap.cc:492] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:58:58.406826  2356 tablet_bootstrap.cc:492] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.432482  2356 tablet_bootstrap.cc:492] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:58:58.433130  2356 ts_tablet_manager.cc:1403] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.011s
I20260709 12:58:58.436086  2356 raft_consensus.cc:359] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:58.436916  2356 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:58:58.427009  2354 tablet_bootstrap.cc:492] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.438421  2354 tablet_bootstrap.cc:492] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:58:58.439263  2354 ts_tablet_manager.cc:1403] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.005s
I20260709 12:58:58.442384  2356 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:58.445027  2354 raft_consensus.cc:359] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:58.445835  2354 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:58:58.446436  2354 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:58.447140  2333 tablet_bootstrap.cc:492] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.450127  2333 tablet_bootstrap.cc:492] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:58:58.450891  2333 ts_tablet_manager.cc:1403] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.003s
I20260709 12:58:58.464733  2333 raft_consensus.cc:359] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:58.472855  2333 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:58:58.473747  2333 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:58.484117  2354 ts_tablet_manager.cc:1434] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.044s	user 0.015s	sys 0.007s
I20260709 12:58:58.485841  2356 ts_tablet_manager.cc:1434] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.017s
I20260709 12:58:58.487746  1555 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-044356f91b2d4fe4a34deeb351b2fbac received from {username='slave'} at 127.0.0.1:57234
I20260709 12:58:58.488265  1555 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-044356f91b2d4fe4a34deeb351b2fbac on tablet 044356f91b2d4fe4a34deeb351b2fbac with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:58:58.489167  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-b37b7f2c08b145c6b88f543822a1cf5c received from {username='slave'} at 127.0.0.1:57234
I20260709 12:58:58.489543  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-b37b7f2c08b145c6b88f543822a1cf5c on tablet b37b7f2c08b145c6b88f543822a1cf5c with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:58:58.491838  2333 ts_tablet_manager.cc:1434] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.005s
I20260709 12:58:58.499828  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-f6fc10a7f7a84904a1cc02696513828e received from {username='slave'} at 127.0.0.1:43404
I20260709 12:58:58.500226  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-f6fc10a7f7a84904a1cc02696513828e on tablet f6fc10a7f7a84904a1cc02696513828e with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:58:58.514873  2334 tablet_bootstrap.cc:492] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.515775  2334 tablet_bootstrap.cc:492] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:58:58.516456  2334 ts_tablet_manager.cc:1403] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.118s	user 0.019s	sys 0.014s
I20260709 12:58:58.519394  2334 raft_consensus.cc:359] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:58.520314  2334 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:58:58.521054  2334 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:58:58.523913  2334 ts_tablet_manager.cc:1434] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:58:58.528678  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-8f45eebdd49441fa87ca7768bae03d64 received from {username='slave'} at 127.0.0.1:57234
I20260709 12:58:58.529058  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-8f45eebdd49441fa87ca7768bae03d64 on tablet 8f45eebdd49441fa87ca7768bae03d64 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:58:58.626816  2277 raft_consensus.cc:1217] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:58.728813  2277 raft_consensus.cc:1217] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:58.774194  2277 raft_consensus.cc:1217] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:58:58.838734  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080016ef60 after lost signal to thread 434
W20260709 12:58:58.839860  1715 debug-util.cc:398] Leaking SignalData structure 0x7b08001ea800 after lost signal to thread 1477
W20260709 12:58:58.842013  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080030e7a0 after lost signal to thread 1718
W20260709 12:58:58.843497  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080030ce40 after lost signal to thread 2301
I20260709 12:58:58.904907  2277 raft_consensus.cc:1217] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:59.034278  2339 raft_consensus.cc:1064] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:58:59.037118  2339 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:58:59.059984  2277 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.061652  2353 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.078222  1686 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.081455  2310 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.089722  2076 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.093086  1686 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.101292  2277 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.121341  1616 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.120978  1440 catalog_manager.cc:5697] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.147305  2310 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.165489  1613 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.209864  2310 raft_consensus.cc:1064] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:58:59.212949  2310 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:58:59.219539  2277 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.220752  1693 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.221035  2076 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.222386  2353 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.232785  1616 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.234220  2353 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.253712  1693 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.256992  2353 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.260533  1616 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.269168  1441 catalog_manager.cc:5697] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.274262  2345 raft_consensus.cc:1064] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:58:59.276479  2345 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:58:59.301463  2277 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.309734  2276 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.310650  1693 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.311786  2372 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.314180  2344 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:59.338514  1540 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.343550  2345 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.351428  1544 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:58:59.364962  2276 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.366477  2076 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.373046  2310 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.375152  1686 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.377203  2339 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.381316  2345 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.384097  1686 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.385545  2277 raft_consensus.cc:2955] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.395342  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b37b7f2c08b145c6b88f543822a1cf5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:59.400120  1540 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.402060  1690 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.414633  2276 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.425357  1441 catalog_manager.cc:5697] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.428686  1443 catalog_manager.cc:5697] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.432819  2339 raft_consensus.cc:1064] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:58:59.436601  2339 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:58:59.451263  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet b37b7f2c08b145c6b88f543822a1cf5c with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:58:59.466310  1616 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:58:59.479416  2277 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.481639  2345 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.482916  1690 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.484236  2345 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.488958  2277 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.487799  2387 tablet_replica.cc:333] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:58:59.490432  2344 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.492671  2310 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.490561  2387 raft_consensus.cc:2243] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:59.495280  2387 raft_consensus.cc:2272] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:59.502005  2387 ts_tablet_manager.cc:1916] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:59.504385  1693 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.504508  2275 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.507745  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6fc10a7f7a84904a1cc02696513828e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:59.508390  2339 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.516710  1440 catalog_manager.cc:5697] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.519266  1690 raft_consensus.cc:2955] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.547818  1616 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.558231  2339 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.602819  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet f6fc10a7f7a84904a1cc02696513828e with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:58:59.629580  2387 ts_tablet_manager.cc:1929] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:59.630053  2387 log.cc:1199] T b37b7f2c08b145c6b88f543822a1cf5c P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/b37b7f2c08b145c6b88f543822a1cf5c
I20260709 12:58:59.656925  2390 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.660570  2395 tablet_replica.cc:333] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:58:59.661646  2395 raft_consensus.cc:2243] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:59.662629  2395 raft_consensus.cc:2272] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:59.668758  1689 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.672240  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet b37b7f2c08b145c6b88f543822a1cf5c (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:58:59.672657  2395 ts_tablet_manager.cc:1916] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:59.676344  1619 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.695636  2275 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.708547  1442 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.717759  2395 ts_tablet_manager.cc:1929] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:59.718226  2395 log.cc:1199] T f6fc10a7f7a84904a1cc02696513828e P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/f6fc10a7f7a84904a1cc02696513828e
I20260709 12:58:59.719828  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet f6fc10a7f7a84904a1cc02696513828e (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:58:59.722565  1540 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:58:59.729753  1689 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.732340  2390 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.730280  2275 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.738981  2076 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.745113  2390 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.747022  1689 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.748193  1540 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:58:59.755056  2276 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.756592  2076 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:59.761408  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 044356f91b2d4fe4a34deeb351b2fbac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:59.762197  2277 raft_consensus.cc:2955] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.775965  1442 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.782037  2339 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.784267  2277 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.798203  1620 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.805191  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f45eebdd49441fa87ca7768bae03d64 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:59.815892  2339 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.817327  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet 044356f91b2d4fe4a34deeb351b2fbac with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:58:59.818265  2387 tablet_replica.cc:333] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:58:59.819497  2387 raft_consensus.cc:2243] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:59.820351  2387 raft_consensus.cc:2272] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:59.825389  2387 ts_tablet_manager.cc:1916] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:59.830120  1619 raft_consensus.cc:2955] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.833341  1443 catalog_manager.cc:5697] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:58:59.851127  2387 ts_tablet_manager.cc:1929] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:59.851631  2387 log.cc:1199] T 044356f91b2d4fe4a34deeb351b2fbac P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/044356f91b2d4fe4a34deeb351b2fbac
I20260709 12:58:59.852805  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f45eebdd49441fa87ca7768bae03d64 with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:58:59.873908  2396 tablet_replica.cc:333] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:58:59.875053  2396 raft_consensus.cc:2243] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:59.875955  2396 raft_consensus.cc:2272] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:59.877161  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet 044356f91b2d4fe4a34deeb351b2fbac (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:58:59.889613  2396 ts_tablet_manager.cc:1916] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:59.900413  2396 ts_tablet_manager.cc:1929] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:59.900818  2396 log.cc:1199] T 8f45eebdd49441fa87ca7768bae03d64 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/8f45eebdd49441fa87ca7768bae03d64
I20260709 12:58:59.902787  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet 8f45eebdd49441fa87ca7768bae03d64 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:00.948310  1544 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:00.956607  1689 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:00.956846  1510 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e675a1020ff48279e061c44c1a368ae. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:00.957834  1613 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:00.958907  2076 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:00.961876  2076 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:00.971201  2353 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:00.974118  1613 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:00.976445  1689 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:00.994640  1443 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.037366  1689 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.049674  1619 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.051646  2394 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.052534  1544 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.056404  2394 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.098608  1538 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.101962  1613 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 12:59:01.108624  1659 consensus_peers.cc:597] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f99348e8926940e29e1f3d35bef36868. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.097332  2412 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.121690  1440 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.140604  1689 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:01.156543  1659 consensus_peers.cc:597] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c48135c32120406e945bec13a16ae327. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.158893  1619 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.160162  2394 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.161512  1540 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.162933  2394 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:59:01.176765  2412 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.177902  1538 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.194342  1613 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.203846  1442 catalog_manager.cc:5697] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.204530  1538 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.238992  1689 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:01.240059  1510 consensus_peers.cc:597] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7aeb3a1da10b4e5a8070d908a280055c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.240564  2310 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.240873  1613 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.242033  2353 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.249591  2310 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.253033  1689 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.267647  1442 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.274107  1613 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:01.591341  2422 ts_tablet_manager.cc:933] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:01.604369  2422 tablet_copy_client.cc:323] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:01.606446  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 5e675a1020ff48279e061c44c1a368ae from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:01.607028  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 5e675a1020ff48279e061c44c1a368ae from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-5e675a1020ff48279e061c44c1a368ae
I20260709 12:59:01.610878  2423 ts_tablet_manager.cc:933] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:01.613631  1554 tablet_copy_source_session.cc:215] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.617565  2422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e675a1020ff48279e061c44c1a368ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.644524  2423 tablet_copy_client.cc:323] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:01.655234  2422 tablet_copy_client.cc:806] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.656023  2422 tablet_copy_client.cc:670] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.672757  2422 tablet_copy_client.cc:538] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.682027  2422 tablet_bootstrap.cc:492] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:01.686815  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet f99348e8926940e29e1f3d35bef36868 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:01.687573  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet f99348e8926940e29e1f3d35bef36868 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-f99348e8926940e29e1f3d35bef36868
I20260709 12:59:01.695501  1704 tablet_copy_source_session.cc:215] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.699419  2423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99348e8926940e29e1f3d35bef36868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.710889  2429 ts_tablet_manager.cc:933] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:01.722301  2429 tablet_copy_client.cc:323] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:01.724365  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet c48135c32120406e945bec13a16ae327 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:01.724860  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet c48135c32120406e945bec13a16ae327 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-c48135c32120406e945bec13a16ae327
I20260709 12:59:01.742508  2432 ts_tablet_manager.cc:933] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:01.752900  2422 tablet_bootstrap.cc:492] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.753674  2422 tablet_bootstrap.cc:492] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:01.754280  2422 ts_tablet_manager.cc:1403] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.006s
I20260709 12:59:01.756613  2432 tablet_copy_client.cc:323] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:01.757946  2422 raft_consensus.cc:359] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.758778  2422 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:01.758849  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 7aeb3a1da10b4e5a8070d908a280055c from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:01.759356  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 7aeb3a1da10b4e5a8070d908a280055c from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-7aeb3a1da10b4e5a8070d908a280055c
I20260709 12:59:01.759431  2422 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.769583  2422 ts_tablet_manager.cc:1434] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.011s
I20260709 12:59:01.773744  1555 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-5e675a1020ff48279e061c44c1a368ae received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:01.774122  1555 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-5e675a1020ff48279e061c44c1a368ae on tablet 5e675a1020ff48279e061c44c1a368ae with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:01.785168  1554 tablet_copy_source_session.cc:215] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.790495  1704 tablet_copy_source_session.cc:215] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.789278  2423 tablet_copy_client.cc:806] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.791976  2423 tablet_copy_client.cc:670] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.795327  2432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aeb3a1da10b4e5a8070d908a280055c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.795908  2429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48135c32120406e945bec13a16ae327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.803025  2423 tablet_copy_client.cc:538] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.814121  2423 tablet_bootstrap.cc:492] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:01.824005  2429 tablet_copy_client.cc:806] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.824548  2429 tablet_copy_client.cc:670] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.828032  2429 tablet_copy_client.cc:538] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.837669  2432 tablet_copy_client.cc:806] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.838208  2432 tablet_copy_client.cc:670] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.842072  2432 tablet_copy_client.cc:538] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.846602  2423 tablet_bootstrap.cc:492] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.851089  2423 tablet_bootstrap.cc:492] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:01.851771  2423 ts_tablet_manager.cc:1403] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.005s
I20260709 12:59:01.854986  2423 raft_consensus.cc:359] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.855816  2423 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:01.857859  2429 tablet_bootstrap.cc:492] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:01.856521  2423 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.865495  2423 ts_tablet_manager.cc:1434] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:59:01.867125  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-f99348e8926940e29e1f3d35bef36868 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:01.867571  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-f99348e8926940e29e1f3d35bef36868 on tablet f99348e8926940e29e1f3d35bef36868 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:01.868906  2432 tablet_bootstrap.cc:492] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:01.899600  2429 tablet_bootstrap.cc:492] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.900441  2429 tablet_bootstrap.cc:492] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:01.901050  2429 ts_tablet_manager.cc:1403] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.010s
I20260709 12:59:01.903975  2429 raft_consensus.cc:359] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.904697  2429 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:01.905306  2429 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.909482  2429 ts_tablet_manager.cc:1434] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:59:01.910878  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-c48135c32120406e945bec13a16ae327 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:01.911643  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-c48135c32120406e945bec13a16ae327 on tablet c48135c32120406e945bec13a16ae327 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:01.925213  2432 tablet_bootstrap.cc:492] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.925866  2432 tablet_bootstrap.cc:492] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:01.926409  2432 ts_tablet_manager.cc:1403] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.009s
I20260709 12:59:01.928480  2432 raft_consensus.cc:359] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.929078  2432 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:01.929569  2432 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:01.933301  2432 ts_tablet_manager.cc:1434] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:59:01.934864  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-7aeb3a1da10b4e5a8070d908a280055c received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:01.935250  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-7aeb3a1da10b4e5a8070d908a280055c on tablet 7aeb3a1da10b4e5a8070d908a280055c with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:02.101627  2276 raft_consensus.cc:1217] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.127112  2276 raft_consensus.cc:1217] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.162348  2276 raft_consensus.cc:1217] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.169315  2276 raft_consensus.cc:1217] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:59:02.251552  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48514.8us
I20260709 12:59:02.539842  2445 raft_consensus.cc:1064] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:02.542961  2445 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:02.553889  2277 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.555531  2413 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.564581  1543 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.567813  1620 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.568786  2446 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.577054  2442 raft_consensus.cc:1064] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:02.570504  2446 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:59:02.581782  2442 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:02.605424  2276 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.607985  2444 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.618160  1619 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.621816  1538 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.622462  2445 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.624991  2445 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.646478  2444 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.660053  1619 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.666898  2445 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.675904  2276 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.733652  2277 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.658169  1538 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.763161  2439 raft_consensus.cc:1064] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:02.740883  1442 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:02.766834  2439 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:02.741789  1620 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.813454  2274 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.820461  1544 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.855494  1614 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.860347  1689 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.859167  2310 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:02.866789  2310 raft_consensus.cc:1064] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:02.867419  2076 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:59:02.881276  2458 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.886023  2310 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:02.962980  1441 catalog_manager.cc:5697] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.966840  1685 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.972330  2310 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.975979  2274 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.979012  2277 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.982513  1620 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.963627  2457 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:02.983989  2438 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.994756  2440 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:03.001873  1686 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.018137  1619 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.056375  2457 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.057783  1620 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.071166  1689 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.075232  1685 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:03.083662  2277 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.086915  2274 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.087571  1620 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.089149  2442 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.090025  2444 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.099777  2445 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.103806  1620 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.105520  2274 raft_consensus.cc:2955] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.115334  1442 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:03.117120  1442 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:03.127902  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f99348e8926940e29e1f3d35bef36868 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.138888  1538 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:03.144017  1441 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.151710  1685 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:03.169036  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet f99348e8926940e29e1f3d35bef36868 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:03.173187  2274 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.175175  2444 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:03.180629  1620 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.181129  1538 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:03.183379  2277 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.185286  2310 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.184741  2413 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.186738  2474 tablet_replica.cc:333] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:03.187805  2474 raft_consensus.cc:2243] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.188627  2474 raft_consensus.cc:2272] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.192368  2474 ts_tablet_manager.cc:1916] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.195102  1620 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.195197  2276 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.196593  2438 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.198953  2310 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.198175  2277 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.202667  2440 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.208082  1689 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.207852  2276 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.209455  2420 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:03.213956  2076 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.222321  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c48135c32120406e945bec13a16ae327 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.222937  2445 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.225031  2474 ts_tablet_manager.cc:1929] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.225606  2474 log.cc:1199] T f99348e8926940e29e1f3d35bef36868 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/f99348e8926940e29e1f3d35bef36868
I20260709 12:59:03.225248  1620 raft_consensus.cc:2955] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.227304  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet f99348e8926940e29e1f3d35bef36868 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:03.234350  1443 catalog_manager.cc:5697] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.236415  1619 raft_consensus.cc:2955] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.239683  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e675a1020ff48279e061c44c1a368ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.241508  2277 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.244876  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7aeb3a1da10b4e5a8070d908a280055c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.250815  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet c48135c32120406e945bec13a16ae327 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:03.254266  2474 tablet_replica.cc:333] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:03.255213  2474 raft_consensus.cc:2243] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.255828  2474 raft_consensus.cc:2272] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.260030  1440 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:03.261413  1688 raft_consensus.cc:2955] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.275996  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e675a1020ff48279e061c44c1a368ae with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:03.290416  2474 ts_tablet_manager.cc:1916] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.298777  1443 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:03.292392  2475 tablet_replica.cc:333] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:03.318868  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet 7aeb3a1da10b4e5a8070d908a280055c with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:03.324934  2475 raft_consensus.cc:2243] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.329861  2475 raft_consensus.cc:2272] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.336310  2476 tablet_replica.cc:333] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:03.337286  2476 raft_consensus.cc:2243] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.338182  2476 raft_consensus.cc:2272] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.340175  2475 ts_tablet_manager.cc:1916] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.342780  2476 ts_tablet_manager.cc:1916] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.362602  2474 ts_tablet_manager.cc:1929] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.362335  2476 ts_tablet_manager.cc:1929] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.363171  2474 log.cc:1199] T c48135c32120406e945bec13a16ae327 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/c48135c32120406e945bec13a16ae327
I20260709 12:59:03.363452  2476 log.cc:1199] T 7aeb3a1da10b4e5a8070d908a280055c P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/7aeb3a1da10b4e5a8070d908a280055c
I20260709 12:59:03.364714  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet c48135c32120406e945bec13a16ae327 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:03.365558  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet 7aeb3a1da10b4e5a8070d908a280055c (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:03.371037  2475 ts_tablet_manager.cc:1929] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.371483  2475 log.cc:1199] T 5e675a1020ff48279e061c44c1a368ae P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/5e675a1020ff48279e061c44c1a368ae
I20260709 12:59:03.373373  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet 5e675a1020ff48279e061c44c1a368ae (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:04.385416  1538 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:04.392169  1510 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3d6c15d42494c1cbf1914151dcfb5ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:04.392403  1616 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.393303  1686 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.394178  2457 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.395359  2482 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.413331  2484 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.419111  1619 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.421149  1686 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.449219  1440 catalog_manager.cc:5697] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.458235  1686 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:04.475615  1619 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.476835  1538 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.477209  2444 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:04.478248  1659 consensus_peers.cc:597] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 165cabe60a114b9ca5fda64711bd3163. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:04.479101  2477 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.498941  2444 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.500491  1541 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.534917  1620 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:04.541792  1442 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:04.560600  1619 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 12:59:04.584263  1585 consensus_peers.cc:597] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ab387e7d0b0401eb317a86421cc1f80. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:04.587484  1688 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.589287  2483 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.592949  1541 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.594280  2500 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.605835  2483 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.608510  1688 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.621147  1538 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.622166  1620 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:04.631953  1440 catalog_manager.cc:5697] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 12:59:04.643035  1585 consensus_peers.cc:597] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83a99308299b4d05a3b45157d06ba9bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:04.651830  1688 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.651978  1538 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.653119  2480 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.653932  2503 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.666533  2480 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.668198  1538 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.673204  1688 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.692080  1442 catalog_manager.cc:5697] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:04.789273  2507 ts_tablet_manager.cc:933] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:04.791066  2507 tablet_copy_client.cc:323] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:04.792559  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet b3d6c15d42494c1cbf1914151dcfb5ac from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:04.793053  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet b3d6c15d42494c1cbf1914151dcfb5ac from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-b3d6c15d42494c1cbf1914151dcfb5ac
I20260709 12:59:04.801677  1554 tablet_copy_source_session.cc:215] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:04.805673  2507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d6c15d42494c1cbf1914151dcfb5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:04.819811  2507 tablet_copy_client.cc:806] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:04.820338  2507 tablet_copy_client.cc:670] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:04.828966  2507 tablet_copy_client.cc:538] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:04.836807  2507 tablet_bootstrap.cc:492] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:04.856899  2507 tablet_bootstrap.cc:492] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:04.857738  2507 tablet_bootstrap.cc:492] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:04.858361  2507 ts_tablet_manager.cc:1403] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:59:04.861582  2507 raft_consensus.cc:359] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:04.862404  2507 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:04.863086  2507 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:04.866492  2507 ts_tablet_manager.cc:1434] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:59:04.868080  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-b3d6c15d42494c1cbf1914151dcfb5ac received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:04.868538  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-b3d6c15d42494c1cbf1914151dcfb5ac on tablet b3d6c15d42494c1cbf1914151dcfb5ac with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:04.956914  1566 debug-util.cc:398] Leaking SignalData structure 0x7b08001a4ee0 after lost signal to thread 434
W20260709 12:59:04.957722  1566 debug-util.cc:398] Leaking SignalData structure 0x7b0800108740 after lost signal to thread 1477
W20260709 12:59:04.958523  1566 debug-util.cc:398] Leaking SignalData structure 0x7b080032b2c0 after lost signal to thread 1569
W20260709 12:59:04.959270  1566 debug-util.cc:398] Leaking SignalData structure 0x7b080032aac0 after lost signal to thread 1644
W20260709 12:59:04.959965  1566 debug-util.cc:398] Leaking SignalData structure 0x7b080010a700 after lost signal to thread 1718
W20260709 12:59:04.960687  1566 debug-util.cc:398] Leaking SignalData structure 0x7b080031c6c0 after lost signal to thread 2301
I20260709 12:59:05.002942  2507 ts_tablet_manager.cc:933] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:05.004825  2507 tablet_copy_client.cc:323] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:05.006562  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 4ab387e7d0b0401eb317a86421cc1f80 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:59:05.007158  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 4ab387e7d0b0401eb317a86421cc1f80 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-4ab387e7d0b0401eb317a86421cc1f80
I20260709 12:59:05.016073  1630 tablet_copy_source_session.cc:215] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.019327  2507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab387e7d0b0401eb317a86421cc1f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.036535  2507 tablet_copy_client.cc:806] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.037082  2507 tablet_copy_client.cc:670] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.040400  2507 tablet_copy_client.cc:538] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.061622  2507 tablet_bootstrap.cc:492] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:05.099826  2512 ts_tablet_manager.cc:933] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:05.101158  2507 tablet_bootstrap.cc:492] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.101997  2507 tablet_bootstrap.cc:492] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:05.102659  2507 ts_tablet_manager.cc:1403] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.004s
I20260709 12:59:05.105505  2507 raft_consensus.cc:359] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:05.106288  2507 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:05.114805  2512 tablet_copy_client.cc:323] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:05.118956  2507 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:05.121397  2507 ts_tablet_manager.cc:1434] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:59:05.124666  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-4ab387e7d0b0401eb317a86421cc1f80 received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:05.125039  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-4ab387e7d0b0401eb317a86421cc1f80 on tablet 4ab387e7d0b0401eb317a86421cc1f80 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:05.133443  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet 165cabe60a114b9ca5fda64711bd3163 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:05.133967  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet 165cabe60a114b9ca5fda64711bd3163 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-165cabe60a114b9ca5fda64711bd3163
I20260709 12:59:05.143402  1704 tablet_copy_source_session.cc:215] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.146900  2512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165cabe60a114b9ca5fda64711bd3163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.164098  2512 tablet_copy_client.cc:806] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.166742  2512 tablet_copy_client.cc:670] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.179494  2512 tablet_copy_client.cc:538] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.190187  2512 tablet_bootstrap.cc:492] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:05.213703  2512 tablet_bootstrap.cc:492] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.214507  2512 tablet_bootstrap.cc:492] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:05.215299  2512 ts_tablet_manager.cc:1403] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.005s
I20260709 12:59:05.216351  2507 ts_tablet_manager.cc:933] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:05.218384  2512 raft_consensus.cc:359] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:05.219242  2512 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:05.219844  2512 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:05.224376  2512 ts_tablet_manager.cc:1434] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:59:05.226176  2507 tablet_copy_client.cc:323] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:05.226286  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-165cabe60a114b9ca5fda64711bd3163 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:05.226718  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-165cabe60a114b9ca5fda64711bd3163 on tablet 165cabe60a114b9ca5fda64711bd3163 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:05.227898  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 83a99308299b4d05a3b45157d06ba9bd from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:59:05.228390  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 83a99308299b4d05a3b45157d06ba9bd from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-83a99308299b4d05a3b45157d06ba9bd
I20260709 12:59:05.244552  1630 tablet_copy_source_session.cc:215] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.247632  2507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a99308299b4d05a3b45157d06ba9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.264567  2507 tablet_copy_client.cc:806] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.265115  2507 tablet_copy_client.cc:670] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.280637  2507 tablet_copy_client.cc:538] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.289744  2507 tablet_bootstrap.cc:492] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:05.305274  2277 raft_consensus.cc:1217] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:05.321563  2507 tablet_bootstrap.cc:492] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.322489  2507 tablet_bootstrap.cc:492] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:05.323251  2507 ts_tablet_manager.cc:1403] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.034s	user 0.025s	sys 0.000s
I20260709 12:59:05.325739  2507 raft_consensus.cc:359] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:05.330725  2507 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:05.331300  2507 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:05.335582  2507 ts_tablet_manager.cc:1434] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:59:05.337390  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-83a99308299b4d05a3b45157d06ba9bd received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:05.337841  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-83a99308299b4d05a3b45157d06ba9bd on tablet 83a99308299b4d05a3b45157d06ba9bd with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:05.428519  2277 raft_consensus.cc:1217] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:05.577410  2277 raft_consensus.cc:1217] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:05.740787  2277 raft_consensus.cc:1217] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:05.814848  2522 raft_consensus.cc:1064] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:05.817412  2522 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:05.826390  1686 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:05.826447  2277 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:05.828805  2521 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:05.835815  2484 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:05.839517  1619 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:05.840729  2482 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:05.846726  2482 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:05.849192  2277 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:05.858282  2477 raft_consensus.cc:1064] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:05.859635  1688 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:05.860603  2477 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:05.878736  2276 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:05.879788  1440 catalog_manager.cc:5697] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:05.883452  2488 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:05.902707  1616 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:05.915231  2513 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:05.932437  1541 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:05.934542  2488 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:05.949927  2513 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:05.959440  1616 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:05.963611  1538 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:05.975800  2276 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:05.972795  1619 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.021899  1442 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:06.062831  2519 raft_consensus.cc:1064] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:06.068257  1686 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:06.071699  1538 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:06.065321  2519 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:06.076764  2276 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.078190  2522 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.081036  2274 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.083410  1619 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.083789  2488 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.084501  2482 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.085855  2277 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.092022  2513 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.093094  2274 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.099110  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3d6c15d42494c1cbf1914151dcfb5ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:06.099740  1443 catalog_manager.cc:5697] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.102188  2276 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.104790  1538 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.105973  2488 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.108150  1541 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.109520  2480 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.110759  2519 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:06.111977  2457 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.113519  1686 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.124440  1541 raft_consensus.cc:2955] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.127045  2480 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.146425  1443 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.147418  1619 raft_consensus.cc:2955] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.156687  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet b3d6c15d42494c1cbf1914151dcfb5ac with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:06.160440  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet 165cabe60a114b9ca5fda64711bd3163 with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:06.162539  2543 tablet_replica.cc:333] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:06.164036  2543 raft_consensus.cc:2243] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:06.166003  2543 raft_consensus.cc:2272] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:06.169476  2543 ts_tablet_manager.cc:1916] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:06.174376  2542 tablet_replica.cc:333] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:06.192950  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 165cabe60a114b9ca5fda64711bd3163 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:06.197824  2542 raft_consensus.cc:2243] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:06.200587  2543 ts_tablet_manager.cc:1929] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:06.228900  2543 log.cc:1199] T 165cabe60a114b9ca5fda64711bd3163 P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/165cabe60a114b9ca5fda64711bd3163
I20260709 12:59:06.238379  2542 raft_consensus.cc:2272] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:06.237792  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 74650.2us
I20260709 12:59:06.248701  2542 ts_tablet_manager.cc:1916] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:06.259097  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet 165cabe60a114b9ca5fda64711bd3163 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:06.268731  2523 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.280411  2276 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.294497  1443 catalog_manager.cc:5697] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.303309  2542 ts_tablet_manager.cc:1929] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:06.314100  1541 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.308557  2542 log.cc:1199] T b3d6c15d42494c1cbf1914151dcfb5ac P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/b3d6c15d42494c1cbf1914151dcfb5ac
I20260709 12:59:06.319737  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet b3d6c15d42494c1cbf1914151dcfb5ac (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:06.345638  1686 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.363158  1619 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:06.364634  2480 raft_consensus.cc:1064] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:06.367188  2480 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:06.369536  2276 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.371376  2523 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.372838  1686 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.378518  2523 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.382999  2544 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.392534  1686 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.393720  2274 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.391744  2276 raft_consensus.cc:2955] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.395063  2523 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.398908  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ab387e7d0b0401eb317a86421cc1f80 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:06.405545  1541 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.408313  1686 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.408186  2480 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.409672  2523 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:06.413175  1441 catalog_manager.cc:5697] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:06.424817  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ab387e7d0b0401eb317a86421cc1f80 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:06.432003  2544 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.450165  2274 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.472123  1686 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.501426  2549 tablet_replica.cc:333] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:06.504017  1541 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.507825  1441 catalog_manager.cc:5697] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:06.519099  2549 raft_consensus.cc:2243] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:06.519909  2549 raft_consensus.cc:2272] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:06.523442  2549 ts_tablet_manager.cc:1916] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:06.539041  2549 ts_tablet_manager.cc:1929] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:06.539649  2549 log.cc:1199] T 4ab387e7d0b0401eb317a86421cc1f80 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/4ab387e7d0b0401eb317a86421cc1f80
I20260709 12:59:06.541281  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet 4ab387e7d0b0401eb317a86421cc1f80 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:06.553048  1619 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:06.557576  2274 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.558980  2523 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.559604  1541 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.560878  2523 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.566593  2544 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.568632  1541 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.578706  2274 raft_consensus.cc:2955] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.590744  1440 catalog_manager.cc:5697] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:06.603615  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet 83a99308299b4d05a3b45157d06ba9bd with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:06.604959  2542 tablet_replica.cc:333] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:06.605659  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83a99308299b4d05a3b45157d06ba9bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:06.606575  2542 raft_consensus.cc:2243] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:06.607370  2542 raft_consensus.cc:2272] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:06.629855  2542 ts_tablet_manager.cc:1916] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:06.649923  2542 ts_tablet_manager.cc:1929] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:06.650310  2542 log.cc:1199] T 83a99308299b4d05a3b45157d06ba9bd P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/83a99308299b4d05a3b45157d06ba9bd
I20260709 12:59:06.651875  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet 83a99308299b4d05a3b45157d06ba9bd (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:07.940125  1616 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:07.984376  1686 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:07.991070  1541 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:07.997251  1585 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b4609f4058b459f804e03408773bd69. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:08.120828  2557 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.124781  2562 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.187776  2503 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.191958  1685 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.193424  1544 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.209160  1441 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.221633  1685 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:08.268354  1659 consensus_peers.cc:597] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c330c505ed4e4efda5c94a1811c68633. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:08.271255  1613 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.272470  1544 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.273857  2554 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.276069  2554 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.290591  2554 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.292361  1544 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.295569  1613 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.313591  1443 catalog_manager.cc:5697] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.308240  1544 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:08.321350  1685 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.322721  2559 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.321704  1613 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:08.326174  1510 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d969afe49dd43c2902adb01b5aa223b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:08.332546  2559 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.332360  2457 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.335960  1685 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.356590  1613 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.356901  1441 catalog_manager.cc:5697] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.366003  1685 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:08.392814  2575 ts_tablet_manager.cc:933] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:08.403663  2575 tablet_copy_client.cc:323] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:08.405758  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 5b4609f4058b459f804e03408773bd69 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
W20260709 12:59:08.406199  1659 consensus_peers.cc:597] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0de7551eb2ca4d369ae826fcaebd0301. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:08.406337  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 5b4609f4058b459f804e03408773bd69 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-5b4609f4058b459f804e03408773bd69
I20260709 12:59:08.413322  1613 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.416857  2554 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.425810  1630 tablet_copy_source_session.cc:215] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:08.429745  2575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4609f4058b459f804e03408773bd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.429605  2477 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.430569  1544 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.432250  2555 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.441766  1616 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.450011  2575 tablet_copy_client.cc:806] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:08.450564  2575 tablet_copy_client.cc:670] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:08.460779  2575 tablet_copy_client.cc:538] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:08.477773  1440 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.479560  2575 tablet_bootstrap.cc:492] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:08.484354  1544 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:08.523326  2575 tablet_bootstrap.cc:492] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:08.524220  2575 tablet_bootstrap.cc:492] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:08.524843  2575 ts_tablet_manager.cc:1403] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.013s
I20260709 12:59:08.531879  2575 raft_consensus.cc:359] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:08.532783  2575 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:08.533425  2575 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:08.553467  2575 ts_tablet_manager.cc:1434] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.007s
I20260709 12:59:08.555505  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-5b4609f4058b459f804e03408773bd69 received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:08.555943  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-5b4609f4058b459f804e03408773bd69 on tablet 5b4609f4058b459f804e03408773bd69 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:08.648773  2575 ts_tablet_manager.cc:933] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:08.659778  2575 tablet_copy_client.cc:323] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:08.661566  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet c330c505ed4e4efda5c94a1811c68633 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:08.662031  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet c330c505ed4e4efda5c94a1811c68633 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-c330c505ed4e4efda5c94a1811c68633
I20260709 12:59:08.675762  1704 tablet_copy_source_session.cc:215] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:08.679898  2575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c330c505ed4e4efda5c94a1811c68633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.698953  2575 tablet_copy_client.cc:806] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:08.699532  2575 tablet_copy_client.cc:670] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:08.703945  2575 tablet_copy_client.cc:538] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:08.712175  2575 tablet_bootstrap.cc:492] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:08.733942  2575 tablet_bootstrap.cc:492] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:08.734805  2575 tablet_bootstrap.cc:492] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:08.735487  2575 ts_tablet_manager.cc:1403] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.001s
I20260709 12:59:08.738772  2575 raft_consensus.cc:359] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:08.739571  2575 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:08.740182  2575 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:08.742624  2575 ts_tablet_manager.cc:1434] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:59:08.744217  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-c330c505ed4e4efda5c94a1811c68633 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:08.744585  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-c330c505ed4e4efda5c94a1811c68633 on tablet c330c505ed4e4efda5c94a1811c68633 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:08.776485  2575 ts_tablet_manager.cc:933] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:08.784458  2575 tablet_copy_client.cc:323] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:08.786067  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 8d969afe49dd43c2902adb01b5aa223b from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:08.786585  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 8d969afe49dd43c2902adb01b5aa223b from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-8d969afe49dd43c2902adb01b5aa223b
I20260709 12:59:08.795018  1554 tablet_copy_source_session.cc:215] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:08.798243  2575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d969afe49dd43c2902adb01b5aa223b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.815348  2575 tablet_copy_client.cc:806] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:08.815953  2575 tablet_copy_client.cc:670] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:08.819597  2575 tablet_copy_client.cc:538] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:08.827742  2575 tablet_bootstrap.cc:492] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:08.853119  2575 tablet_bootstrap.cc:492] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:08.853952  2575 tablet_bootstrap.cc:492] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:08.854871  2575 ts_tablet_manager.cc:1403] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.014s
I20260709 12:59:08.857450  2575 raft_consensus.cc:359] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:08.858237  2575 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:08.858832  2575 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:08.865270  2575 ts_tablet_manager.cc:1434] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:59:08.866895  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-8d969afe49dd43c2902adb01b5aa223b received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:08.867309  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-8d969afe49dd43c2902adb01b5aa223b on tablet 8d969afe49dd43c2902adb01b5aa223b with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:08.885922  2276 raft_consensus.cc:1217] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:08.958963  2575 ts_tablet_manager.cc:933] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:08.961133  2575 tablet_copy_client.cc:323] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:08.962922  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet 0de7551eb2ca4d369ae826fcaebd0301 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:08.963429  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet 0de7551eb2ca4d369ae826fcaebd0301 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-0de7551eb2ca4d369ae826fcaebd0301
I20260709 12:59:08.968456  1704 tablet_copy_source_session.cc:215] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:08.970937  2575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de7551eb2ca4d369ae826fcaebd0301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.983959  2575 tablet_copy_client.cc:806] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:08.984880  2575 tablet_copy_client.cc:670] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:08.997673  2575 tablet_copy_client.cc:538] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:09.006155  2575 tablet_bootstrap.cc:492] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
W20260709 12:59:09.006699  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080030caa0 after lost signal to thread 434
W20260709 12:59:09.007666  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080030e260 after lost signal to thread 1477
W20260709 12:59:09.008775  1715 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8260 after lost signal to thread 1569
W20260709 12:59:09.009742  1715 debug-util.cc:398] Leaking SignalData structure 0x7b08001eaa40 after lost signal to thread 1644
W20260709 12:59:09.010704  1715 debug-util.cc:398] Leaking SignalData structure 0x7b08002afea0 after lost signal to thread 1718
W20260709 12:59:09.016793  1715 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac8a0 after lost signal to thread 2301
I20260709 12:59:09.055282  2276 raft_consensus.cc:1217] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:09.108888  2575 tablet_bootstrap.cc:492] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:09.111351  2575 tablet_bootstrap.cc:492] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:09.132076  2575 ts_tablet_manager.cc:1403] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.019s
I20260709 12:59:09.141181  2575 raft_consensus.cc:359] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:09.150460  2575 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:09.151110  2575 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:09.153429  2575 ts_tablet_manager.cc:1434] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:59:09.158747  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-0de7551eb2ca4d369ae826fcaebd0301 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:09.159153  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-0de7551eb2ca4d369ae826fcaebd0301 on tablet 0de7551eb2ca4d369ae826fcaebd0301 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:09.272851  2276 raft_consensus.cc:1217] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:09.355512  2503 raft_consensus.cc:1064] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:09.357909  2503 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:09.404018  2276 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.408998  2562 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.546732  1544 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.550973  1685 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.558988  2274 raft_consensus.cc:1217] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:09.581195  2557 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.583055  2557 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:09.617336  2589 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:59:09.620064  2477 raft_consensus.cc:1064] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:09.622535  2477 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:09.646040  2277 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.650394  2591 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:09.672858  1612 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.673897  1541 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.672408  2557 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.675362  2591 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.677069  2591 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.690716  1689 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.709676  2277 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.724246  1440 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.743530  1541 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.757143  2559 raft_consensus.cc:1064] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:09.759783  2559 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:09.772292  2477 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.782979  1616 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.784853  2274 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.782015  1689 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.785415  2559 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:09.796514  2552 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.798177  2588 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.805773  2274 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.819352  1544 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.819720  1616 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.838455  2559 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.849978  2274 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.851745  1441 catalog_manager.cc:5697] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.868420  1612 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:09.875738  1685 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.878235  1544 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.879766  2557 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.882113  1689 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:09.889072  2277 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.890599  2595 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.898904  1612 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.899195  2503 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.901729  2551 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.904999  1616 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.905587  1544 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.906962  2595 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.874641  1440 catalog_manager.cc:5697] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.912216  1616 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.924710  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c330c505ed4e4efda5c94a1811c68633 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:09.903519  2277 raft_consensus.cc:2955] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.935148  2274 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.936546  2562 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.937209  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b4609f4058b459f804e03408773bd69 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:09.967216  2274 raft_consensus.cc:2955] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.955798  1544 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:09.961608  1442 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.980899  1440 catalog_manager.cc:5697] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:09.991586  2274 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.995033  1689 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.993044  2559 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:59:09.998116  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet c330c505ed4e4efda5c94a1811c68633 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:10.005745  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b4609f4058b459f804e03408773bd69 with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:10.007854  2588 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:10.011722  2552 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.030974  1689 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.032194  2274 raft_consensus.cc:2955] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.047806  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d969afe49dd43c2902adb01b5aa223b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:10.029276  2608 tablet_replica.cc:333] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:10.059269  2609 tablet_replica.cc:333] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:10.060060  2608 raft_consensus.cc:2243] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:10.067459  2608 raft_consensus.cc:2272] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:10.068095  2609 raft_consensus.cc:2243] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:10.069096  2609 raft_consensus.cc:2272] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:10.074164  1440 catalog_manager.cc:5697] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.076185  2608 ts_tablet_manager.cc:1916] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:10.079926  2609 ts_tablet_manager.cc:1916] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:10.090343  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d969afe49dd43c2902adb01b5aa223b with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:10.095873  2608 ts_tablet_manager.cc:1929] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:10.096318  2608 log.cc:1199] T c330c505ed4e4efda5c94a1811c68633 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/c330c505ed4e4efda5c94a1811c68633
I20260709 12:59:10.097879  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet c330c505ed4e4efda5c94a1811c68633 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:10.103001  2610 tablet_replica.cc:333] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:10.104629  2610 raft_consensus.cc:2243] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:10.109907  2609 ts_tablet_manager.cc:1929] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:10.110387  2609 log.cc:1199] T 5b4609f4058b459f804e03408773bd69 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/5b4609f4058b459f804e03408773bd69
I20260709 12:59:10.112228  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet 5b4609f4058b459f804e03408773bd69 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:10.115585  2610 raft_consensus.cc:2272] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:10.162477  2610 ts_tablet_manager.cc:1916] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:10.189355  2595 raft_consensus.cc:1064] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:10.196097  2595 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:10.202039  2610 ts_tablet_manager.cc:1929] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:10.202620  2610 log.cc:1199] T 8d969afe49dd43c2902adb01b5aa223b P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/8d969afe49dd43c2902adb01b5aa223b
I20260709 12:59:10.208899  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet 8d969afe49dd43c2902adb01b5aa223b (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:10.219295  2274 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:10.221259  2477 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:10.226231  1613 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:10.227617  2595 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:10.227977  1541 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:10.229507  2477 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:10.247673  2595 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.251991  1613 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.256594  2277 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.285226  1541 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.286844  1440 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.306248  1686 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:10.324988  1544 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:10.327431  2595 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:10.333732  2277 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:10.335467  2595 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:10.338063  2477 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.338454  1544 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.363508  2277 raft_consensus.cc:2955] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.360293  1440 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:10.382344  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0de7551eb2ca4d369ae826fcaebd0301 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:10.388443  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet 0de7551eb2ca4d369ae826fcaebd0301 with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:10.389487  2610 tablet_replica.cc:333] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:10.390560  2610 raft_consensus.cc:2243] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:10.392431  2610 raft_consensus.cc:2272] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:10.397544  2610 ts_tablet_manager.cc:1916] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:10.512516  2610 ts_tablet_manager.cc:1929] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:10.513000  2610 log.cc:1199] T 0de7551eb2ca4d369ae826fcaebd0301 P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/0de7551eb2ca4d369ae826fcaebd0301
I20260709 12:59:10.515272  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet 0de7551eb2ca4d369ae826fcaebd0301 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:11.454283  1544 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:11.459355  1613 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:11.459628  1510 consensus_peers.cc:597] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3485ff8d284d46bea80fa498e5f6d34a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:11.459761  1689 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:11.460421  2559 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.461199  2552 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.471892  2559 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.475878  1613 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.478024  1689 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.485222  1616 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:11.492839  1585 consensus_peers.cc:597] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a0b1eaf4f774ec3b24c196f0234dff9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:11.494251  1443 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.495198  1689 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:11.502302  2557 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.496833  1544 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:11.508096  2557 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.511101  2557 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.514937  1689 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.526638  1544 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.532212  1689 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:11.543301  1613 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:11.542550  1659 consensus_peers.cc:597] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96e20996757d4784ade11fe9799f7a13. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:11.541256  1443 catalog_manager.cc:5697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:11.545117  2591 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.547349  1541 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:11.553795  2477 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.577455  1613 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.578855  2477 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.581187  1544 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.593540  1541 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:11.601352  1440 catalog_manager.cc:5697] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 12:59:11.602192  1510 consensus_peers.cc:597] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69b3c7e5df794f4baecc6be830fb8f80. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:11.606127  1689 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:11.607084  1616 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:11.608577  2588 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.610371  2588 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.619117  2552 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.620668  1689 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.640470  1439 catalog_manager.cc:5697] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.651201  1613 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:11.868600  2637 ts_tablet_manager.cc:933] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:11.871487  2637 tablet_copy_client.cc:323] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:11.872972  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 3485ff8d284d46bea80fa498e5f6d34a from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:11.873394  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 3485ff8d284d46bea80fa498e5f6d34a from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-3485ff8d284d46bea80fa498e5f6d34a
I20260709 12:59:11.878963  1554 tablet_copy_source_session.cc:215] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:11.881608  2637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3485ff8d284d46bea80fa498e5f6d34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:11.892302  2637 tablet_copy_client.cc:806] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:11.892865  2637 tablet_copy_client.cc:670] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:11.896366  2637 tablet_copy_client.cc:538] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:11.906554  2637 tablet_bootstrap.cc:492] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:11.928269  2637 tablet_bootstrap.cc:492] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:11.929208  2637 tablet_bootstrap.cc:492] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:11.929908  2637 ts_tablet_manager.cc:1403] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.015s
I20260709 12:59:11.932816  2637 raft_consensus.cc:359] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:11.933990  2637 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:11.934691  2637 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:11.937930  2637 ts_tablet_manager.cc:1434] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:59:11.940557  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-3485ff8d284d46bea80fa498e5f6d34a received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:11.940984  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-3485ff8d284d46bea80fa498e5f6d34a on tablet 3485ff8d284d46bea80fa498e5f6d34a with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:12.051785  2637 ts_tablet_manager.cc:933] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:12.053745  2637 tablet_copy_client.cc:323] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:12.057061  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 8a0b1eaf4f774ec3b24c196f0234dff9 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:59:12.057525  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 8a0b1eaf4f774ec3b24c196f0234dff9 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-8a0b1eaf4f774ec3b24c196f0234dff9
I20260709 12:59:12.063349  1630 tablet_copy_source_session.cc:215] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:12.066323  2637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0b1eaf4f774ec3b24c196f0234dff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:12.082247  2637 tablet_copy_client.cc:806] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:12.082844  2637 tablet_copy_client.cc:670] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:12.086416  2637 tablet_copy_client.cc:538] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:12.094954  2637 tablet_bootstrap.cc:492] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:12.144011  2637 tablet_bootstrap.cc:492] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:12.144940  2637 tablet_bootstrap.cc:492] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:12.145689  2637 ts_tablet_manager.cc:1403] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.021s
I20260709 12:59:12.151115  2637 raft_consensus.cc:359] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:12.153363  2637 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:12.154057  2637 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:12.157104  2637 ts_tablet_manager.cc:1434] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:59:12.162488  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-8a0b1eaf4f774ec3b24c196f0234dff9 received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:12.162909  2643 ts_tablet_manager.cc:933] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:12.162930  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-8a0b1eaf4f774ec3b24c196f0234dff9 on tablet 8a0b1eaf4f774ec3b24c196f0234dff9 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:12.170181  2637 ts_tablet_manager.cc:933] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:12.172657  2637 tablet_copy_client.cc:323] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:12.175175  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 69b3c7e5df794f4baecc6be830fb8f80 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:12.175845  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 69b3c7e5df794f4baecc6be830fb8f80 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-69b3c7e5df794f4baecc6be830fb8f80
I20260709 12:59:12.183885  2643 tablet_copy_client.cc:323] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:12.185556  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet 96e20996757d4784ade11fe9799f7a13 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:12.186085  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet 96e20996757d4784ade11fe9799f7a13 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-96e20996757d4784ade11fe9799f7a13
I20260709 12:59:12.186058  1554 tablet_copy_source_session.cc:215] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:12.191238  2637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b3c7e5df794f4baecc6be830fb8f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:12.193058  1704 tablet_copy_source_session.cc:215] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:12.198536  2643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e20996757d4784ade11fe9799f7a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:12.204869  2637 tablet_copy_client.cc:806] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:12.205294  2637 tablet_copy_client.cc:670] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:12.208432  2637 tablet_copy_client.cc:538] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:12.214495  2643 tablet_copy_client.cc:806] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:12.215133  2643 tablet_copy_client.cc:670] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:12.219183  2637 tablet_bootstrap.cc:492] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:12.221388  2643 tablet_copy_client.cc:538] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:12.235073  2643 tablet_bootstrap.cc:492] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:12.250798  2637 tablet_bootstrap.cc:492] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:12.251724  2637 tablet_bootstrap.cc:492] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:12.252701  2637 ts_tablet_manager.cc:1403] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.009s
I20260709 12:59:12.256238  2637 raft_consensus.cc:359] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:12.257112  2643 tablet_bootstrap.cc:492] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:12.257051  2637 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:12.257952  2643 tablet_bootstrap.cc:492] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:12.257787  2637 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:12.258608  2643 ts_tablet_manager.cc:1403] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 12:59:12.260720  2637 ts_tablet_manager.cc:1434] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:12.272109  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-69b3c7e5df794f4baecc6be830fb8f80 received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:12.272509  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-69b3c7e5df794f4baecc6be830fb8f80 on tablet 69b3c7e5df794f4baecc6be830fb8f80 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:12.261420  2643 raft_consensus.cc:359] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:12.273756  2643 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:12.274487  2643 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:12.276789  2643 ts_tablet_manager.cc:1434] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.004s
I20260709 12:59:12.279738  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-96e20996757d4784ade11fe9799f7a13 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:12.280164  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-96e20996757d4784ade11fe9799f7a13 on tablet 96e20996757d4784ade11fe9799f7a13 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:12.345129  2274 raft_consensus.cc:1217] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:12.632333  2274 raft_consensus.cc:1217] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:12.642343  2274 raft_consensus.cc:1217] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:12.714260  2274 raft_consensus.cc:1217] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:12.841493  2645 raft_consensus.cc:1064] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:12.848409  2645 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:12.864979  2274 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:12.866889  2559 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:12.875689  1685 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:12.878774  1617 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:12.877331  2559 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:59:12.883010  2654 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:12.905480  2655 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:12.908404  1685 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:12.907133  2274 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:12.943487  1617 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:12.947190  1439 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.049094  2627 raft_consensus.cc:1064] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:13.052377  2627 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:13.073537  2277 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:13.075896  1541 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:13.076815  1685 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:13.078536  2557 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.079274  2627 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.084400  2557 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.104489  2557 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.106396  2274 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.116698  1685 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.110172  1544 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:13.139145  2274 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:13.129881  1442 catalog_manager.cc:5697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.140424  2654 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:13.142064  1617 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:13.147452  2654 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:13.156236  2645 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.163034  1617 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.168967  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3485ff8d284d46bea80fa498e5f6d34a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:13.170145  2276 raft_consensus.cc:2955] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.186153  2591 raft_consensus.cc:1064] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:13.187404  1613 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:13.187891  1442 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:13.196291  2274 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:13.197585  2627 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:13.198094  1689 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:13.201100  2557 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:13.203285  1544 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.208012  2649 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.202171  2591 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:13.228041  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet 3485ff8d284d46bea80fa498e5f6d34a with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:13.222368  2274 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.243039  2559 raft_consensus.cc:1064] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:13.245815  2559 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:13.259439  2670 tablet_replica.cc:333] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:13.268954  1686 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:13.271610  2655 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.273620  2274 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:13.274850  2559 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.286849  2670 raft_consensus.cc:2243] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:13.288555  1617 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:13.287755  2274 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:13.288630  2670 raft_consensus.cc:2272] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:13.292703  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 73448.2us
I20260709 12:59:13.295069  1544 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:13.291052  2591 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:13.296545  2651 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:13.296799  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a0b1eaf4f774ec3b24c196f0234dff9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:13.300948  2670 ts_tablet_manager.cc:1916] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:13.303979  2652 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:13.304167  1689 raft_consensus.cc:2955] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.310544  1442 catalog_manager.cc:5697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:13.322572  1613 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:13.329062  2559 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.331701  1686 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.339830  2277 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.342024  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a0b1eaf4f774ec3b24c196f0234dff9 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:13.345225  2631 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.348380  1613 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.362421  2559 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.362211  1442 catalog_manager.cc:5697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:13.368508  2274 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.373639  1544 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.386013  1442 catalog_manager.cc:5697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:13.393759  2678 tablet_replica.cc:333] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:13.394974  2678 raft_consensus.cc:2243] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:13.395570  2678 raft_consensus.cc:2272] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:13.423142  1619 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.419188  1689 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:13.429919  2678 ts_tablet_manager.cc:1916] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:13.432364  2274 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:13.432906  1544 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:13.433610  2631 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:13.434405  2591 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:13.445326  2591 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.458388  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96e20996757d4784ade11fe9799f7a13 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:13.448797  1541 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.458740  2670 ts_tablet_manager.cc:1929] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:13.459318  2670 log.cc:1199] T 3485ff8d284d46bea80fa498e5f6d34a P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/3485ff8d284d46bea80fa498e5f6d34a
I20260709 12:59:13.449596  2274 raft_consensus.cc:2955] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.465340  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet 3485ff8d284d46bea80fa498e5f6d34a (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:13.468807  1440 catalog_manager.cc:5697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:13.471021  2678 ts_tablet_manager.cc:1929] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:13.471513  2678 log.cc:1199] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/8a0b1eaf4f774ec3b24c196f0234dff9
I20260709 12:59:13.474982  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet 8a0b1eaf4f774ec3b24c196f0234dff9 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:13.485267  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet 96e20996757d4784ade11fe9799f7a13 with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:13.493829  2680 tablet_replica.cc:333] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:13.495179  2680 raft_consensus.cc:2243] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:13.495970  2680 raft_consensus.cc:2272] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:13.499665  2680 ts_tablet_manager.cc:1916] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:13.514561  2680 ts_tablet_manager.cc:1929] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:13.514976  2680 log.cc:1199] T 96e20996757d4784ade11fe9799f7a13 P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/96e20996757d4784ade11fe9799f7a13
I20260709 12:59:13.516608  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet 96e20996757d4784ade11fe9799f7a13 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:13.752820  1541 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:13.756500  2274 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:13.756564  1619 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:13.757812  2667 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:13.758605  2559 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:13.763127  2667 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.764842  1619 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.767693  2277 raft_consensus.cc:2955] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.774559  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 69b3c7e5df794f4baecc6be830fb8f80 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:13.784690  1440 catalog_manager.cc:5697] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:13.798719  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet 69b3c7e5df794f4baecc6be830fb8f80 with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:13.799806  2670 tablet_replica.cc:333] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:13.801366  2670 raft_consensus.cc:2243] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:13.802114  2670 raft_consensus.cc:2272] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:13.805862  2670 ts_tablet_manager.cc:1916] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:13.817854  2670 ts_tablet_manager.cc:1929] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:13.818138  2670 log.cc:1199] T 69b3c7e5df794f4baecc6be830fb8f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/69b3c7e5df794f4baecc6be830fb8f80
I20260709 12:59:13.819373  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet 69b3c7e5df794f4baecc6be830fb8f80 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:14.871286  1617 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:14.877367  1689 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:14.878527  1585 consensus_peers.cc:597] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0644dffc23e84f7da7f8c0aac9e1c859. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:14.879489  2681 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.880103  1541 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:14.882994  2681 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:14.888967  1686 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:14.887939  2649 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:14.897717  1541 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:14.901923  1442 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:14.914851  1686 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:14.923244  1617 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:14.924172  1659 consensus_peers.cc:597] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90bfe669a290453597d79375d2aadae5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:14.924619  2591 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.948531  1541 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:14.950119  2591 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:14.953608  1617 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:14.962502  2591 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.980592  1686 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:14.982978  1544 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:14.984668  1443 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:14.992218  1659 consensus_peers.cc:597] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35e8bc6e059f4dc3b59e584357979e78. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:14.995751  1544 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.996239  1617 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.997375  2591 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.999105  2477 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:15.008239  2591 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:15.010645  1613 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:15.010367  1544 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:15.025167  1541 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:15.033507  1443 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:15.047176  1613 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:15.049019  1510 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce9fc6a855e249298263a94d04de35a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:15.049160  1686 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:15.050161  2559 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:15.051002  2682 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:15.060891  2667 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:15.062773  1686 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:15.080504  1440 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:15.086076  1613 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:15.313540  2702 ts_tablet_manager.cc:933] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:15.315570  2702 tablet_copy_client.cc:323] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:15.317481  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet 90bfe669a290453597d79375d2aadae5 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:15.317912  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet 90bfe669a290453597d79375d2aadae5 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-90bfe669a290453597d79375d2aadae5
I20260709 12:59:15.323796  1704 tablet_copy_source_session.cc:215] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:15.326978  2702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bfe669a290453597d79375d2aadae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:15.341073  2702 tablet_copy_client.cc:806] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:15.341607  2702 tablet_copy_client.cc:670] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:15.350965  2702 tablet_copy_client.cc:538] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:15.358819  2702 tablet_bootstrap.cc:492] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:15.385587  2702 tablet_bootstrap.cc:492] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:15.386363  2702 tablet_bootstrap.cc:492] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:15.387094  2702 ts_tablet_manager.cc:1403] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.009s
I20260709 12:59:15.389935  2702 raft_consensus.cc:359] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:15.390921  2702 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:15.391916  2702 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:15.405056  2702 ts_tablet_manager.cc:1434] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 12:59:15.407575  2706 ts_tablet_manager.cc:933] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:15.407902  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-90bfe669a290453597d79375d2aadae5 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:15.408396  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-90bfe669a290453597d79375d2aadae5 on tablet 90bfe669a290453597d79375d2aadae5 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:15.415189  2706 tablet_copy_client.cc:323] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:15.417042  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 0644dffc23e84f7da7f8c0aac9e1c859 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:59:15.417450  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 0644dffc23e84f7da7f8c0aac9e1c859 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-0644dffc23e84f7da7f8c0aac9e1c859
I20260709 12:59:15.422407  1630 tablet_copy_source_session.cc:215] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:15.426239  2706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0644dffc23e84f7da7f8c0aac9e1c859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:15.437641  2706 tablet_copy_client.cc:806] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:15.438203  2706 tablet_copy_client.cc:670] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:15.442248  2706 tablet_copy_client.cc:538] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:15.450443  2706 tablet_bootstrap.cc:492] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:15.469138  2706 tablet_bootstrap.cc:492] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:15.469872  2706 tablet_bootstrap.cc:492] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:15.470463  2706 ts_tablet_manager.cc:1403] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.020s	user 0.021s	sys 0.001s
I20260709 12:59:15.472841  2706 raft_consensus.cc:359] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:15.473616  2706 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:15.474206  2706 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:15.475970  2706 ts_tablet_manager.cc:1434] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:59:15.477720  2702 ts_tablet_manager.cc:933] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:15.478658  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-0644dffc23e84f7da7f8c0aac9e1c859 received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:15.479133  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-0644dffc23e84f7da7f8c0aac9e1c859 on tablet 0644dffc23e84f7da7f8c0aac9e1c859 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:15.481393  2702 tablet_copy_client.cc:323] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:15.482908  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet 35e8bc6e059f4dc3b59e584357979e78 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:15.483449  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet 35e8bc6e059f4dc3b59e584357979e78 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-35e8bc6e059f4dc3b59e584357979e78
I20260709 12:59:15.489629  1704 tablet_copy_source_session.cc:215] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:15.492205  2702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e8bc6e059f4dc3b59e584357979e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:15.503072  2702 tablet_copy_client.cc:806] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:15.503674  2702 tablet_copy_client.cc:670] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:15.507509  2702 tablet_copy_client.cc:538] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:15.515066  2702 tablet_bootstrap.cc:492] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:15.533676  2702 tablet_bootstrap.cc:492] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:15.534622  2702 tablet_bootstrap.cc:492] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:15.535349  2702 ts_tablet_manager.cc:1403] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.013s
I20260709 12:59:15.538295  2702 raft_consensus.cc:359] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:15.539202  2702 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:15.539903  2702 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:15.542328  2702 ts_tablet_manager.cc:1434] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:59:15.546907  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-35e8bc6e059f4dc3b59e584357979e78 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:15.547312  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-35e8bc6e059f4dc3b59e584357979e78 on tablet 35e8bc6e059f4dc3b59e584357979e78 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:15.557075  2702 ts_tablet_manager.cc:933] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:15.561718  2702 tablet_copy_client.cc:323] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:15.563238  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet ce9fc6a855e249298263a94d04de35a4 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:15.563706  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet ce9fc6a855e249298263a94d04de35a4 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-ce9fc6a855e249298263a94d04de35a4
I20260709 12:59:15.570220  1554 tablet_copy_source_session.cc:215] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:15.572897  2702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9fc6a855e249298263a94d04de35a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:15.595459  2702 tablet_copy_client.cc:806] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:15.596421  2702 tablet_copy_client.cc:670] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:15.599874  2702 tablet_copy_client.cc:538] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:15.606063  2702 tablet_bootstrap.cc:492] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:15.619938  2702 tablet_bootstrap.cc:492] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:15.620580  2702 tablet_bootstrap.cc:492] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:15.621080  2702 ts_tablet_manager.cc:1403] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.015s	user 0.015s	sys 0.000s
I20260709 12:59:15.623219  2702 raft_consensus.cc:359] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:15.623822  2702 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:15.624236  2702 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:15.625612  2702 ts_tablet_manager.cc:1434] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:15.627014  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-ce9fc6a855e249298263a94d04de35a4 received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:15.627346  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-ce9fc6a855e249298263a94d04de35a4 on tablet ce9fc6a855e249298263a94d04de35a4 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:15.715274  2274 raft_consensus.cc:1217] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:15.825110  2274 raft_consensus.cc:1217] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:15.939531  2274 raft_consensus.cc:1217] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:59:16.105489  2698 raft_consensus.cc:1064] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:16.107321  2698 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.112752  2274 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.114110  2591 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.114279  1617 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.117491  1544 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.118402  2591 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.119392  2698 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.126088  2276 raft_consensus.cc:1217] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:16.152808  2591 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.155663  1617 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.155997  1544 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.171113  2274 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.190156  1440 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.244205  1685 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.250922  1544 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:16.252398  2274 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:16.253661  2591 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.254993  2712 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.262344  2591 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.263545  2276 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.263906  1544 raft_consensus.cc:2955] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.271167  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90bfe669a290453597d79375d2aadae5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:16.284221  1439 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.289206  2681 raft_consensus.cc:1064] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:16.291878  2681 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.309669  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet 90bfe669a290453597d79375d2aadae5 with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:16.311605  2728 tablet_replica.cc:333] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:16.312701  2728 raft_consensus.cc:2243] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:16.313567  2728 raft_consensus.cc:2272] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:16.318842  2274 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.319698  2591 raft_consensus.cc:1064] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:16.320478  2684 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.320838  1685 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.321605  2591 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.322172  2715 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.323633  2728 ts_tablet_manager.cc:1916] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:16.327498  1541 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.329206  2715 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:16.347394  1617 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:16.347405  1544 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:16.345340  2274 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:16.349115  2720 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.350106  2712 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.351801  2698 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.367944  2681 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.376883  2728 ts_tablet_manager.cc:1929] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:16.376543  1685 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.377743  1541 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.388677  1538 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.392710  2276 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.387661  2720 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.404948  1439 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.409778  2728 log.cc:1199] T 90bfe669a290453597d79375d2aadae5 P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/90bfe669a290453597d79375d2aadae5
I20260709 12:59:16.413110  1442 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.413537  1613 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.414951  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet 90bfe669a290453597d79375d2aadae5 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:16.429447  2276 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.433037  1617 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.441636  1685 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:16.443182  2715 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.445987  1685 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.447657  2274 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:16.451454  2274 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:16.454123  2712 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.455039  1617 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:16.453903  2715 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.456354  2712 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.463271  2591 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.468166  2736 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.473289  1689 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.481600  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0644dffc23e84f7da7f8c0aac9e1c859 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:16.493672  2277 raft_consensus.cc:2955] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.495342  1613 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.496966  2275 raft_consensus.cc:2955] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.503067  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35e8bc6e059f4dc3b59e584357979e78 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:16.479616   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:16.520854  1440 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.525079  1439 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:16.532637  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e8bc6e059f4dc3b59e584357979e78 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:16.540881  1529 tablet_service.cc:1558] Processing DeleteTablet for tablet 0644dffc23e84f7da7f8c0aac9e1c859 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:16.552947  2737 tablet_replica.cc:333] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:16.553833  2737 raft_consensus.cc:2243] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:16.554358  2737 raft_consensus.cc:2272] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:16.569120  2737 ts_tablet_manager.cc:1916] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:16.585218  2737 ts_tablet_manager.cc:1929] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:59:16.585610  2737 log.cc:1199] T 35e8bc6e059f4dc3b59e584357979e78 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/35e8bc6e059f4dc3b59e584357979e78
I20260709 12:59:16.587182  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet 35e8bc6e059f4dc3b59e584357979e78 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:16.587337  2737 tablet_replica.cc:333] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:16.588241  2737 raft_consensus.cc:2243] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:16.588946  2737 raft_consensus.cc:2272] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:16.593228  2737 ts_tablet_manager.cc:1916] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:16.611488  2737 ts_tablet_manager.cc:1929] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:16.611821  2737 log.cc:1199] T 0644dffc23e84f7da7f8c0aac9e1c859 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/0644dffc23e84f7da7f8c0aac9e1c859
I20260709 12:59:16.612914  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet 0644dffc23e84f7da7f8c0aac9e1c859 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:16.617251  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:16.617897  1689 raft_consensus.cc:606] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:16.628845  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:16.629287  1538 raft_consensus.cc:606] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:16.631549  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:16.631946  1541 raft_consensus.cc:606] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:16.634119  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:16.634586  1541 raft_consensus.cc:606] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:16.636790  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:16.637254  1541 raft_consensus.cc:606] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:16.650900  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f61c89956d24976b4d464550172cd55"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:16.651322  1617 raft_consensus.cc:606] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:16.653617  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:16.653986  1541 raft_consensus.cc:606] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:16.654836   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:59:16.656262   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:16.675386  2667 raft_consensus.cc:1064] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:16.677052  2667 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.687816  1685 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.688038  2277 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.687836  1617 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.689425  2723 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.690234  2714 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.691107  2667 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.712638  2722 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.721244  1613 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.742890  1443 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.743235  2277 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.742451  1685 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.774530  1538 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.782112  2275 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:16.782202  1617 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:16.785497  2723 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.787839  2723 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.789561  2723 raft_consensus.cc:993] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:16.791059  2682 raft_consensus.cc:1081] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:16.792520  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53910
I20260709 12:59:16.793033  1613 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.793351  1613 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.792685  2682 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.795219  1617 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.798403  2275 raft_consensus.cc:2955] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.799310  1613 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:16.802240  1613 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:16.805764  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:16.806329  1538 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:16.806617  1538 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:16.807781  1538 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:16.808755  1538 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.811944  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ce9fc6a855e249298263a94d04de35a4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:16.813397  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:16.813872  1685 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.835319  1685 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:16.834735  1439 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:16.837304  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:16.838094  2736 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.839030  2736 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:16.839293  1538 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:16.839812  2736 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:16.849318  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet ce9fc6a855e249298263a94d04de35a4 with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:16.852902  2747 tablet_replica.cc:333] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:16.853948  2747 raft_consensus.cc:2243] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:16.854635  2747 raft_consensus.cc:2272] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:16.856927  2747 ts_tablet_manager.cc:1916] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:16.859174  1443 catalog_manager.cc:5697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.868834  2747 ts_tablet_manager.cc:1929] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:16.869189  2747 log.cc:1199] T ce9fc6a855e249298263a94d04de35a4 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/ce9fc6a855e249298263a94d04de35a4
I20260709 12:59:16.870328  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet ce9fc6a855e249298263a94d04de35a4 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:16.941581  2682 raft_consensus.cc:993] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:16.942075  2722 raft_consensus.cc:1081] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:16.943329  2275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45390
I20260709 12:59:16.943740  2275 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.943979  2275 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.949052  2275 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.951871  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:16.952127  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:16.952407  1538 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:16.952543  2275 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:16.952661  1689 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.952762  1538 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:16.953831  1538 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.954659  1538 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.956938  1689 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:16.957880  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:16.958413  1538 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:16.958629  2705 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.959573  2705 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:16.960333  2705 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:16.967160  1443 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.000834  2682 raft_consensus.cc:993] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:17.001292  2722 raft_consensus.cc:1081] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:17.002566  2275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45390
I20260709 12:59:17.003072  2275 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.003386  2275 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.007730  2275 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:17.009639  2275 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:17.010118  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:17.010520  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:17.010672  1538 raft_consensus.cc:3055] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.011046  1538 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:17.011065  1613 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.011746  1538 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:17.012812  1538 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.016848  1613 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:17.017750  1538 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:17.017750  2243 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:17.018658  2705 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:17.019136  2705 raft_consensus.cc:697] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:17.019868  2705 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:17.027107  1443 catalog_manager.cc:5697] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.066250  2722 raft_consensus.cc:993] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:17.066630  2682 raft_consensus.cc:1081] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:17.067773  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:52958
I20260709 12:59:17.068159  1689 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.068485  1689 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.073405  1689 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:17.074657  1689 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:17.075198  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:17.075511  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:17.075722  1613 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.076026  1538 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.076264  1538 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:17.076956  1538 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:17.078019  1538 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.080729  1613 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:17.082388  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:17.083058  2591 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:17.083691  2698 raft_consensus.cc:993] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:17.084048  2698 raft_consensus.cc:1081] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:17.084097  1538 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:17.084749  2591 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:17.085423  2274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45402
I20260709 12:59:17.085516  2591 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:17.085845  2274 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.086400  2274 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.093015  2274 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:17.095456  2274 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:17.096160  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:17.096284  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:17.096685  1613 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.096889  1689 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:17.097219  1689 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:17.097807  1689 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:17.098555  1689 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.099888  1443 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.102015  1613 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:17.103087  2243 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:17.104619  1689 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:17.108397  2705 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:17.108870  2705 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:17.109937  2682 raft_consensus.cc:993] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:17.109669  2705 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:17.110359  2723 raft_consensus.cc:1081] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:17.111863  1619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53910
I20260709 12:59:17.112308  1619 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.112602  1619 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.118469  1619 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:17.120545  1619 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:17.121446  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:17.121954  1538 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.122210  1538 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:17.122414  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:17.122880  1685 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.122843  1538 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:17.124188  1538 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.124367  2681 raft_consensus.cc:993] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:17.124816  2681 raft_consensus.cc:1081] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Signalling peer e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:17.126216  1443 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 3, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.129241  1685 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:17.129284  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f61c89956d24976b4d464550172cd55"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:52956
I20260709 12:59:17.130846  1689 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.131381  1689 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.132035  1538 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:17.130945  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:17.133625  2736 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:17.134050  2736 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:17.134899  2736 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:17.138124  1689 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:17.139870  1689 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:17.140846  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:17.141402  1538 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.140765  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:17.144958  1613 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.145263  1613 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:17.146176  1613 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:17.147337  1613 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.149086  1538 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:17.149991  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:17.150992  2698 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:17.151582  2698 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:17.151568  1443 catalog_manager.cc:5697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.152580  2698 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:17.153637  1613 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:17.163364  1440 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.322844  1685 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:17.324023  2736 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.334689  1538 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:17.336841  2681 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:17.387220  1538 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.388128  2705 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.400836  1685 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.402304  2705 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.402845  1538 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.405409  2705 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.426106  1613 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.427721  2705 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.542120  1685 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:17.543120  2764 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.560550  1613 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:17.561839  2705 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.597817  1544 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:17.599016  2698 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.604962  1687 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:17.606119  2756 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.611603  1619 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:17.613082  2698 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:17.622293  1544 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:17.623406  2736 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.648116  1544 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:17.650363  2712 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.657298   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:17.666927  1613 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:17.668426  2591 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.717770   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:17.749838  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:17.750355  1544 raft_consensus.cc:606] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:17.752622  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:17.753008  1687 raft_consensus.cc:606] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:17.754983  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:17.755450  1544 raft_consensus.cc:606] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:17.757572  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:17.758006  1544 raft_consensus.cc:606] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:17.760901  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:17.761309  1538 raft_consensus.cc:606] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:17.764326  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:17.764880  1538 raft_consensus.cc:606] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:17.767544  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:17.767987  1613 raft_consensus.cc:606] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:17.768935   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:59:17.769929   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:17.796141  2682 raft_consensus.cc:993] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:17.796563  2773 raft_consensus.cc:1081] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:17.797775  1619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53910
I20260709 12:59:17.798241  1619 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.798528  1619 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.802743  1619 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:17.804039  1619 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:17.804616  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:17.804811  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:17.805084  1538 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.805281  1685 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.805418  1538 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:17.806041  1538 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:17.806802  1538 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.809904  1685 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:17.810881  1584 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:17.811646  2756 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:17.812071  2756 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:17.812184  1538 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:17.812876  2756 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:17.821089  1439 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.911429  1538 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:17.916927  1619 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:17.916980  1510 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f81118a8e62c4910be3913ae0e3f240d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:17.917102  1687 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:17.918641  2773 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.919360  2682 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.931393  2682 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:17.934084  1687 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:17.934919  1613 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:17.942236  1619 consensus_queue.cc:237] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:17.948522  1439 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.957396  1538 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:17.957849  1585 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ece2ab6676aa475ba1e5a5d1b13fc569. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:17.957140  1687 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:17.960094  2756 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.961428  2779 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:17.972744  2681 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:17.975383  1538 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:17.978778  2682 raft_consensus.cc:993] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:17.979218  2773 raft_consensus.cc:1081] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:17.980588  2274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45390
I20260709 12:59:17.980976  2274 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.981293  2274 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.986138  1687 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:17.989319  1613 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:17.990175  1439 catalog_manager.cc:5697] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:17.993353  2274 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:17.995874  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:17.996381  1538 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.996644  1538 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:17.996599  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:17.997211  1619 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.997447  1538 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:17.998412  1538 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.007308  1538 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:18.008363  2241 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:18.009027  2764 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:18.009480  2764 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:18.010565  2764 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.014930  1619 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:18.017180  2274 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:18.018193  1585 consensus_peers.cc:597] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f35127b66604c1685f1fbe404840774. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:18.018360  1687 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:18.022532  2681 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.023447  2698 raft_consensus.cc:993] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:18.023918  2698 raft_consensus.cc:1081] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:18.025584  2275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45402
I20260709 12:59:18.026087  2275 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.026485  2275 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.034997  2275 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.034792  1538 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:18.038945  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:18.039551  1685 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:18.039884  1685 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:18.040535  1685 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.041486  1685 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.036993  2275 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:18.045426  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:18.045918  1538 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.046793  1440 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.047462  2681 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.054642  1685 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:18.057089  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:18.057421  1538 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:18.059935  2764 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:18.060925  2764 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:18.067178  2779 raft_consensus.cc:993] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:18.067660  2681 raft_consensus.cc:1081] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:18.069262  2274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45396
I20260709 12:59:18.069772  2274 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.069597  2764 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.070159  2274 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.070140  2779 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:18.072154  1544 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:18.083124  1687 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:18.078632  1685 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:18.086400  2274 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.088406  2274 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:18.088485  1440 catalog_manager.cc:5697] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.091279  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:18.092159  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:18.092615  1686 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.091854  1613 raft_consensus.cc:3055] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:18.105804  1613 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:18.106513  1613 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.107722  1613 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.099500  1686 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:18.111016  2241 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:18.111742  2748 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:18.112171  2748 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:18.112970  2748 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.129204  1613 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
W20260709 12:59:18.137458  1659 consensus_peers.cc:597] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0cd29b6c17d47e6bfaba57728b3b725. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:18.142855  2714 raft_consensus.cc:993] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:18.143314  2714 raft_consensus.cc:1081] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:18.143715  1613 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:18.145303  1538 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:18.146070  2274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45390
I20260709 12:59:18.154767  2274 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.155093  2274 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.154951  2591 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.156325  2591 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.161091  2274 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.163451  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:18.163987  1541 raft_consensus.cc:3055] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:18.164258  1541 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:18.166325  2274 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:18.166024  1541 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.167309  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:18.167884  1687 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.168069  1541 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.173049  1440 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.174558  1687 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:18.176120  1541 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:18.186086  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:18.186856  2773 raft_consensus.cc:993] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:18.187105  2764 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:18.187397  2773 raft_consensus.cc:1081] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:18.187901  2764 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:18.188795  2764 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.189414  2275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45390
I20260709 12:59:18.190009  2275 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.189311  2591 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:18.190331  2275 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.192251  1613 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:18.196595  2275 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.199697  2275 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:18.201169  1538 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:18.206976  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:18.207480  1541 raft_consensus.cc:3055] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:18.207749  1541 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:18.208360  1541 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.209440  1541 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.210806  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:18.211337  1687 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.214795  1440 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.218883  1541 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:18.220043  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:18.221019  2764 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:18.221514  2764 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:18.222323  2764 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:18.225845  1687 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:18.227053  1442 catalog_manager.cc:5697] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.228904  1442 catalog_manager.cc:5697] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.250249  1442 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.272082  1538 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:18.273056  2756 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.284296  2773 raft_consensus.cc:993] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:18.284754  2714 raft_consensus.cc:1081] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:18.286108  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53910
I20260709 12:59:18.286556  1613 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.286895  1613 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.288589  1687 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:18.292268  2756 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.292243  1613 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:18.308995  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:18.309469  1541 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:18.309739  1541 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:18.309991  1613 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:18.310393  1541 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:18.311539  1541 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.313702  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:18.314250  1687 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.320727  1687 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:18.321285  1541 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:18.321681  1584 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:18.322407  2681 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:18.322829  2681 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:18.323498  2681 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:18.335723  1440 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.407130  1538 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.408293  2764 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.420148  1619 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.421528  2764 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.454993  2806 ts_tablet_manager.cc:933] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:18.456678  2806 tablet_copy_client.cc:323] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:18.457871  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet ece2ab6676aa475ba1e5a5d1b13fc569 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:59:18.458248  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet ece2ab6676aa475ba1e5a5d1b13fc569 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-ece2ab6676aa475ba1e5a5d1b13fc569
I20260709 12:59:18.463689  1630 tablet_copy_source_session.cc:215] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:18.466361  2806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece2ab6676aa475ba1e5a5d1b13fc569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:18.478850  2806 tablet_copy_client.cc:806] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:18.479380  2806 tablet_copy_client.cc:670] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:18.482375  2806 tablet_copy_client.cc:538] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:18.490574  2806 tablet_bootstrap.cc:492] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:18.493327  1687 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.494941  2764 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.500907  2809 ts_tablet_manager.cc:933] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:18.514041  1538 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.529309  2748 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.564141  1687 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.565665  2748 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:18.582612  2809 tablet_copy_client.cc:323] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:18.585122  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet f81118a8e62c4910be3913ae0e3f240d from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:18.585582  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet f81118a8e62c4910be3913ae0e3f240d from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-f81118a8e62c4910be3913ae0e3f240d
I20260709 12:59:18.590790  1687 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.592324  2748 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.592731  1554 tablet_copy_source_session.cc:215] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:18.597056  2809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81118a8e62c4910be3913ae0e3f240d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:18.599647  2806 tablet_bootstrap.cc:492] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:18.602111  2806 tablet_bootstrap.cc:492] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:18.602779  2806 ts_tablet_manager.cc:1403] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.112s	user 0.035s	sys 0.023s
I20260709 12:59:18.618712  1619 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.615592  1538 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.620476  2764 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.632321  2705 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.688828  2809 tablet_copy_client.cc:806] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:18.690009  2809 tablet_copy_client.cc:670] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
W20260709 12:59:18.709514  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 66158.5us
I20260709 12:59:18.682973  2806 raft_consensus.cc:359] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:18.723084  2809 tablet_copy_client.cc:538] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:18.723474  2806 raft_consensus.cc:740] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:18.724195  2806 consensus_queue.cc:260] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:18.726296  1541 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.726429  2815 ts_tablet_manager.cc:933] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:18.730415  2821 ts_tablet_manager.cc:933] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:18.735368  2817 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:18.736640  2809 tablet_bootstrap.cc:492] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:18.739539  2806 ts_tablet_manager.cc:1434] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.136s	user 0.002s	sys 0.004s
I20260709 12:59:18.741072  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-ece2ab6676aa475ba1e5a5d1b13fc569 received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:18.741806  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-ece2ab6676aa475ba1e5a5d1b13fc569 on tablet ece2ab6676aa475ba1e5a5d1b13fc569 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:18.752775  2821 tablet_copy_client.cc:323] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:18.754565  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet c0cd29b6c17d47e6bfaba57728b3b725 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:18.755079  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet c0cd29b6c17d47e6bfaba57728b3b725 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-c0cd29b6c17d47e6bfaba57728b3b725
I20260709 12:59:18.761222  1686 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.763226  2705 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.766960  1704 tablet_copy_source_session.cc:215] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:18.778759   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:18.791771  2815 tablet_copy_client.cc:323] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:18.792026  2821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0cd29b6c17d47e6bfaba57728b3b725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:18.793140  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 1f35127b66604c1685f1fbe404840774 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:59:18.793620  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 1f35127b66604c1685f1fbe404840774 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-1f35127b66604c1685f1fbe404840774
I20260709 12:59:18.804567  1630 tablet_copy_source_session.cc:215] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:18.808830  2815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f35127b66604c1685f1fbe404840774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:18.819543  2809 tablet_bootstrap.cc:492] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:18.824534  2809 tablet_bootstrap.cc:492] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:18.825217  2809 ts_tablet_manager.cc:1403] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.033s
I20260709 12:59:18.827694  2809 raft_consensus.cc:359] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:18.828505  2809 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:18.829099  2809 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:18.833879  2809 ts_tablet_manager.cc:1434] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:59:18.835348  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-f81118a8e62c4910be3913ae0e3f240d received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:18.835736  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-f81118a8e62c4910be3913ae0e3f240d on tablet f81118a8e62c4910be3913ae0e3f240d with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:18.846971  2821 tablet_copy_client.cc:806] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:18.847534  2821 tablet_copy_client.cc:670] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:18.852648  2815 tablet_copy_client.cc:806] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:18.853152  2815 tablet_copy_client.cc:670] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:18.856223  2821 tablet_copy_client.cc:538] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:18.858949  2815 tablet_copy_client.cc:538] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:18.864200  2821 tablet_bootstrap.cc:492] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:18.872866  1687 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:18.874495  2756 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.882937  2815 tablet_bootstrap.cc:492] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:18.884449   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:18.899565  2821 tablet_bootstrap.cc:492] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:18.900416  2821 tablet_bootstrap.cc:492] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:18.905900  1541 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:18.907711  2821 ts_tablet_manager.cc:1403] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.019s
I20260709 12:59:18.908010  2756 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.914522  2274 raft_consensus.cc:1217] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:18.922652  2821 raft_consensus.cc:359] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:18.925909  2821 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:18.934137  2821 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:18.957299  2821 ts_tablet_manager.cc:1434] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.002s
I20260709 12:59:18.958768  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-c0cd29b6c17d47e6bfaba57728b3b725 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:18.959129  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-c0cd29b6c17d47e6bfaba57728b3b725 on tablet c0cd29b6c17d47e6bfaba57728b3b725 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:18.970984  2815 tablet_bootstrap.cc:492] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:18.971758  2815 tablet_bootstrap.cc:492] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:18.973879  2815 ts_tablet_manager.cc:1403] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.004s
I20260709 12:59:18.979475  2815 raft_consensus.cc:359] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:18.980244  2815 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:18.980850  2815 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:18.983497  2815 ts_tablet_manager.cc:1434] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:59:18.985260  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-1f35127b66604c1685f1fbe404840774 received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:18.985623  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-1f35127b66604c1685f1fbe404840774 on tablet 1f35127b66604c1685f1fbe404840774 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:18.997228  2274 raft_consensus.cc:1217] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:59:18.997726  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:18.998351  1619 raft_consensus.cc:606] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:19.002218  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:19.002708  1619 raft_consensus.cc:606] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:19.005527  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:19.006026  1685 raft_consensus.cc:606] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:19.007118   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:19.008585   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:19.114868  2823 raft_consensus.cc:993] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:19.115342  2698 raft_consensus.cc:1081] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:19.117842  2274 raft_consensus.cc:1217] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:19.118019  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53894
I20260709 12:59:19.118556  1613 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.118901  1613 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.132894  1613 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:19.134411  1613 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:19.134913  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:19.135437  1538 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.139410  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:19.139990  1685 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.140036  1538 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:19.140341  1685 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:19.141134  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:19.141088  1685 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:19.141872  2756 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.142220  1685 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.142282  2756 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:19.143402  2756 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:19.150928  1685 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:19.153069  1442 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.197093  2274 raft_consensus.cc:1217] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:19.321277  2756 raft_consensus.cc:993] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:19.321782  2681 raft_consensus.cc:1081] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:19.323458  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38018
I20260709 12:59:19.323922  1541 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.324138  1541 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.328397  1541 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:19.329687  1541 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:19.330422  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:19.330586  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:19.331007  1613 raft_consensus.cc:3055] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.331125  1685 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.331358  1613 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:19.332056  1613 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:19.332974  1613 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.336022  1685 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:19.338828  1509 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:19.339996  1613 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:19.340834  2832 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.341341  2832 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:19.342118  2832 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:19.356526  1440 catalog_manager.cc:5697] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.379437  2714 raft_consensus.cc:1064] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:19.381623  2714 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:19.387878  2756 raft_consensus.cc:993] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:19.388299  2756 raft_consensus.cc:1081] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:19.390365  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38018
I20260709 12:59:19.390847  1538 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.391176  1538 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.397123  2274 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:19.398823  2682 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.399500  1538 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:19.400595  1685 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:19.406849  1538 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:19.409776  1619 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:19.410236  2832 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.412786  2682 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.407438  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:19.407678  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:19.415781  1685 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.421370  2714 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.422953  1685 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:19.425221  1613 raft_consensus.cc:3055] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.425544  1613 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:19.424901  1619 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.427357  1509 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:19.428086  1613 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:19.429144  1613 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.428493  1687 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.430615  2839 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.431090  2839 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:19.431861  2839 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:19.449187  2274 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.464588  1613 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:19.477355  1442 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.497455  1538 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:19.501780  2274 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:19.502921  2682 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:19.503063  1442 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.506532  1687 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:19.508649  2839 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:19.510522  2843 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.518342  2275 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.522729  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f81118a8e62c4910be3913ae0e3f240d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:19.533977  1687 raft_consensus.cc:2955] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.538707  1442 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.549202  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet f81118a8e62c4910be3913ae0e3f240d with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:19.550633  2779 raft_consensus.cc:1064] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:19.551749  2847 tablet_replica.cc:333] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:19.552644  2847 raft_consensus.cc:2243] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:19.552955  2779 consensus_queue.cc:237] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:19.553506  2847 raft_consensus.cc:2272] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:19.559978  2591 raft_consensus.cc:1064] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:19.561414  2847 ts_tablet_manager.cc:1916] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:19.561961  2591 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:19.588521  2847 ts_tablet_manager.cc:1929] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:19.588982  2847 log.cc:1199] T f81118a8e62c4910be3913ae0e3f240d P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/f81118a8e62c4910be3913ae0e3f240d
I20260709 12:59:19.589226  2275 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:19.590495  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet f81118a8e62c4910be3913ae0e3f240d (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:19.590626  2823 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.598867  1544 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:19.600942  1619 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:19.601303  2591 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.604243  1686 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:19.608104  1544 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:19.608889  2274 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:19.611326  2698 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.611984  2681 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.633997  1686 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.634897  2698 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.639238  1538 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.640112  2779 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.642501  2779 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.641947  1538 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.646160  2681 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.646766  2756 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.649117  1619 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.638267  2274 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.654516  2756 raft_consensus.cc:1064] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:19.657081  2756 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:19.661345  1442 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.694115  2274 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:19.695658  2850 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.696125  1687 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:19.706178  1619 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:19.706643  2275 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:19.709120  1687 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:19.709408  2591 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:19.710908  2591 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:19.712320  1544 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:19.720683  2756 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.726799  2850 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.728240  2823 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.739189  1619 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.743608  2275 raft_consensus.cc:2955] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.756218  2277 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.757972  1687 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.763895  2714 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:19.764834  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 49807.7us
I20260709 12:59:19.769011  1442 catalog_manager.cc:5697] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.771498  2756 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.785689  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c0cd29b6c17d47e6bfaba57728b3b725 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:19.786309  1442 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.797308  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet c0cd29b6c17d47e6bfaba57728b3b725 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:19.797215  1689 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.804450  1545 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.859050  2756 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.890457  2871 tablet_replica.cc:333] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:19.891359  2871 raft_consensus.cc:2243] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:19.892038  2871 raft_consensus.cc:2272] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:19.944608  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48820.8us
I20260709 12:59:19.972601  2871 ts_tablet_manager.cc:1916] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:19.996877  1612 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.978878  1689 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.990453  2277 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:19.994359  1613 consensus_queue.cc:237] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:20.003304  2275 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:20.004901  2864 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:20.009501   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:20.011372  2865 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.012853  2275 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.036305  1443 catalog_manager.cc:5697] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.037956  2871 ts_tablet_manager.cc:1929] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:20.038417  2871 log.cc:1199] T c0cd29b6c17d47e6bfaba57728b3b725 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/c0cd29b6c17d47e6bfaba57728b3b725
I20260709 12:59:20.041692  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet c0cd29b6c17d47e6bfaba57728b3b725 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:20.048297  2832 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.049535  1691 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.054091  2839 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.058504  1442 catalog_manager.cc:5697] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.073843  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet ece2ab6676aa475ba1e5a5d1b13fc569 with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:20.077950  2875 tablet_replica.cc:333] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:20.078821  1538 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:20.079484  2875 raft_consensus.cc:2243] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.087741  2875 raft_consensus.cc:2272] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.090229  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ece2ab6676aa475ba1e5a5d1b13fc569 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:20.091193  2875 ts_tablet_manager.cc:1916] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:20.094565  1538 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.112856  2875 ts_tablet_manager.cc:1929] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:59:20.113334  2875 log.cc:1199] T ece2ab6676aa475ba1e5a5d1b13fc569 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/ece2ab6676aa475ba1e5a5d1b13fc569
I20260709 12:59:20.117314  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet ece2ab6676aa475ba1e5a5d1b13fc569 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:20.122787  1617 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.142133  2843 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.147226  2681 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:20.147866  1619 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:20.149298   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:20.152707  2275 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:20.154026  2850 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:20.160982  2681 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.163460  2275 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.181238  1691 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:20.182160  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f35127b66604c1685f1fbe404840774 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:20.184201  1540 raft_consensus.cc:2955] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.187994  1442 catalog_manager.cc:5697] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.201830  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f35127b66604c1685f1fbe404840774 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:20.202725  2871 tablet_replica.cc:333] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:20.203274  2864 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:20.203621  2871 raft_consensus.cc:2243] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.204741  2871 raft_consensus.cc:2272] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.207824  2871 ts_tablet_manager.cc:1916] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:20.209703  1691 raft_consensus.cc:2955] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:20.233719  2871 ts_tablet_manager.cc:1929] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:20.234090  2871 log.cc:1199] T 1f35127b66604c1685f1fbe404840774 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/1f35127b66604c1685f1fbe404840774
I20260709 12:59:20.235181  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:20.235704  1538 raft_consensus.cc:606] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:20.237828  2843 raft_consensus.cc:993] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:20.238210  2843 raft_consensus.cc:1081] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:20.239542  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53910
I20260709 12:59:20.240057  1613 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.239109  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet 1f35127b66604c1685f1fbe404840774 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:20.240370  1613 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.240813  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b4609f4058b459f804e03408773bd69"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:20.241321  1619 raft_consensus.cc:606] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:20.243928  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:20.244464  1538 raft_consensus.cc:606] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:20.245945  2681 raft_consensus.cc:993] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:20.246297  2681 raft_consensus.cc:1081] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:20.246196  1613 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:20.247385  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:20.247686  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b4609f4058b459f804e03408773bd69"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38018
I20260709 12:59:20.247948  1691 raft_consensus.cc:606] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:20.248158  1540 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.248490  1540 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.248777  1613 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:20.249480  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:20.250022  1691 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.251513  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:20.251924  1538 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:20.252156  1538 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:20.252748  1538 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:20.253556  1538 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.254576  1540 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:20.256798  1691 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:20.257500  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:20.257910  2275 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.258896  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:20.259451  1613 raft_consensus.cc:606] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:20.259375  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:20.260710  1538 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:20.261070  2756 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:20.261507  2756 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:20.262110  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:20.262611  1613 raft_consensus.cc:3055] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:20.262271  2756 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:20.262928  1613 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:20.263193  2275 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:20.263933  1540 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:20.263552  1613 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:20.264259  1510 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:20.265283  2843 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:20.265723  2843 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:20.266487  2843 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:20.270025  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53120c1adf947fd992e5950edf26301"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:20.270505  1538 raft_consensus.cc:606] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:20.265441  1613 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.271462   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:20.273058   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:20.275899  1613 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:20.281491  1443 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:20.285259  1442 catalog_manager.cc:5697] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:20.322695  2856 raft_consensus.cc:993] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:20.323153  2698 raft_consensus.cc:1081] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:20.324333  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53894
I20260709 12:59:20.324450  2832 raft_consensus.cc:993] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:20.324810  1613 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.324986  2843 raft_consensus.cc:1081] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:20.325238  1613 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.326375  2275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45390
I20260709 12:59:20.326924  2275 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.327247  2275 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.331379  1613 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:20.333213  1613 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:20.333158  2275 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:20.334051  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:20.334940  2275 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:20.334761  1689 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:20.335373  1689 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:20.335681  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:20.336180  1613 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.336231  1689 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:20.337133  1689 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.338994  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:20.339485  1540 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:20.339742  1540 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:20.340442  1540 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:20.341275  1689 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:20.341382  1613 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:20.341542  1540 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.342219  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:20.334051  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:20.342926  1538 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.342945  2756 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:20.343117  2243 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:20.343592  2756 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:20.344136  2863 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:20.344353  2756 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:20.347082  1540 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:20.348692  1538 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:20.351120  2863 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:20.352730  2863 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:20.363767  1442 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:20.364964  1443 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:20.709435  2275 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:20.709698  2756 raft_consensus.cc:993] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:20.710206  2681 raft_consensus.cc:1081] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:20.710711  2832 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:20.711596  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38018
I20260709 12:59:20.712066  1540 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.712383  1540 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.718123  1540 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:20.720427  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:20.720633  1540 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:20.720940  1619 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:20.721228  1619 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:20.721900  1619 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:20.722837  1619 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.722689  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:20.723417  1691 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.727314  1619 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:20.728391  1511 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:20.729138  2832 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:20.729527  2832 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:20.730412  2832 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:20.730919  1691 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:20.732893  1619 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:20.734287  2843 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:20.741613  1613 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:20.745872  2880 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:20.756191  2832 raft_consensus.cc:993] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:20.756573  2843 raft_consensus.cc:1081] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:20.758227  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d53120c1adf947fd992e5950edf26301"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:52958
I20260709 12:59:20.758297  1691 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:20.757354  1443 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 2 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:20.758832  1689 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.759286  1689 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.761276  1540 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:20.761564  2681 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.764389  2863 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:20.766986  1689 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:20.772176  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:20.772671  1613 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.773113  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:20.773699  1538 raft_consensus.cc:3055] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:20.774073  1538 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:20.774853  1538 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:20.779278  1689 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:20.784085  1613 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:20.787065  1660 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:20.788105  1538 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.789471  2856 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:20.790762  2856 raft_consensus.cc:697] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:20.791546  2856 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:20.799119  1538 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:20.800253  1540 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:20.801371  2864 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.820091  1439 catalog_manager.cc:5697] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:20.866487  1540 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.867441  1691 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.868964  2864 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.869542  2681 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:21.206863  1691 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:21.207593  1613 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:21.208042  2832 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:21.208741  2889 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:21.231307  1613 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:21.232610  2698 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:21.245646  1540 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:21.247015  2698 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:21.275761   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:21.332902  1540 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:21.337769  1689 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:21.338043  1613 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:21.339306  2889 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:21.340883  2843 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:59:21.343336  1510 consensus_peers.cc:597] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a483be3e3ee4d5381336b0877760ca9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:21.343885   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:21.345585  2714 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.349591  1689 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.359508  1619 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.368830  1439 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 4, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.380899  1617 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:21.405315  1585 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a0105ba6bf14860a95121a73725f62e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:21.406874  1691 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:21.408921  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:21.409276  1538 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:21.409422  1540 raft_consensus.cc:606] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:21.411090  2864 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:21.411900  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f35127b66604c1685f1fbe404840774"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:21.412420  1617 raft_consensus.cc:606] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:21.412741  2864 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:21.414565  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:21.415076  1540 raft_consensus.cc:606] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:21.417524  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:21.418001  1617 raft_consensus.cc:606] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:21.423310  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:21.423791  1689 raft_consensus.cc:606] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:21.424937   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:21.426893   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:21.426575  2681 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.436381  1689 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.437628  1540 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.449258  2903 raft_consensus.cc:993] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:21.449681  2903 raft_consensus.cc:1081] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:21.451287  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53894
I20260709 12:59:21.451748  1613 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.452097  1613 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.452659  1617 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:21.452209  1439 catalog_manager.cc:5697] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.458053  1613 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:21.459844  1613 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:21.468272  1585 consensus_peers.cc:597] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1669ae3f986d428ca0a51760ca20bc70. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:21.470916  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:21.471418  1540 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.476841  1540 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:21.478052  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:21.478580  1689 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:21.478742  1540 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:21.478879  1689 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:21.479918  1691 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:21.479637  1689 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:21.481326  1689 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.482831  2864 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:21.486963  1689 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:21.486975  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:21.488170  2756 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:21.488233  2681 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:21.488646  2756 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:21.489379  2756 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:21.495543  2681 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.500118  1442 catalog_manager.cc:5697] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.503515  1689 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.502466  1540 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.512332  1691 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:21.521121  1442 catalog_manager.cc:5697] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.534492  1540 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:21.535878  2856 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:21.536279  1619 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:21.536715  1659 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2590e3864b048c4b1d12cec239acf7a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:21.537437  2714 raft_consensus.cc:993] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:21.537835  2714 raft_consensus.cc:1081] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:21.539026  2856 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:21.539464  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:52958
I20260709 12:59:21.540011  1689 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.540369  1689 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.547724  2856 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.548858  1540 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.549811  1689 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:21.552506  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:21.553160  1617 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.553543  1689 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:21.552439  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:21.554270  1538 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:21.554543  1538 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:21.555181  1538 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:21.556115  1538 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.561633  1619 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.563007  1617 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:21.567813  1538 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:21.568161  1443 catalog_manager.cc:5697] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:21.570850  1660 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:21.571710  2698 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:21.572105  2698 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:21.572657  2698 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:21.592386  1443 catalog_manager.cc:5697] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.593937  2756 raft_consensus.cc:993] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:21.594334  2681 raft_consensus.cc:1081] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:21.595499  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38018
I20260709 12:59:21.595870  1540 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.596122  1540 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.600739  1540 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:21.604018  1540 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:21.604816  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:21.605554  1619 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:21.605535  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:21.606036  1619 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:21.606176  1689 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.606762  1619 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:21.607748  1619 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.611896  1689 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:21.612892  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:21.613355  1619 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:21.613576  2889 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:21.613996  2889 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:21.614571  2889 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:21.624904  1443 catalog_manager.cc:5697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 2 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.643699  2681 raft_consensus.cc:993] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:21.644160  2864 raft_consensus.cc:1081] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Signalling peer e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:21.645597  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f35127b66604c1685f1fbe404840774"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:52956
I20260709 12:59:21.646090  1689 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.646361  1689 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.650359  1689 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:21.652051  1689 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:21.653861  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:21.654109  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:21.654364  2275 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.654574  1619 raft_consensus.cc:3055] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:21.654903  1619 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:21.655509  1619 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:21.656478  1619 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.660781  2275 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:21.661537  1619 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:21.662348  1660 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:21.663050  2698 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:21.663434  2698 raft_consensus.cc:697] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:21.664161  2698 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:21.676230  1443 catalog_manager.cc:5697] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.749909  2714 raft_consensus.cc:993] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:21.750348  2889 raft_consensus.cc:1081] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:21.751637  2275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45390
I20260709 12:59:21.752009  2275 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.752245  2275 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.756987  2275 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:21.758213  2275 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:21.758899  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:21.759318  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:21.759445  1540 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:21.759814  1619 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.759795  1540 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:21.763327  1540 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:21.764273  1540 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.765688  1619 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:21.766528  2243 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:21.767194  2863 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:21.768117  2863 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:21.769043  1540 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:21.769392  2863 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:21.779625  1443 catalog_manager.cc:5697] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.795223  2921 ts_tablet_manager.cc:933] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:21.796764  2921 tablet_copy_client.cc:323] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:21.797899  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 4a0105ba6bf14860a95121a73725f62e from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:59:21.798271  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 4a0105ba6bf14860a95121a73725f62e from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-4a0105ba6bf14860a95121a73725f62e
I20260709 12:59:21.802768  1630 tablet_copy_source_session.cc:215] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:21.805269  2921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0105ba6bf14860a95121a73725f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.816043  2921 tablet_copy_client.cc:806] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:21.816437  2921 tablet_copy_client.cc:670] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:21.820894  2921 tablet_copy_client.cc:538] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:21.828732  2921 tablet_bootstrap.cc:492] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:21.849817  2921 tablet_bootstrap.cc:492] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:21.850652  2921 tablet_bootstrap.cc:492] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:21.851547  2921 ts_tablet_manager.cc:1403] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.005s
I20260709 12:59:21.853870  2921 raft_consensus.cc:359] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:21.854396  2921 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:21.854852  2921 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:21.856622  2921 ts_tablet_manager.cc:1434] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:59:21.858527  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-4a0105ba6bf14860a95121a73725f62e received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:21.858909  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-4a0105ba6bf14860a95121a73725f62e on tablet 4a0105ba6bf14860a95121a73725f62e with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:21.859488  2924 ts_tablet_manager.cc:933] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:21.873262  2924 tablet_copy_client.cc:323] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:21.875252  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 8a483be3e3ee4d5381336b0877760ca9 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:21.875706  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 8a483be3e3ee4d5381336b0877760ca9 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-8a483be3e3ee4d5381336b0877760ca9
I20260709 12:59:21.881117  1554 tablet_copy_source_session.cc:215] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:21.883584  2924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a483be3e3ee4d5381336b0877760ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.889035  1538 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:21.890511  2681 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:21.898547  2924 tablet_copy_client.cc:806] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:21.899066  2924 tablet_copy_client.cc:670] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:21.903005  2924 tablet_copy_client.cc:538] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:21.910537  2924 tablet_bootstrap.cc:492] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:21.915189  1689 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:21.916365  2864 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:21.985033  2924 tablet_bootstrap.cc:492] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:21.985976  2924 tablet_bootstrap.cc:492] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:21.987607  2924 ts_tablet_manager.cc:1403] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.016s
I20260709 12:59:21.992120  2924 raft_consensus.cc:359] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:21.993077  2924 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:21.994073  2924 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:21.996043  2921 ts_tablet_manager.cc:933] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:21.997172  2924 ts_tablet_manager.cc:1434] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:59:22.001619  2921 tablet_copy_client.cc:323] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:22.003866  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 1669ae3f986d428ca0a51760ca20bc70 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:59:22.004488  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 1669ae3f986d428ca0a51760ca20bc70 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-1669ae3f986d428ca0a51760ca20bc70
I20260709 12:59:22.025889  1630 tablet_copy_source_session.cc:215] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:22.030496  2921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1669ae3f986d428ca0a51760ca20bc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.034873  1689 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:22.038254  2714 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:22.041567  1619 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.043756  2698 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.061393  2921 tablet_copy_client.cc:806] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:22.061980  2921 tablet_copy_client.cc:670] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:22.067250  2921 tablet_copy_client.cc:538] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:22.071161  1617 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:22.072508  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-8a483be3e3ee4d5381336b0877760ca9 received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:22.072866  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-8a483be3e3ee4d5381336b0877760ca9 on tablet 8a483be3e3ee4d5381336b0877760ca9 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:22.073779  2714 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:22.075778  2921 tablet_bootstrap.cc:492] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:22.080236  1538 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.087607  2856 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:22.188643  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 51598.1us
I20260709 12:59:22.264858  1616 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.266067  2904 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.268719  2275 raft_consensus.cc:1217] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:59:22.290334  2921 tablet_bootstrap.cc:492] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:22.293933  2275 raft_consensus.cc:1217] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:22.307693  2921 tablet_bootstrap.cc:492] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:22.309556  2921 ts_tablet_manager.cc:1403] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.234s	user 0.041s	sys 0.042s
I20260709 12:59:22.314159  2921 raft_consensus.cc:359] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:22.317104  2921 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:22.317682  2921 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:22.320137  2921 ts_tablet_manager.cc:1434] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:59:22.324355  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-1669ae3f986d428ca0a51760ca20bc70 received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:22.324738  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-1669ae3f986d428ca0a51760ca20bc70 on tablet 1669ae3f986d428ca0a51760ca20bc70 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:22.351629  2275 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.356344  2904 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.361413  1617 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.363729  2863 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.369186  2921 ts_tablet_manager.cc:933] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:22.372475  2921 tablet_copy_client.cc:323] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
W20260709 12:59:22.390798  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 134939us
I20260709 12:59:22.392105  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet b2590e3864b048c4b1d12cec239acf7a from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:22.392603  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet b2590e3864b048c4b1d12cec239acf7a from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-b2590e3864b048c4b1d12cec239acf7a
I20260709 12:59:22.407997  1704 tablet_copy_source_session.cc:215] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:22.411773  1540 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.414533  2953 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.423326  2921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2590e3864b048c4b1d12cec239acf7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.430063   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:22.466290  2921 tablet_copy_client.cc:806] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:22.466771  2921 tablet_copy_client.cc:670] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:22.489812  2921 tablet_copy_client.cc:538] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:22.496549  2921 tablet_bootstrap.cc:492] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:22.518726  2921 tablet_bootstrap.cc:492] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:22.519450  2921 tablet_bootstrap.cc:492] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:22.520040  2921 ts_tablet_manager.cc:1403] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.017s
I20260709 12:59:22.522421  2921 raft_consensus.cc:359] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:22.523180  2921 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:22.523702  2921 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:22.525796  2921 ts_tablet_manager.cc:1434] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:59:22.527276  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-b2590e3864b048c4b1d12cec239acf7a received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:22.527669  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-b2590e3864b048c4b1d12cec239acf7a on tablet b2590e3864b048c4b1d12cec239acf7a with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:22.530988   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:22.576889  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:22.577476  1687 raft_consensus.cc:606] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:22.579658  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:22.580144  1540 raft_consensus.cc:606] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:22.582266  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:22.582782  1616 raft_consensus.cc:606] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:22.583954   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:22.586196   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:22.590691  2275 raft_consensus.cc:1217] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:22.677361  2946 raft_consensus.cc:1064] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:22.679445  2946 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:22.684988  1687 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:22.686216  2275 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:22.687181  1540 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:22.687803  2943 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:22.688649  2942 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:22.689440  2756 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:22.703426  2942 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:22.708701  1540 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:22.719704  2275 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:22.729315  1442 catalog_manager.cc:5697] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.731436  1687 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:22.753717  2946 raft_consensus.cc:993] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:22.754151  2946 raft_consensus.cc:1081] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:22.756305  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38018
I20260709 12:59:22.756807  1538 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.757161  1538 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.762120  2275 raft_consensus.cc:1217] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:22.763434  1616 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:22.764381  1538 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:22.772326  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:22.772816  1617 raft_consensus.cc:3055] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.773085  1617 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:22.773730  1617 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:22.775220  1538 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:22.775614  1617 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.776904  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:22.777499  1687 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.782348  2275 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.784065  2942 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.789650  1617 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:22.790733  1511 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:22.790568  2943 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:22.792902  1538 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.795073  1687 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:22.791519  2889 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.796931  2756 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.796952  2889 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:22.797999  2889 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:22.801880  1538 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:22.805032  2277 raft_consensus.cc:2955] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:22.808522  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a0105ba6bf14860a95121a73725f62e with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:22.821254  1439 catalog_manager.cc:5697] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 4 to 5, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.831713  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a0105ba6bf14860a95121a73725f62e with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:22.830521  1443 catalog_manager.cc:5697] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.838716  2966 tablet_replica.cc:333] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:22.839668  2966 raft_consensus.cc:2243] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:22.840278  2966 raft_consensus.cc:2272] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:22.842526  2939 raft_consensus.cc:1064] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:22.844985  2937 raft_consensus.cc:993] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:22.850863  2937 raft_consensus.cc:1081] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:22.851965  2966 ts_tablet_manager.cc:1916] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:22.855072  1617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53910
I20260709 12:59:22.849594  2939 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:22.855628  1617 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.855984  1617 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.863265  1617 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:22.867961  2856 raft_consensus.cc:993] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:22.868530  2856 raft_consensus.cc:1081] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:22.875507  2966 ts_tablet_manager.cc:1929] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:59:22.878999  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:22.894264  2966 log.cc:1199] T 4a0105ba6bf14860a95121a73725f62e P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/4a0105ba6bf14860a95121a73725f62e
I20260709 12:59:22.894315  1540 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.894745  1540 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:22.895416  1540 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:22.896310  1540 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.877686  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:22.898888  1687 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.905853  1687 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:22.884923  1616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53894
I20260709 12:59:22.876777  1617 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:22.910593  1616 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.910995  1616 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.911319  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:22.912369  2942 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.912801  2942 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:22.909425  1540 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:22.913612  2942 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:22.921310  2277 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:22.929842  1616 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:22.931444  1616 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:22.959838  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet 4a0105ba6bf14860a95121a73725f62e (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:22.976092  1687 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:22.975903  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:22.977324  1691 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.977788  1691 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:22.979106  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:22.979364  1691 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:22.979933  1545 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.982167  1691 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.984719  1617 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:23.005154  2889 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:23.009500  2714 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:23.020411  2889 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:22.989337  1443 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.039839  1545 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
W20260709 12:59:23.045580  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 54843us
I20260709 12:59:23.047212  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:23.048915  2864 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:23.056284  1691 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:23.056360  2864 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:23.084295  2864 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:23.110425  2681 raft_consensus.cc:1064] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:23.113631  2681 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:23.142580  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 76240.2us
I20260709 12:59:23.158229  1691 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.161850  1540 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.163185  2954 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.165803  2943 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:23.167127  1691 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.168529  1443 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.173893  2756 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.176396  2277 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:59:23.180966  1566 debug-util.cc:398] Leaking SignalData structure 0x7b0800115d40 after lost signal to thread 434
W20260709 12:59:23.182549  1566 debug-util.cc:398] Leaking SignalData structure 0x7b080031caa0 after lost signal to thread 1477
W20260709 12:59:23.184337  1566 debug-util.cc:398] Leaking SignalData structure 0x7b08001071a0 after lost signal to thread 1569
I20260709 12:59:23.185074  2756 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:23.189109  1566 debug-util.cc:398] Leaking SignalData structure 0x7b08001a4d40 after lost signal to thread 1644
W20260709 12:59:23.190685  1566 debug-util.cc:398] Leaking SignalData structure 0x7b08001fe660 after lost signal to thread 1718
W20260709 12:59:23.192401  1566 debug-util.cc:398] Leaking SignalData structure 0x7b0800314260 after lost signal to thread 2301
I20260709 12:59:23.246726  1443 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 4 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.247498  2277 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.267236  1616 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.268040  2943 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.272439  1545 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.287021  1613 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.290158  2971 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.305972  2941 raft_consensus.cc:1064] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:23.311951  1545 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:23.325769  1443 catalog_manager.cc:5697] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.335647  2941 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:23.341148  2275 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.345229  1686 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.350659  2277 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:23.352175  2954 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:23.353518  1687 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:23.368232  2714 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.372391  2277 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.400034  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a483be3e3ee4d5381336b0877760ca9 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:23.428762  1540 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.432382  2756 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.446099  2889 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:23.448119  1613 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.450317  1439 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 5 to 6, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.461381  1613 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:23.465224  2275 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.474382  2277 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:23.474788  1545 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:23.475870  2756 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:23.477161  2856 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:23.478006  2942 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:23.477547  1691 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.481645  1545 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.483493  2856 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.484926  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a483be3e3ee4d5381336b0877760ca9 with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:23.489846  1687 raft_consensus.cc:2955] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.503961  2756 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.505549  2939 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.511548  2276 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.527721  2904 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:23.529469  2987 tablet_replica.cc:333] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:23.533367  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1669ae3f986d428ca0a51760ca20bc70 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:23.535631  1686 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.536844  2987 raft_consensus.cc:2243] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:23.537708  2987 raft_consensus.cc:2272] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:23.536974  1540 raft_consensus.cc:2955] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.549474  2987 ts_tablet_manager.cc:1916] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:23.585100  2987 ts_tablet_manager.cc:1929] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:59:23.585611  2987 log.cc:1199] T 8a483be3e3ee4d5381336b0877760ca9 P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/8a483be3e3ee4d5381336b0877760ca9
I20260709 12:59:23.587364   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:23.579476  2856 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.579483  1439 catalog_manager.cc:5697] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.603688  2943 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.604494  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet 8a483be3e3ee4d5381336b0877760ca9 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:23.613041  1540 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.616240  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet 1669ae3f986d428ca0a51760ca20bc70 with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:23.628598  1538 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.629329  2756 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:23.636286  1687 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.639408  2943 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.641112  2276 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.657510  2994 tablet_replica.cc:333] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
W20260709 12:59:23.670607  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 73308.5us
I20260709 12:59:23.671186  2994 raft_consensus.cc:2243] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:23.671981  2994 raft_consensus.cc:2272] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:23.673791  1440 catalog_manager.cc:5697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.676113  2994 ts_tablet_manager.cc:1916] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:23.685081  1613 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.696605  2994 ts_tablet_manager.cc:1929] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:23.697073  2994 log.cc:1199] T 1669ae3f986d428ca0a51760ca20bc70 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/1669ae3f986d428ca0a51760ca20bc70
I20260709 12:59:23.700825  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet 1669ae3f986d428ca0a51760ca20bc70 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:23.736225  1686 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:23.741351  2277 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:23.742616  2856 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:23.743625  1540 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:23.748816  2856 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:23.754761  2698 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.757395  2276 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.763724  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b2590e3864b048c4b1d12cec239acf7a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:23.764878  1538 raft_consensus.cc:2955] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.776022  1439 catalog_manager.cc:5697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:23.802774  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet b2590e3864b048c4b1d12cec239acf7a with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:23.803707  2987 tablet_replica.cc:333] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:23.804783  2987 raft_consensus.cc:2243] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:23.805560  2987 raft_consensus.cc:2272] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:23.810099  2987 ts_tablet_manager.cc:1916] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:23.821311   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:23.841190  2987 ts_tablet_manager.cc:1929] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:23.842566  2987 log.cc:1199] T b2590e3864b048c4b1d12cec239acf7a P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/b2590e3864b048c4b1d12cec239acf7a
I20260709 12:59:23.854293  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet b2590e3864b048c4b1d12cec239acf7a (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:23.873381  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f61c89956d24976b4d464550172cd55"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:23.873914  1686 raft_consensus.cc:606] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:23.876284  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:23.876830  1616 raft_consensus.cc:606] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:23.879261  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea97e615db7549b797908560563dd608"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:23.879644  1616 raft_consensus.cc:606] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:23.881982  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:23.882438  1538 raft_consensus.cc:606] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:23.883845   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:23.885535   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:24.044929  2943 raft_consensus.cc:993] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:24.045382  2681 raft_consensus.cc:1081] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:24.046778  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea97e615db7549b797908560563dd608"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38018
I20260709 12:59:24.047348  1538 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.047672  1538 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.052285  1538 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:24.053706  1538 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:24.054522  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:24.055074  1616 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.055215  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:24.055353  1616 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:24.055719  1687 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.056187  1616 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:24.057086  1616 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.061638  1687 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:24.062793  1509 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:24.063534  1616 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:24.063668  2971 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.064258  2971 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:24.065112  2971 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:24.074759  1439 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.162307  2943 raft_consensus.cc:993] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:24.162844  2681 raft_consensus.cc:1081] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:24.164507  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38018
I20260709 12:59:24.165010  1538 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.165359  1538 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.172025  1538 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:24.174238  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:24.174451  1538 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:24.174777  1616 raft_consensus.cc:3055] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.175201  1616 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:24.175928  1616 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:24.176677  1616 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.174674  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:24.178900  1687 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.181206  1616 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:24.183046  1511 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:24.183777  2971 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.184194  2971 raft_consensus.cc:697] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:24.185344  1687 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:24.184944  2971 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:24.199091  1439 catalog_manager.cc:5697] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.235643  2889 raft_consensus.cc:993] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:24.236100  2889 raft_consensus.cc:1081] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:24.237731  2277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45390
I20260709 12:59:24.238224  2277 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.238541  2277 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.247061  2277 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:24.249956  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:24.250499  1538 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.250820  1538 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:24.251602  1538 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:24.252637  1538 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.255605  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:24.258920  2277 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:24.259042  1687 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.268667  1687 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:24.269244  1538 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:24.269511  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:24.270282  3003 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.270797  3003 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:24.271695  3003 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:24.281589  1439 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.291016  2698 raft_consensus.cc:993] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:24.291472  2698 raft_consensus.cc:1081] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:24.292874  1616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f61c89956d24976b4d464550172cd55"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53894
I20260709 12:59:24.293360  1616 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.293702  1616 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.301728  1616 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:24.303547  1616 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:24.304309  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:24.304843  1687 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:24.304329  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:24.305207  1687 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:24.305403  1538 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.306169  1687 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:24.307256  1687 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.312386  1538 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:24.319083  1687 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:24.320228  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:24.321044  2943 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:24.321528  2943 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:24.322392  2943 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:24.334239  1439 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.525759  1687 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.526944  2971 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.541297  1616 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.543999  2937 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:24.681299  1687 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.684449  2971 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.713304  1613 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.717060  2971 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.729384  1686 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:24.730872  2756 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.751893  1540 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:24.753445  2943 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.784226  1686 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:24.785907  2972 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:24.828447  1540 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:24.831072  2972 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:24.887501   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:24.915237  1613 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:24.937311  1585 consensus_peers.cc:597] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d3b81d89af143c88a2c3179213662ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:24.941670  1686 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:24.942896  1540 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:24.944633  2943 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.947340  2943 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.963245  2681 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:24.968487  1686 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:24.979521  1540 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:24.979569  1613 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:24.989507  1439 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:25.013913  1585 consensus_peers.cc:597] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ef93a23494e4934beefa28be227bc72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.017874  1687 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:25.022095  2943 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:25.024336  1540 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:25.027944  2943 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:25.039712   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:25.041994  2943 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.046144  1687 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.093276  1540 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.092947  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:25.101125  1613 raft_consensus.cc:606] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:25.105490  2681 raft_consensus.cc:993] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:25.105893  2681 raft_consensus.cc:1081] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:25.105683  1544 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:25.112432  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82622e43412243cb95bf17b246050060"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:25.112987  1538 raft_consensus.cc:606] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:25.113646  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38018
I20260709 12:59:25.114274   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:25.114799  1540 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.115198  1540 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.115818   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:25.126799  1440 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.138958  1540 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:25.140691  1510 consensus_peers.cc:597] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c3db709fac1489b928f0a9df67f0426. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.140825  1540 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:25.141264  1613 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:25.142203  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:25.142760  1612 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:25.143029  1612 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:25.143680  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:25.144059  1686 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:25.144207  1691 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.145761  2937 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:25.143723  1612 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:25.149397  1612 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.154188  3013 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:25.156174  1691 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:25.157193  1509 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:25.158051  2937 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:25.158509  2937 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:25.159390  2937 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:25.157225  1612 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:25.180326  2937 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.187881  1613 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.200235  1691 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.202267  1439 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 2 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.217708  1687 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:25.218757  1440 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.240154  1613 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:25.241055  1659 consensus_peers.cc:597] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cd03248480b4bfd8a76471850708909. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.243062  1544 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:25.244784  3011 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:25.250267  2698 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:25.265103  2993 raft_consensus.cc:2955] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.267503  1544 raft_consensus.cc:2955] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.268111  1612 raft_consensus.cc:2955] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:25.285075  1442 catalog_manager.cc:5697] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 2, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.354964  2971 raft_consensus.cc:993] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:25.355437  2971 raft_consensus.cc:1081] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:25.359680  1687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82622e43412243cb95bf17b246050060"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:52958
I20260709 12:59:25.360148  1687 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.360483  1687 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.365808  1687 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:25.367565  1687 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:25.368480  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:25.369510  1544 raft_consensus.cc:3055] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:25.372372  1544 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:25.372520  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:25.373128  1544 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:25.374336  1544 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.373153  1612 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.384298  1544 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:25.385715  1658 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:25.388259  2993 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:25.388710  2993 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:25.389453  2993 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:25.393453  1612 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:25.407621  1440 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.460557  3038 ts_tablet_manager.cc:933] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:25.462476  3038 tablet_copy_client.cc:323] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 12:59:25.464149  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 4d3b81d89af143c88a2c3179213662ff from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 12:59:25.464610  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 4d3b81d89af143c88a2c3179213662ff from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-4d3b81d89af143c88a2c3179213662ff
I20260709 12:59:25.478101  1630 tablet_copy_source_session.cc:215] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:25.481331  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3b81d89af143c88a2c3179213662ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:25.502889  3038 tablet_copy_client.cc:806] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:25.503554  3038 tablet_copy_client.cc:670] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:25.507354  3038 tablet_copy_client.cc:538] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:25.520846  3038 tablet_bootstrap.cc:492] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:25.562052  1687 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:25.566537  2889 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:59:25.613232  1510 consensus_peers.cc:597] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ef93a23494e4934beefa28be227bc72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.668864  1613 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:25.670864  2937 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:25.741364  3046 ts_tablet_manager.cc:933] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:25.746523  3046 tablet_copy_client.cc:323] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:25.790498  1544 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.791862  3011 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:25.799952  3045 ts_tablet_manager.cc:933] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:25.834807  1617 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.850826  3011 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:25.863478  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet 3cd03248480b4bfd8a76471850708909 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:25.864077  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet 3cd03248480b4bfd8a76471850708909 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-3cd03248480b4bfd8a76471850708909
W20260709 12:59:25.869197  1509 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:40935, user_credentials={real_user=slave}} blocked reactor thread for 99038.2us
I20260709 12:59:25.879433  1704 tablet_copy_source_session.cc:215] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:25.914196  3045 tablet_copy_client.cc:323] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:25.935679  3046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd03248480b4bfd8a76471850708909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:25.959128  3046 tablet_copy_client.cc:806] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:25.959668  3046 tablet_copy_client.cc:670] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:26.003566  3051 ts_tablet_manager.cc:933] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:26.012915  3051 tablet_copy_client.cc:323] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:26.015767  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 1c3db709fac1489b928f0a9df67f0426 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:26.016325  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 1c3db709fac1489b928f0a9df67f0426 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-1c3db709fac1489b928f0a9df67f0426
I20260709 12:59:26.025651  1554 tablet_copy_source_session.cc:215] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.035656  3038 tablet_bootstrap.cc:492] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:26.036675  3038 tablet_bootstrap.cc:492] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:26.037432  3038 ts_tablet_manager.cc:1403] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.517s	user 0.123s	sys 0.246s
I20260709 12:59:26.040516  3038 raft_consensus.cc:359] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:26.041354  3038 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:26.042026  3038 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:26.047892  3038 ts_tablet_manager.cc:1434] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:59:26.049425  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-4d3b81d89af143c88a2c3179213662ff received from {username='slave'} at 127.0.0.1:43404
I20260709 12:59:26.049861  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-4d3b81d89af143c88a2c3179213662ff on tablet 4d3b81d89af143c88a2c3179213662ff with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:26.062179  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 6ef93a23494e4934beefa28be227bc72 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:26.062664  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 6ef93a23494e4934beefa28be227bc72 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-6ef93a23494e4934beefa28be227bc72
I20260709 12:59:26.070107  1554 tablet_copy_source_session.cc:215] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.078289  3046 tablet_copy_client.cc:538] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:26.078538  3045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3db709fac1489b928f0a9df67f0426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:26.080920  3051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef93a23494e4934beefa28be227bc72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:26.087534  3046 tablet_bootstrap.cc:492] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:26.100796  3051 tablet_copy_client.cc:806] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:26.101365  3051 tablet_copy_client.cc:670] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:26.106739  3045 tablet_copy_client.cc:806] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:26.107492  3045 tablet_copy_client.cc:670] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:26.111799  3051 tablet_copy_client.cc:538] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:26.112303  3045 tablet_copy_client.cc:538] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:26.119557   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:26.120682  3051 tablet_bootstrap.cc:492] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:26.126309  3045 tablet_bootstrap.cc:492] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:26.170084  3046 tablet_bootstrap.cc:492] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:26.171109  3046 tablet_bootstrap.cc:492] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:26.171813  3046 ts_tablet_manager.cc:1403] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.004s
I20260709 12:59:26.181432  3046 raft_consensus.cc:359] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:26.182281  3046 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:26.182915  3046 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:26.192598  3045 tablet_bootstrap.cc:492] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:26.192761  3046 ts_tablet_manager.cc:1434] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 12:59:26.193522  3045 tablet_bootstrap.cc:492] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:26.194362  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-3cd03248480b4bfd8a76471850708909 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:26.194624  3045 ts_tablet_manager.cc:1403] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.003s
I20260709 12:59:26.194813  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-3cd03248480b4bfd8a76471850708909 on tablet 3cd03248480b4bfd8a76471850708909 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:26.198464  3051 tablet_bootstrap.cc:492] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:26.199293  3051 tablet_bootstrap.cc:492] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:26.208818  3051 ts_tablet_manager.cc:1403] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.009s
I20260709 12:59:26.202275  3045 raft_consensus.cc:359] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:26.215713  3045 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:26.216558  3051 raft_consensus.cc:359] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:26.217413  3051 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:26.216475  3045 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:26.218037  3051 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:26.220408  3051 ts_tablet_manager.cc:1434] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:59:26.228681  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-6ef93a23494e4934beefa28be227bc72 received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:26.229074  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-6ef93a23494e4934beefa28be227bc72 on tablet 6ef93a23494e4934beefa28be227bc72 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:26.240377  3045 ts_tablet_manager.cc:1434] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 12:59:26.255136  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-1c3db709fac1489b928f0a9df67f0426 received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:26.255506  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-1c3db709fac1489b928f0a9df67f0426 on tablet 1c3db709fac1489b928f0a9df67f0426 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:26.332132  2275 raft_consensus.cc:1217] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:26.367551   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:26.378499  2275 raft_consensus.cc:1217] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:26.494346  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:26.494971  1540 raft_consensus.cc:606] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:26.498078  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:26.498577  1686 raft_consensus.cc:606] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:26.501654   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:26.503373   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:26.580503  2275 raft_consensus.cc:1217] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Deduplicated request from leader. Original: 2.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:59:26.632956  2275 raft_consensus.cc:1217] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:26.715745  2889 raft_consensus.cc:1064] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:26.717217  2889 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:26.724184  2275 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:26.725806  1616 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:26.726001  1686 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:26.726253  3013 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:26.728547  2889 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:26.729314  3014 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:26.747645  3013 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.749135  1686 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.751096  1612 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.771811  2277 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.809738  1442 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:26.826948  2756 raft_consensus.cc:1064] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:26.829128  2756 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:26.840691  2277 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:26.841391  1686 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:26.841952  2756 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:26.846772  3057 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:26.842288  1540 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:26.856189  2756 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:26.872499  3062 raft_consensus.cc:993] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:26.873040  3014 raft_consensus.cc:1081] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:26.876958  1612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53910
I20260709 12:59:26.877434  1612 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.877753  1612 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.884292  1612 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:26.886178  1612 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:26.886335  2681 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.888643  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:26.889170  1538 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:26.889494  1538 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:26.888736  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:26.890225  1687 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.890341  1538 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:26.891793  1538 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.893872  1540 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.899793  1538 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:26.901034  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:26.901722  2756 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.902133  2756 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:26.902854  2756 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:26.903776  1687 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:26.915897  1538 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:26.925824  2277 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:26.926553  1687 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:26.927891  3014 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:26.929073  3062 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:26.939210  2275 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.948879  3013 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.952528  1687 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.954528  1686 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.974975  1439 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.975584  2277 raft_consensus.cc:2955] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:26.994532  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c3db709fac1489b928f0a9df67f0426 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:26.990275  1443 catalog_manager.cc:5697] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.999495  1439 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 4 to 5, VOTER e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.004398  3011 raft_consensus.cc:993] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:27.004861  3011 raft_consensus.cc:1081] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:27.008086  1612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53894
I20260709 12:59:27.008553  1612 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.008865  1612 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.018196  1612 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.018064  1616 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.020831  1601 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c3db709fac1489b928f0a9df67f0426 with delete_type TABLET_DATA_TOMBSTONED (TS e12d7b3551014757ba7dda3e83605b83 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53880
I20260709 12:59:27.021754  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:27.022059  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:27.022289  2275 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.022635  1686 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:27.022949  1686 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:27.023610  1686 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.025409  1686 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.026152  2276 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:27.028761  2756 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.031592  1687 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:27.031984  1686 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:27.032923  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:27.033702  2943 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.034931  2681 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:27.035009  2275 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:27.035424  2681 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:27.036615  1612 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:27.036198  2681 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.038187  3072 tablet_replica.cc:333] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 12:59:27.039201  3072 raft_consensus.cc:2243] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.039965  3072 raft_consensus.cc:2272] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.044946  3072 ts_tablet_manager.cc:1916] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:27.054525  3057 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.059837  1686 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.066624  2276 raft_consensus.cc:2955] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.072201  3072 ts_tablet_manager.cc:1929] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:59:27.072700  3072 log.cc:1199] T 1c3db709fac1489b928f0a9df67f0426 P e12d7b3551014757ba7dda3e83605b83: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-1-root/wals/1c3db709fac1489b928f0a9df67f0426
I20260709 12:59:27.076116  1430 catalog_manager.cc:5028] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): tablet 1c3db709fac1489b928f0a9df67f0426 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:27.079928  1440 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 4 to 5, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.088706  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d3b81d89af143c88a2c3179213662ff with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:27.090405  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d3b81d89af143c88a2c3179213662ff with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:27.106113  1440 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:27.150071  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 60453us
I20260709 12:59:27.150607  3077 tablet_replica.cc:333] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:27.155997  3077 raft_consensus.cc:2243] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.156805  3077 raft_consensus.cc:2272] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.159535  3011 raft_consensus.cc:1064] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:27.161198  3077 ts_tablet_manager.cc:1916] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:27.162086  3011 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.185447  1612 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:27.187106  1540 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:27.186995  3011 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:27.187522  2276 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:27.188472  2993 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.189503  3056 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.199564  3062 raft_consensus.cc:1064] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:27.201821  3062 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.208352  2276 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:27.209906  1686 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:27.210032  3013 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.211620  2889 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.214738  2993 raft_consensus.cc:2955] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.218365  1613 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:27.220012  3077 ts_tablet_manager.cc:1929] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:59:27.223193  3077 log.cc:1199] T 4d3b81d89af143c88a2c3179213662ff P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/4d3b81d89af143c88a2c3179213662ff
I20260709 12:59:27.227198  2277 raft_consensus.cc:2955] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.233246  2889 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.236383  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet 4d3b81d89af143c88a2c3179213662ff (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:27.253412  1440 catalog_manager.cc:5697] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.264451  1613 raft_consensus.cc:2955] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.268417  1686 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.281998  2275 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:27.283957  3011 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:27.301187  3011 raft_consensus.cc:2955] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.302997  2275 raft_consensus.cc:2955] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.308063  1616 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:27.312654  3056 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:27.317840  1442 catalog_manager.cc:5697] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 12:59:27.323407  3079 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 12:59:27.323807  3014 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.326264  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3cd03248480b4bfd8a76471850708909 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:27.326651  1687 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.331013  1616 raft_consensus.cc:2955] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.331108  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cd03248480b4bfd8a76471850708909 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:27.332816  3077 tablet_replica.cc:333] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:27.335157  3077 raft_consensus.cc:2243] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.335711  3077 pending_rounds.cc:70] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: Trying to abort 1 pending ops.
I20260709 12:59:27.335980  3077 pending_rounds.cc:77] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633657489702912 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "3cd03248480b4bfd8a76471850708909" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } } }
I20260709 12:59:27.337186  3077 raft_consensus.cc:2917] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:59:27.337548  3077 raft_consensus.cc:2889] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:59:27.337908  3077 raft_consensus.cc:2272] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.345350  2276 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.361280  1443 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.361892  3077 ts_tablet_manager.cc:1916] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:27.386834  3077 ts_tablet_manager.cc:1929] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:27.393049  3077 log.cc:1199] T 3cd03248480b4bfd8a76471850708909 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/3cd03248480b4bfd8a76471850708909
I20260709 12:59:27.395373  1616 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.400254  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet 3cd03248480b4bfd8a76471850708909 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:27.406225  1540 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.413458  2276 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:27.415064  1616 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:27.416064  2276 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:27.415462  3086 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:27.417475  2943 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.423475  3013 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:27.424883  3013 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.427012  2275 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.428930  1616 raft_consensus.cc:2955] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.443243  1440 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 5 to 6, VOTER e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) evicted. New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:27.453756  1676 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ef93a23494e4934beefa28be227bc72 with delete_type TABLET_DATA_TOMBSTONED (TS e2a2b76c98ee44ff95e6508c34da0e3d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:52940
I20260709 12:59:27.456696  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ef93a23494e4934beefa28be227bc72 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:27.463114  1687 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:27.465298  2943 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.471765  3090 tablet_replica.cc:333] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 12:59:27.472856  3090 raft_consensus.cc:2243] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.473685  3090 raft_consensus.cc:2272] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.483858  3090 ts_tablet_manager.cc:1916] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:27.501564  3090 ts_tablet_manager.cc:1929] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:59:27.501874  3090 log.cc:1199] T 6ef93a23494e4934beefa28be227bc72 P e2a2b76c98ee44ff95e6508c34da0e3d: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-2-root/wals/6ef93a23494e4934beefa28be227bc72
I20260709 12:59:27.503444  1428 catalog_manager.cc:5028] TS e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): tablet 6ef93a23494e4934beefa28be227bc72 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 12:59:27.504235   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:27.511564  1540 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:27.512867  2756 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:27.513089  1687 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:27.514106  2756 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:27.816891   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:27.848397  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:27.848832  1616 raft_consensus.cc:606] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:27.850713  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:27.851130  1616 raft_consensus.cc:606] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:27.853312  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:27.853940  1540 raft_consensus.cc:606] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:27.855228   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:27.856259   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:27.947883  2681 raft_consensus.cc:993] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:27.948294  2943 raft_consensus.cc:1081] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:27.949565  2277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45396
I20260709 12:59:27.949976  2277 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.950254  2277 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.954876  2277 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.956420  2277 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:27.956883  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:27.957378  1616 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:27.957682  1616 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:27.958280  1616 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.957259  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:27.958884  1687 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.959089  1616 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.963833  1687 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:27.964720  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:27.965139  1616 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:27.965468  3076 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:27.965950  3076 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:27.966603  3076 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:27.974174  1443 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.994571  3013 raft_consensus.cc:993] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:27.995101  3062 raft_consensus.cc:1081] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:27.996366  2277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45390
I20260709 12:59:27.996826  2277 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.997133  2277 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.001179  2277 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:28.002526  2277 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:28.003022  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:28.003297  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:28.003578  1540 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:28.003845  1687 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.003897  1540 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:28.004694  1540 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:28.005829  1540 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.009792  1687 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:28.010695  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:28.011310  3076 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:28.011672  1540 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:28.012415  3076 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:28.013330  3076 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:28.021943  1443 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 3 to 4, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.691819  1691 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:28.710997  1691 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:28.710842  3104 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:28.719436  3100 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:29.193835   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:29.583120  3106 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:29.583767  3106 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.585958  3106 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:29.595371  3107 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.596005  3107 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.598222  3107 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.605327  3107 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.605793  3107 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.607746  3114 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.608295  3114 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.610231  3114 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.614460  3114 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.616011  3114 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.611820  3011 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.666018  3011 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:29.666844  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.024s	sys 0.014s
W20260709 12:59:29.667176  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.024s	sys 0.014s
I20260709 12:59:29.611287  3115 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.620450  3119 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.624152  3120 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:29.628084  3117 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.628566  3107 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:29.632525  3126 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.633826  3104 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.634212  3124 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.647320  3111 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:29.648358  3121 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.650183  3129 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.656203  3113 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.664943  3105 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.675634  3011 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.701253  3011 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.701432  3116 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.701668  3011 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.702098  3116 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.655776  3106 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:29.691121  3104 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.695379  3127 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.696815  3121 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.663482  3132 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.689190  3107 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.691269  3126 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.685652  3119 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.675712  3115 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.710621  3106 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.753854  3139 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.754709  3131 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.759243  3128 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.760915  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.687796  3120 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.696254  3111 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.763672  3011 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.765810  1617 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:29.767859  3111 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:29.696537  3124 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.770320  3124 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:29.772286  3138 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.772740  3138 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.774163  3138 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:29.689203  3117 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.776764  3011 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.777390  3011 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.709530  3129 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.781220  3129 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:29.781721  3129 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.782130  3129 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.784116  3129 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.784596  3129 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.786046  3129 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.792938  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.793526  1617 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:59:29.748175  3107 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.795610  3011 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.847128  3011 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.847663  3011 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.759927  3132 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.853487  3121 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.854074  3132 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.854070  3121 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.709301  3113 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.855645  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.856930  3011 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.854647  3115 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.792194  3111 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:29.795003  3124 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.837522  3130 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:29.863306  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.857365  3120 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:29.747705  3127 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.871889  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.866966  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.873034  1617 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:29.730396  3105 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:29.870832  1641 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba3a0 after lost signal to thread 434
I20260709 12:59:29.876329  3146 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.876529  3106 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:29.855079  3133 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.854791  3121 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.876758  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.880977  2681 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.881695  2681 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.885228  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.885726  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.795920  3128 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.888758  2681 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:29.863099  3111 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.788944  3139 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.865931  3124 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.896231  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.899117  3011 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.899585  3011 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:29.893586  3115 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:29.904455  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.904970  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.906945  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.790917  3131 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.908095  2943 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:29.910138  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.877527  3130 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.909489  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.913034  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.913805  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.913903  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.911494  2943 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.912084  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.909772  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.916093  3011 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:29.898355  3116 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:29.913627  1613 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:29.919618  2943 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:29.914572  1538 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:29.917809  1545 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:59:29.904534  3132 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:29.911934  3104 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:29.905916  3119 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.911427  3135 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.921720  3145 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:29.904227  3147 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.928640  3148 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.928956  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.904125  3115 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.884542  3146 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.917629  3141 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.929510  1541 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:29.889988  3133 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.947309  3112 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:29.920049  1542 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:29.955435  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:29.921948  3132 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.929159  3148 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:29.944243  3113 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:29.956525  1619 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:59:30.009579  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:29.999550  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.029021  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.008852  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:30.029340  1613 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:30.029906  2276 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:29.954368  3128 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:29.945514  3104 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:29.999037  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:29.998059  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:29.943806  3141 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.036921  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:29.956507  3151 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:30.037376  3143 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.042774  1693 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:30.038935  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:30.038784  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:29.999238  1641 debug-util.cc:398] Leaking SignalData structure 0x7b08000a10c0 after lost signal to thread 1477
I20260709 12:59:29.956518  3144 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.039492  2943 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:29.944465  3136 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:30.052033  1544 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:30.047600  3127 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.060766  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:29.997459  3146 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:29.997566  3120 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.005362  3140 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.062073  3132 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.049309  3104 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.034394  3126 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:30.031270  3149 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.069703  2943 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.929296  3147 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:29.947781  3112 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.066457  3131 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:30.075134  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.075980  3152 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:30.076521  3157 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:30.077625  3148 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.077821  3146 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:30.079196  3141 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.080050  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:30.080291  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:30.060498  3144 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.060537  3153 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:29.954614  3135 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.086064  2943 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.086825  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.073590  3111 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.072969  3127 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:30.071419  3117 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:30.084316  3113 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:29.948578  3145 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.082161  3120 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.069990  3143 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.070752  3151 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.082773  3136 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.177760  3133 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.086952  3140 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.518847  3133 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 12:59:30.449110  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 384119us
I20260709 12:59:30.519562  3133 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.520201  1585 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:30.520780  3140 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.139456  3153 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:30.242599  3119 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.237820  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.533196  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.248355  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.544517  3162 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.545076  3162 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:30.545526  3162 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.183635  3154 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:30.215021   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:30.554481  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.557708  2276 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:59:30.232601  3116 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.559002  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.249452  3131 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.251237  3096 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.354966  3121 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:30.351941  3107 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:30.352341  3123 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.561044  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.107884  3148 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.444538  3147 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.560288  3139 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.564213  3145 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.565893  3143 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.091950  3146 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.092842  3105 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.560600  3111 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:30.426568  3130 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:30.566769  1658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.021s	sys 0.025s
I20260709 12:59:30.567773  1541 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:30.547065  3119 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.568670  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.091773  3152 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.572656  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.566130  3151 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:30.572129  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.452961  3112 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.567083  3140 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:30.555130  3113 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.548532  3127 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:30.577226  1658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.022s	sys 0.026s
W20260709 12:59:30.562354  1641 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8ca0 after lost signal to thread 1569
I20260709 12:59:30.561703  3116 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.577879  1614 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:30.580982  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.139458  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.086229  3149 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.562258  3131 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.354816  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.596570  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:30.571365  3148 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.504144  1539 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:30.587965  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 682764us
I20260709 12:59:30.101091  3157 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.570261  3154 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:30.584306  3104 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:30.585054  3151 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:30.593040  3164 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:30.600435  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 1.88087e+06us
I20260709 12:59:30.602138  3119 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.579396  3111 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.608218  1614 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:30.571571  3096 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.573848  3123 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.613574  1545 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:30.587400  3140 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:30.629683  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:50692
I20260709 12:59:30.638684  1617 raft_consensus.cc:606] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:30.639925  3076 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:30.640394  3076 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.642208  3115 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.644515  1658 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:59:30.616851  1641 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8b20 after lost signal to thread 1644
I20260709 12:59:30.656008  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.642289  3076 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.620884  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:30.658793  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.663631  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.615475  3161 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:30.664575  3161 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.629235  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:30.654441  3120 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.615550  3104 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:30.618440  3135 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:30.615540  3151 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.657929  3153 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.693012  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.717079  3140 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.670979  3161 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.678966  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.800691  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.800941  3111 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.801467  1543 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:30.616899  3164 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.735929  3146 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.850467  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.724938  3076 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:30.658540  3115 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:30.748267  3127 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.851733  3107 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.853550  3160 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:30.678700  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.678277  3096 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.756129  3131 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.779646  3152 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.856760  3107 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.869285  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:30.870452  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.753079  3162 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.871402  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.874473  3166 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:30.854913  3115 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:30.885890  3168 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:30.856866  3160 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.868611  3113 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.902031  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:30.874981  3166 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:30.895419  3115 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.868824  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.894204  3164 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.855602  3076 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.902660  1688 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 1.
I20260709 12:59:30.901948  3168 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.894585  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:30.922036  1543 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:30.916136  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:30.922667  1689 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 1.
I20260709 12:59:30.897220  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:30.923828  3162 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.924957  3151 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:30.907804  3166 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.921413  3160 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.922128  3107 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.930496  3116 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:30.940085  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:30.940238  3104 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:30.981808  3168 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.005538  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.006346  1537 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:31.007486  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.024869  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.025842  1538 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:31.024228  3166 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.047251  3168 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.027598  1537 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
W20260709 12:59:31.049599  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.047793  3168 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.067950  3168 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.064088  3166 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.068323  3076 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:31.069063  1641 debug-util.cc:398] Leaking SignalData structure 0x7b0800363220 after lost signal to thread 1718
I20260709 12:59:31.070859  3115 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.073630  3115 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:31.077831  1641 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc800 after lost signal to thread 2301
I20260709 12:59:31.078341  3129 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.082283  3104 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.084296  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.087971  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:31.088841  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 202358us
I20260709 12:59:31.093021  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.093824  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.095775  3149 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.096040  3148 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.096907  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.097738  3144 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.096949  3123 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.099370  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.100194  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.100811  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.101401  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.102890  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1190) took 1340 ms. Trace:
I20260709 12:59:31.103349  1540 rpcz_store.cc:276] 0709 12:59:29.762104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.762236 (+   132us) service_pool.cc:224] Handling call
0709 12:59:29.762533 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:29.791882 (+ 29349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.791913 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:29.791950 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:29.791982 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.101846 (+1309864us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b540014cdd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:31.102716 (+   870us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.102824 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67107072}
I20260709 12:59:31.077849  3136 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.105983  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1202) took 1208 ms. Trace:
I20260709 12:59:31.106324  1544 rpcz_store.cc:276] 0709 12:59:29.897355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.897483 (+   128us) service_pool.cc:224] Handling call
0709 12:59:31.105824 (+1208341us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400283054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:31.105908 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337923328}
I20260709 12:59:31.097365  3124 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.108374  3114 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.111177  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.113219   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:59:31.113894  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.114666   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:31.115083  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.115255  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:31.115718  2275 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.117295  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.117893  1540 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:31.119119  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 1801) took 1172 ms. Trace:
I20260709 12:59:31.119468  1686 rpcz_store.cc:276] 0709 12:59:29.949266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.957159 (+  7893us) service_pool.cc:224] Handling call
0709 12:59:29.957482 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.087726 (+130244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.087754 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:30.087796 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:30.087827 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.118902 (+1031075us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54001a7f54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:31.118947 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.119049 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299066240}
I20260709 12:59:31.121044  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 358) took 1119 ms. Trace:
I20260709 12:59:31.121389  2277 rpcz_store.cc:276] 0709 12:59:30.001701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.560801 (+559100us) service_pool.cc:224] Handling call
0709 12:59:30.561061 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.616935 (+ 55874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.616974 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:30.617019 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:30.617056 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.120819 (+503763us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b540046e6d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:31.120860 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.120963 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128002432}
I20260709 12:59:31.123323  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 490) took 1044 ms. Trace:
I20260709 12:59:31.123737  2273 rpcz_store.cc:276] 0709 12:59:30.078912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.079581 (+   669us) service_pool.cc:224] Handling call
0709 12:59:30.868389 (+788808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.871435 (+  3046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.871469 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:30.871513 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:30.871544 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.871599 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.123156 (+251557us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b540071f550. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:31.123270 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786916992}
I20260709 12:59:31.124866  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.125418  1688 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:59:31.126787  1658 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.127460  3114 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.127502  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.127954  3114 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.128305  3129 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.128369  3114 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.128423  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.128784  3129 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.129175  3129 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.129261  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1188) took 1123 ms. Trace:
I20260709 12:59:31.129628  1658 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.129944  3115 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.130879  3107 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.131278  3107 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.130959  3115 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.131620  3107 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.131812  3115 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.131984  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.135905  3136 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:31.138276  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.138242  3115 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.140986  3115 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.143149  3107 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.144383  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 225) took 1043 ms. Trace:
I20260709 12:59:31.144891  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.144721  1545 rpcz_store.cc:276] 0709 12:59:30.101487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.101632 (+   145us) service_pool.cc:224] Handling call
0709 12:59:30.169465 (+ 67833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.619325 (+449860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.144174 (+524849us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400353c54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:31.144308 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020603776}
I20260709 12:59:31.145912  3011 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.146214  3011 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.146731  3011 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.147868  3133 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.150170  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.151620  3157 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.151678  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:31.152563  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.153317  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.153534  3011 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.154227  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.155311  3011 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.155256  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.156710  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.157297  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.158139  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 362) took 1140 ms. Trace:
I20260709 12:59:31.158452  2274 rpcz_store.cc:276] 0709 12:59:30.017932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.018096 (+   164us) service_pool.cc:224] Handling call
0709 12:59:30.037137 (+ 19041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.085326 (+ 48189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.085357 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:30.085392 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:30.085418 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.157846 (+1072428us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b540045b0d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:31.157887 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.157980 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110414592}
I20260709 12:59:31.159466  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.159675  3154 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.160065  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.160480  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.161947  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:31.162115  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.163152  1658 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.163833  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.163932  3120 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.164067  3011 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.164407  3120 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:31.164462  3011 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:31.164857  3120 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.164911  3011 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.166637  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.166942  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.167629  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.163928  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.167940  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.168594  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.168987  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.169538  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.170775  1693 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:31.171279  3160 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.171674  3160 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.172030  3160 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.172281  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.172848  1686 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:31.175061  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.129698  1542 rpcz_store.cc:276] 0709 12:59:30.006297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.018072 (+ 11775us) service_pool.cc:224] Handling call
0709 12:59:30.036885 (+ 18813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.072440 (+ 35555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.074111 (+  1671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:30.080772 (+  6661us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:30.082615 (+  1843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.129039 (+1046424us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b540025c6d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:31.129081 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.129207 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69587328}
I20260709 12:59:31.176260  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.176335  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.177574  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.177881  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.178697  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.178735  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.179049  3160 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:31.179494  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.179855  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.179972  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.180585  2272 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:59:31.180610  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.180938  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.181792  1691 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.182943  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.180981  3160 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:31.183979  3139 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.184324  3139 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:31.184667  3139 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.174991  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.186942  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.187503  1536 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.191045  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.192410  3139 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.192893  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.193027  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.194186  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.194725  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:31.196733  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.137040  3114 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.197476  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.197870  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.201967  3011 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.203197  3120 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.199955  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.199961  1510 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.196933  3107 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.207183  3143 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:31.207360  3174 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.207541  3143 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:31.207975  3143 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.212412  1509 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.212940  1536 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:31.213518  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.216307  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.216081  3143 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.218897  3143 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.219632  1545 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.220522  3131 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.220907  3131 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.221247  3131 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.222975  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.223639  3062 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.223948  3120 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.224298  3062 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.225800  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.225816  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.226462  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.226708  3152 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.227109  3152 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.227497  3152 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.228231  3131 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.230479  1510 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.231741  3174 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.232287  2275 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:31.248100  3116 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.248445  2269 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.248008  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.248736  3116 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.249503  3143 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.199843  3139 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.250643  3116 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.250515  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.201705  3114 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.234440  3159 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.235044  1658 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.251549  3159 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.252496  3139 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:31.253052  3139 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:31.253459  3159 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.235247  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.254062  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.254631  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.254329  3139 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.255064  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.255970  1612 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:31.258649  1616 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:31.259830  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.260528  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.236212  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.236580  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.236794  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.237289  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.262082  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.237679  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.240087  3152 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.241748  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.263383  1545 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:31.264520  3152 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.242035  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.264746  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.243010  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.243333  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.243526  1619 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:31.244545  1541 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:31.245326  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.243012  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.267757  2681 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.268227  2681 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.268589  3110 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:31.247146  1510 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e51c69bdb8c4616a20162792bc3e235. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:31.269054  3110 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.269883  2681 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.270311  2681 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.270799  3106 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.205751  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.260380  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.267139  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.271258  3106 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:31.271921  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 66198.4us
I20260709 12:59:31.271147  2681 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.272567  2241 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.272861  3152 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:31.273434  2681 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.273566  2241 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.273945  3174 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:31.274077  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:31.274147  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.274339  3174 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:31.274749  3104 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:31.274983  1686 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:31.275132  3104 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.275411  3131 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.275588  3104 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.275226  3174 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.275851  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.273164  3106 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.276396  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.273650  3133 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.276403  1693 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:31.277711  3174 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.278749  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.278914  3157 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:31.279266  3157 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.280035  3157 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.251523  3116 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.277396  3133 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.283192  3127 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.284013  3133 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.284682  3129 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.286096  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.286255  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.287034  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.287676  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.288142  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.288328  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.288642  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.288959  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.289736  3133 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.271348  3110 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.290191  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.290990  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.291265  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.292117  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.293313  3143 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.293710  3143 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:31.203733  3011 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.294037  1689 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:31.294524  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.295008  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.294051  3143 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.295363  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.297420  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.298588  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.299314  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.300762  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.303848  1612 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.304234  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.305819  1691 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.305672  3157 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.307174  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.308533  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.309094  1691 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 1.
I20260709 12:59:31.309262  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.309705  3143 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.310236  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.310750  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.311641  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.312168  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.312407  3170 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:31.313598  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.314733  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.315560  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.316002  2241 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.316237  1689 raft_consensus.cc:2393] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:31.316609  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.318742  1688 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.319340  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.320577  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.321069  3170 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.320096  3136 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.322018  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.323318  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.327785  2241 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.323983  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.325626  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.325539  3127 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:31.327983  3143 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.328945  1689 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:31.332896  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.333020  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.330045  3110 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.335439  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.336524  3133 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.330302  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:31.337527  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.338202  3110 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.338594  3110 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:31.338958  3110 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.340281  1442 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.341810  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.342494  3133 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.342865  3133 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:31.342886  3136 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.343343  3133 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.342881  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:31.344640  1660 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:31.345037  3139 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.345479  3139 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:31.345571  3176 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:31.346306  3139 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.346437  3176 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:31.330076  3104 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.346885  3176 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.343390  3127 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:31.352041  3152 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.352169  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.352049  1584 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.344558  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.352861  3152 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.358628  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:31.362241  1659 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.367487  1585 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:31.378577  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:31.379436  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.381191  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.383380  3011 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.385008  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:31.431334  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 50192.9us
I20260709 12:59:31.415159  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.386082  2681 consensus_queue.cc:1059] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:59:31.432082  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.388157  1688 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:31.432191  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 47264us
I20260709 12:59:31.388713  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.388160  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.366400  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.436283  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:31.363335  3104 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.436712  2269 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:31.438699  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.438854  3100 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.439378  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.351218  3127 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:31.436322  3169 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.439853  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.361255  3143 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.430545  3136 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.440465  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.440531  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.440678  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.441089  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.364562  3129 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.441633  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.441866  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.460345  1541 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:59:31.442683  1694 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.439467  3114 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.443737  2241 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.445086  3168 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.445719  3176 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.430591  3106 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:31.433691  1659 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.439520  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:31.391883  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.451458  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 12:59:31.468204  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 76437.1us
I20260709 12:59:31.468950  1660 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:31.361099  3152 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.430614  3131 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.474448  3131 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:31.475039  3131 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.475217  3106 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:31.475642  3140 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.476224  3106 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.441217  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:31.401039  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:31.479787  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 78813.6us
I20260709 12:59:31.480696  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.482064  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.483837  3159 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.459532  3116 raft_consensus.cc:3055] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:31.484705  2681 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.458357  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.441285  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:31.454478  3115 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.469931  3011 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.470687  1660 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:31.487367  3011 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:31.487888  3011 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.488773  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.470649  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.470518  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.490193  1659 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.491428  3160 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:31.491854  3160 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.492230  3160 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.473075  3176 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.473515  3147 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.473882  3107 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.477927  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.494071  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.495476  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.495528  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.501407  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.503647  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.502102  3147 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:31.507489  2274 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:31.507620  3147 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.467854  3100 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.509007  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.508370  3176 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.522531  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.487785  3116 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:31.500203  3114 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:31.498643  3096 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.503063  3129 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.532461  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.548115  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.499084  3104 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.521965  3124 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.509285  3076 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.495828  3156 consensus_queue.cc:1059] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:59:31.501943  3168 consensus_queue.cc:1059] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:59:31.546559  3142 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:59:31.548931  3100 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:31.542225  3114 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:31.553131  3120 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.523967  3115 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:31.534968  3154 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.545497  3159 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.565026  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.567323  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.564172  2681 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:31.535283  3152 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:31.555270  3148 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:31.570299  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 66744.8us
I20260709 12:59:31.571235  2241 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.531071  3111 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:59:31.544358  3125 consensus_queue.cc:1059] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:59:31.569285  3109 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.581521  3139 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.568261  3159 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:31.583166  3159 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.569502  3133 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.585619  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.588065  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.590718  3011 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.559249  3100 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:31.563122  3114 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.568482  3170 raft_consensus.cc:3055] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:31.593796  2943 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.607869  2681 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:31.612028  2681 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:31.608199  3011 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:31.558593  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 63089.8us
I20260709 12:59:31.613324  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.613547  3187 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.558830  3163 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:59:31.610097  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:31.615346  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 121347us
I20260709 12:59:31.616305  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.617164  1660 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.620343  3139 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.611701  3170 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:31.623835  3170 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:31.626325  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 59067.6us
I20260709 12:59:31.627507  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.574381  3157 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.631067  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.635613  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.592459  3104 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.635329  2681 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.612722  3100 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.569428  3165 consensus_queue.cc:1059] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:59:31.641736  3183 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.641804  3137 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.595881  3136 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.614781  3187 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.643606  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.645872  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:31.648468  1614 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:31.649191  3158 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.612152  3110 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.654450  3110 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.642515  3115 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.656308  2681 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.657672  1660 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.658205  3096 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.658282  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:31.658923  3096 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.659255  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.659984  3096 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.660365  3096 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.660698  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.661445  3176 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.662742  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.663455  3011 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.664386  1660 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.665048  3011 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.667372  1660 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.668805  3011 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.670507  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.677248  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.677443  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.677786  1617 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.679440  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.681073  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.681816  1618 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.683693  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.684708  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.685871  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.644428  3166 consensus_queue.cc:1059] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:59:31.670214  3114 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.657178  3125 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.716337  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:31.721848  3156 raft_consensus.cc:3055] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:31.722262  3156 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:31.722349  3109 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.728483  3160 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.723022  3156 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.724228  3143 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:31.724895  3118 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.644268  3127 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.728411  3114 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.739001  3156 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.738819  3118 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.713891  3165 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.754381  3158 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:31.754905  3158 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:31.735411  3143 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:31.764487  3170 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.739893  3133 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.767103  1617 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:31.769268  1660 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.770505  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.774987  3183 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.776573  3118 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.777753  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:31.779004  3147 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.780081  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.780825  3147 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.762151  3143 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.781301  3131 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.782729  1685 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.787992  1660 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:31.788924  3100 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.789616  3114 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:31.789988  2275 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:31.790042  3114 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:31.790983  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.791400  3114 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.792824  3108 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:31.793234  3108 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:31.794262  3108 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:31.735998  3125 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.787623  3183 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.805255  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.805526  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.802143  1612 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
W20260709 12:59:31.816074  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 267993us
I20260709 12:59:31.812091  3100 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:31.816520  3108 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.783933  3158 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.825657  3113 consensus_queue.cc:1059] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:59:31.832087  3113 raft_consensus.cc:3055] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:31.832163  3131 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:31.832458  3113 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:31.833122  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.833493  3113 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.835461  3113 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.845753  3125 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.852316  3158 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.851480  3159 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:31.884394  1509 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.885521  1509 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.886513  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.891845  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.892886  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.893764  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.894560  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:31.878262  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 262856us
I20260709 12:59:31.896925  1509 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.898651  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:31.896406  3148 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.904785  3148 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:31.905269  3148 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.898880  3124 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.890950  3062 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.895874  3123 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.896476  3120 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.910799  1538 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.899768  3174 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.895918  3188 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.898370  3140 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.901916  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.926951  1687 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.901520  3149 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:59:31.934857  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.925725  3062 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:31.939767  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.940573  1616 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.941113  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.941701  1616 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.930150  3160 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.949687  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:31.939807  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:31.959874  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.961555  3193 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:31.962522  3193 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:31.962882  3193 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:31.964195  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:31.969573  3127 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.967612  1658 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.968302  1611 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.967506  3183 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:59:31.975239  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:31.976037  1658 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.927987  1618 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:31.910547  3116 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:31.983153  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:31.985451  3011 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.987231  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:31.978873  3160 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.990005  3116 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.990401  1614 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.995193  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:31.970938  3139 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.979359  3147 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.980906  3111 raft_consensus.cc:3055] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:31.999374  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:31.993096  2243 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:31.991221  3131 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.005512  1658 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:32.000085  3159 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:31.978157  3143 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.009599  3011 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:32.011472  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.982218  3163 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:59:32.007803  3143 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:32.000907  3111 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:32.004971  3168 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:31.971380  3193 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.025957  3162 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:31.995487  3187 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:32.030053  3187 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.030411  3187 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:32.030733  3110 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.031095  3110 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:32.031143  3187 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.031921  3110 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.033030  3110 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.034420  3111 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.035684  3111 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.032377  3187 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.034922  3153 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:32.041759  3193 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.047894  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:32.052295  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:31.996089  3169 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:59:32.063252  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 377343us
I20260709 12:59:32.064193  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:32.036629  3162 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:32.070055  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.070955  3156 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.071369  3163 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.071460  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.043823  3168 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:32.074147  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:32.078112  1691 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.079416  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:32.081979  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:32.080477  1687 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.054946  3131 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:32.058601  3169 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:32.087248  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:32.090648  1685 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.086382  3152 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:32.093149  3152 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:32.093680  3152 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.095412  1687 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.097575  1617 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:32.098474  3162 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.099740  3162 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.078984  3125 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:32.102079  3125 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.103928  3125 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:32.109401  3131 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:32.112258  3131 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.115061  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:32.117856  1687 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.119058  3152 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.123502  3152 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:32.127179  3124 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.126814  3168 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.085142  3163 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.127911  1543 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.088253  3169 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:32.052418  3153 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.138094  3165 raft_consensus.cc:3055] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:32.144330  3200 ts_tablet_manager.cc:933] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:32.132419  3169 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.138509  3165 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:32.145386  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:32.153421  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.158460  3160 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:32.159029  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:32.164716  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 266110us
I20260709 12:59:32.148178  3165 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.143471  3148 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.165815   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:32.167052  1584 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.166296  1509 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.149580  3163 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:59:32.176759  1509 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.180747  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.166164  3158 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.174372  3111 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.188611  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.194294  1612 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.196139  3196 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.196738  3143 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.192483  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:32.195924  3110 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:32.202136  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:32.203703  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:32.204717  1687 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:32.182554  3124 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.212157  1543 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:32.210124  1687 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.206779  1615 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.206904  3110 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.188446  3113 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.200522  1539 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.228843  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:32.229491  1540 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.234154  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:32.233367  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:32.221204  3110 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:32.223196  3165 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.198050  3140 consensus_queue.cc:1059] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:59:32.254201  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:32.247452  1618 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:59:32.248226  3110 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.260680  1685 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.261188  1688 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.262596  1691 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.267935  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:32.269554  3062 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:32.270478  3062 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:32.274072  3062 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:32.275899  1693 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.276568  3062 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.281549  3113 consensus_queue.cc:1059] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:32.282104  3062 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.275364  3110 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.288843  3188 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:59:32.312451  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 12:59:32.313843  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 56004.5us
I20260709 12:59:32.310416  1540 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
W20260709 12:59:32.308561  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 395139us
I20260709 12:59:32.299748  3148 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:32.318987  1509 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.319774  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.331364  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.333047  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:32.316844  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:32.317056  1618 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.325467  3149 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.342438  3188 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:32.338428  3106 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.337925  3143 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.356623  1541 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.344543  3163 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.367328  3153 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:32.395900  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 99438.9us
W20260709 12:59:32.394654  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 60534.2us
I20260709 12:59:32.403100  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:32.404294  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.374826  3203 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:32.399097  3192 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:32.405443  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 80953.3us
I20260709 12:59:32.391003  3200 tablet_copy_client.cc:323] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 12:59:32.415843  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:32.418576  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:32.401340  3197 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:59:32.420480  3190 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.420724  1693 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.424690  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:32.432583  3169 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.425313  1690 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:59:32.435679  1694 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.414263  3192 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:32.437033  1540 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.413946  3170 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.433216  3111 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.436820  3162 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:32.441506  3204 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:32.449579  1611 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:32.459493  3174 raft_consensus.cc:3055] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:32.459874  3174 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:32.463048  3201 raft_consensus.cc:3055] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.463444  3201 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:32.464000  3192 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.465569  3192 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.466603  1554 tablet_copy_service.cc:140] P 0cccd9c43f9747529680a8e7463961c9: Received BeginTabletCopySession request for tablet 4e51c69bdb8c4616a20162792bc3e235 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:57234)
I20260709 12:59:32.466648  1510 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:32.466998  3154 raft_consensus.cc:3055] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.467226  1554 tablet_copy_service.cc:161] P 0cccd9c43f9747529680a8e7463961c9: Beginning new tablet copy session on tablet 4e51c69bdb8c4616a20162792bc3e235 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:57234: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-4e51c69bdb8c4616a20162792bc3e235
I20260709 12:59:32.467347  3154 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:32.425078  3203 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.468125  3154 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.469192  3154 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:32.449765  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.474040  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:32.444388  3210 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.440804  3156 consensus_queue.cc:1059] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:59:32.481400  3011 consensus_queue.cc:1059] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:32.458400  2269 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:32.486312  1543 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:32.471215  3062 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.488130  3168 consensus_queue.cc:1059] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:59:32.496896  3168 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.497247  3168 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 12:59:32.497692  3207 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
I20260709 12:59:32.495355  3213 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:32.493726  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:32.502456  3213 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:32.504350  3213 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.505815  3213 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.505895  3203 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:32.507639  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 331) took 1170 ms. Trace:
I20260709 12:59:32.473272  3162 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:32.512280  1691 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.516908  3124 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.518049  1544 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.523836  3120 raft_consensus.cc:3055] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.524184  3120 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:32.524942  3120 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:32.526113  3120 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.529995  3162 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.531039  1611 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:59:32.536643  1585 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:32.498087  3168 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.544775  1545 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.545696  3076 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:59:32.556474  3169 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.556842  3169 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:32.557538  3169 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:32.559325  2243 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:32.560314  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.563265  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.507984  1442 rpcz_store.cc:276] 0709 12:59:31.337591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.337721 (+   130us) service_pool.cc:224] Handling call
0709 12:59:32.507564 (+1169843us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:31.568693 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:31.728953 (+160260us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:31.728985 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:59:31.728999 (+    14us) tablet.cc:662] Decoding operations
0709 12:59:31.729319 (+   320us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:31.729363 (+    44us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:31.729386 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:31.729560 (+   174us) tablet.cc:701] Row locks acquired
0709 12:59:31.729576 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:59:31.729688 (+   112us) write_op.cc:270] Start()
0709 12:59:31.736110 (+  6422us) write_op.cc:276] Timestamp: P: 1783601971729654 usec, L: 0
0709 12:59:31.736431 (+   321us) op_driver.cc:348] REPLICATION: starting
0709 12:59:31.747575 (+ 11144us) log.cc:844] Serialized 541 byte log entry
0709 12:59:32.391977 (+644402us) op_driver.cc:464] REPLICATION: finished
0709 12:59:32.450412 (+ 58435us) write_op.cc:301] APPLY: starting
0709 12:59:32.450527 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:32.450648 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:32.450834 (+   186us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:32.451050 (+   216us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:32.451250 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:32.451306 (+    56us) write_op.cc:312] APPLY: finished
0709 12:59:32.452949 (+  1643us) log.cc:844] Serialized 23 byte log entry
0709 12:59:32.453672 (+   723us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:32.453772 (+   100us) write_op.cc:454] Released schema lock
0709 12:59:32.453833 (+    61us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":58199,"apply.run_cpu_time_us":2021,"apply.run_wall_time_us":21275,"num_ops":1,"prepare.queue_time_us":205544,"prepare.run_cpu_time_us":48372,"prepare.run_wall_time_us":529095,"raft.queue_time_us":146070,"replication_time_us":655369,"spinlock_wait_cycles":19987328,"thread_start_us":662943,"threads_started":4,"wal-append.queue_time_us":490168}]]}
I20260709 12:59:32.540696  3110 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.545265  3106 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.577778  3196 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:32.582970  3196 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:32.569860  3100 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.549369  3139 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:59:32.546308  3214 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:59:32.577826  3168 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.576184  3110 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:32.512955  3174 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.580303  3169 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.585148  3196 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:32.611366  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.623723  1691 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.625030  1618 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:32.625979  1687 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.632831  3120 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:32.634552  3212 consensus_queue.cc:1059] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:59:32.636108  3139 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:59:32.640323  3110 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.663405  3110 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.678855  3201 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.683164  1617 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.683596  3139 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:32.685870  3201 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.701125  1554 tablet_copy_source_session.cc:215] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:32.704397  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e51c69bdb8c4616a20162792bc3e235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.704872  3174 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.709049  3147 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.709446  3147 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:32.711735  3212 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.712153  3212 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:32.712874  1541 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:59:32.713016  1618 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:32.713475  1541 pending_rounds.cc:85] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 2
I20260709 12:59:32.713773  1541 pending_rounds.cc:107] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.3
I20260709 12:59:32.714078  1541 raft_consensus.cc:2917] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Aborting config change with OpId 2.3: Aborted: Op aborted by new leader
I20260709 12:59:32.714511  1541 raft_consensus.cc:2889] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:32.714758  3203 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:59:32.718539  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:57224 (request call id 13) took 2626 ms. Trace:
I20260709 12:59:32.718962  1541 rpcz_store.cc:276] 0709 12:59:30.092289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.095267 (+  2978us) service_pool.cc:224] Handling call
0709 12:59:30.916145 (+820878us) log.cc:844] Serialized 506 byte log entry
0709 12:59:32.718438 (+1802293us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":255,"raft.run_cpu_time_us":1588,"raft.run_wall_time_us":1586,"thread_start_us":158855,"threads_started":1,"wal-append.queue_time_us":159116,"wal-append.run_cpu_time_us":1555,"wal-append.run_wall_time_us":1009549}
I20260709 12:59:32.710304  3147 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.722738  3147 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.724284  3011 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:32.736500  1491 auto_rebalancer.cc:629] Failed to schedule move for tablet 4e51c69bdb8c4616a20162792bc3e235: Aborted: Op aborted by new leader
I20260709 12:59:32.712936  3212 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.742313  3212 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.753530  1691 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:32.742308  3225 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.101s	user 0.003s	sys 0.000s
I20260709 12:59:32.754524  1690 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:32.777253  3222 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:59:32.780277  1443 catalog_manager.cc:5697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.796989  1443 catalog_manager.cc:5697] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 3, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.774102  1691 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:32.811110  3203 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:32.816262  3200 tablet_copy_client.cc:806] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:32.816921  3200 tablet_copy_client.cc:670] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:32.830715  3200 tablet_copy_client.cc:538] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:32.876048  1617 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:32.878062  1545 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:32.879313  3139 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:32.879262  1659 consensus_peers.cc:597] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82622e43412243cb95bf17b246050060. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.880801  3114 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:32.904613  3200 tablet_bootstrap.cc:492] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:32.914894  3147 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:32.918581  1617 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:32.920920  1442 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.924014  1442 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 3 to 4, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:32.957331  2276 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:32.958874  3153 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:32.966317  1439 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.968313  1439 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.971735  1541 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:32.973189  3153 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:32.975755  3200 tablet_bootstrap.cc:492] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:59:32.982913  3200 tablet_bootstrap.cc:492] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:32.983722  3200 ts_tablet_manager.cc:1403] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.007s
I20260709 12:59:32.988461  3200 raft_consensus.cc:359] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:32.991820  3200 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:32.992528  3200 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:33.009323  3200 ts_tablet_manager.cc:1434] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:59:33.014238  1540 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:33.019840  1554 tablet_copy_service.cc:342] P 0cccd9c43f9747529680a8e7463961c9: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-4e51c69bdb8c4616a20162792bc3e235 received from {username='slave'} at 127.0.0.1:57234
I20260709 12:59:33.020264  1554 tablet_copy_service.cc:434] P 0cccd9c43f9747529680a8e7463961c9: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-4e51c69bdb8c4616a20162792bc3e235 on tablet 4e51c69bdb8c4616a20162792bc3e235 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:33.045109  1491 auto_rebalancer.cc:629] Failed to schedule move for tablet 4d3947e120494929a5b22c639f5d830c: Illegal state: Replica 0cccd9c43f9747529680a8e7463961c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 12:59:33.051148  1691 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:33.049464  1443 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.054873  3153 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.061095  3153 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.062975  3192 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.063421  3192 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.064992  3192 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.060274  1617 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:33.065928  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:33.060365  1659 consensus_peers.cc:597] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b25acf355940411ba0ffd6483b7467c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.068114  3214 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:33.075201  1537 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:33.069806  3153 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:33.071116  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:33.078068  2276 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:33.068878  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.079388  1690 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:33.080669  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:33.081365  3153 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.081763  3153 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.082026  1585 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.082094  3153 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.083379  3114 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:33.085525  3139 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:33.086856  3192 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:33.087234  3192 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.087548  3192 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.096100  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.096650  1691 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:59:33.095113  1617 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:33.098745  3168 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:33.099201  3168 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.101019  3168 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.103967  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.104714  1611 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 2: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:33.116518  3153 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.119215  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.119796  1540 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:33.120208  3192 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.120630  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:33.121563  3168 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:33.123548  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:33.123991  3168 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:33.121670  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.124533  2276 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.124547  3168 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.122794  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:33.127833  1690 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.147533  2276 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:33.148633  1585 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.153316  3153 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.156250  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:33.156777  1691 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.157531  3192 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:33.160127  1442 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.154739  3168 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.158262  3109 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:33.183121  1541 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:33.184650  1690 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:33.183080  2276 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:33.191145  1691 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:33.195175  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:33.193807  3114 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.200098  3110 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:33.197912  3114 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:33.200827  3110 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:33.201659  3110 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.202955  3114 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:33.203867  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.204429  1541 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:33.205561  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:33.207542  3139 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.207702  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.207950  3139 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.199082  3109 raft_consensus.cc:697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:33.208328  1611 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:33.208304  3139 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.195359  3158 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:59:33.210632  3214 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.211956  3168 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.212080  3214 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.212884  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:33.213608  1611 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 2: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:33.215063  3192 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:59:33.209177  3109 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.223579  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.224145  1611 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:33.225207  1660 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:33.225981  3114 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.222856  3214 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.226380  3114 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.226926  3114 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.232658  3139 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:33.235635  3139 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:33.237023  3114 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.242697  3114 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.280144  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.285553  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:33.286816  1617 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.289201  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:33.290155  1618 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.297626  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.298441  1540 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:33.306557  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.307528  1545 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.290521  1541 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:33.325484  3168 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.326210  3168 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.330080  3200 ts_tablet_manager.cc:933] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.312651  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.332967  1540 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.331887  3168 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.335405  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.336180  1544 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:33.340451  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:33.349825  3114 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.350513  3114 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.351392  3168 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.352943  3168 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.353097  3114 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.354395  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.355221  1611 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:33.356079  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.356599  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:33.358335  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.359067  3147 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.359493  3147 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.359803  3147 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.362069  1691 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:33.366916  1540 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:33.369525  1618 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:33.353365  3168 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.380932  1537 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:33.376698  1545 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:33.383438  3110 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.385748  3110 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.386333  3200 tablet_copy_client.cc:323] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:33.388325  3110 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.397994  1658 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:33.399351  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:33.399881  3160 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:33.408694  1443 catalog_manager.cc:5697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.400527  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.412397  3160 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:33.412968  1443 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.413803  3160 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.410089  3192 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.416805  3192 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.417994  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:33.421181  3192 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:33.423915  3104 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:33.425056  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:33.429860  3114 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:33.430454  3114 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:33.434603  3114 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:33.440837  3168 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.423354  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.437448  1617 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:33.440467  3109 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.435246  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet 82622e43412243cb95bf17b246050060 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:33.441221  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.450562  3104 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:33.456970  3147 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.460098  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet 82622e43412243cb95bf17b246050060 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-82622e43412243cb95bf17b246050060
I20260709 12:59:33.460002  3109 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.463937  3168 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.465248  3212 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:33.465421  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.466097  1545 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:33.465838  3212 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.466516  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.467283  1690 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:33.467425  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.468323  3110 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.468712  3110 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.468925  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:33.469111  3110 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.469578  1617 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.469672  1537 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:33.462522  3252 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.475481  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.463069  3147 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.484304  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.486184  1584 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.486990  3252 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.489516  3252 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.490944  1690 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:33.492548  3192 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:33.493036  3192 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.493548  3192 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.471132  3212 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:33.504575  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.505283  1442 catalog_manager.cc:5697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 4, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.506232  1618 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:33.508468  3104 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.509399  2243 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.510281  3168 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.510686  3168 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.511185  3168 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.465399  3109 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.513298  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:33.514196  2273 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:33.504714  1691 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:33.516637  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:33.516670  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:33.517784  3212 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:33.518181  3212 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:33.518513  3212 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.524159  3109 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.524546  3109 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.525000  3109 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.535205  3201 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:33.535858  3249 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:59:33.535780  3201 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.540201  1617 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:33.543277  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:33.543284  3110 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.544457  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.545033  3210 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.545320  1611 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:33.545692  3210 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.546841  3147 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:33.547290  1511 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.548326  3174 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:33.548745  3174 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.549080  3174 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.549964  3210 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.547374  3147 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:33.552507  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.553151  1543 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.552743  3147 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.533311  1704 tablet_copy_source_session.cc:215] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:33.557601  3174 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.561944  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:33.562517  3201 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.562850  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.563439  3110 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.563469  1541 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.562530  1691 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.568779  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.570478  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:33.571089  1690 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.571837  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.572549  1537 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:33.576053  1658 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:33.586130  3139 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:33.587268  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.589990  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.592408  1541 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:33.584836  3109 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.598865  1690 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:33.618054  1543 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:33.606418  1693 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:59:33.620913  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:33.621402  1690 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.598949  1691 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:33.613580  3212 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.628089  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:33.628770  1693 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:33.629699  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:33.629253  3212 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:33.631995  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.623005  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.634583  3110 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:33.635111  3110 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:33.611946  3109 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.636077  3110 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.596652  3139 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.637830  3139 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.647933  3201 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.648643  3201 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.656991  3201 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.657874  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.658649  1693 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:33.603051  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82622e43412243cb95bf17b246050060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:33.663947  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.664559  1690 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:33.667924  2276 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:33.665808  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:33.669170  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:33.673636  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:33.673224  3212 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:33.660668  3168 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.691138  3251 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:33.691323  3244 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:33.691819  3244 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:33.692735  3244 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.699993  3254 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.700538  3254 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.702982  3251 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:33.704028  3174 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.703925  3251 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.689602  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:59:33.705060  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 43700.1us
I20260709 12:59:33.702678  3254 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.708387  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:33.709156  3158 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:33.716255  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.716867  3158 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.717239  1543 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:33.712633  1691 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.709738  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.718348  3174 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:33.715914  3201 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.715847  1544 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.717157  3109 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:33.689213  3212 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 12:59:33.726706  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 53787.5us
I20260709 12:59:33.728770  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.730178  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:33.730638  1618 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.722903  3201 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.747056  3158 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.747567  1540 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:33.747051  3201 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.747097  1544 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:33.742641  1443 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.719573  3139 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.724059  3174 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.785364  2271 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:33.801369  3174 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.801831  3174 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:33.731873  3109 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.804381  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.804682  3109 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.773279  3114 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.758251  3192 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.807112  3158 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:33.807827  3192 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:33.808773  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:33.809077  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.809396  1615 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.809820  1690 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:33.811301  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 12:59:33.797708  3262 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 12:59:33.798911  3168 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:33.815510  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 97038.8us
I20260709 12:59:33.816256  1691 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:33.820538  3263 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:33.821823  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:33.834411  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.835106  1693 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:33.805722  3114 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.837098  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.821244  3263 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.841596  3201 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.843848  3139 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.843976  1693 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:33.844163  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.845417  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:33.845698  1615 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:33.802350  3174 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.844426  3139 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.848640  3192 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:33.852216  3139 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.816860  1611 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:33.856933  3139 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.857080  3114 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:33.858048  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.860387  3174 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.862133  3174 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.782357  3212 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:33.863734  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.864463  1617 raft_consensus.cc:2368] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4.
I20260709 12:59:33.865649  3158 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:33.866345  3158 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.866875  3263 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.847230  3104 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.867843  3104 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.868193  3104 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.868573  3158 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.852635  1618 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:33.871079  1690 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:33.871220  1511 leader_election.cc:400] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4.
I20260709 12:59:33.871622  1511 leader_election.cc:403] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:33.872119  3263 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.848119  2243 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.873479  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.874214  1694 raft_consensus.cc:2368] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3.
I20260709 12:59:33.872262  1511 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:33.893049  1584 leader_election.cc:400] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3.
I20260709 12:59:33.893458  1584 leader_election.cc:403] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:33.895691  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 48521.9us
I20260709 12:59:33.901882  1540 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.845721  3111 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.907645  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:33.872241  1440 catalog_manager.cc:5697] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.862603  3174 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:33.917194  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.916181  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:33.917704  1543 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.918020  1691 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:33.936640  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.912328  3158 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.895582  3192 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:33.959718  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.916512  3109 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:33.934046  3174 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.966558  1544 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:33.959875  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:33.936729  3110 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:59:33.966096  3109 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:33.979282  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 80377.4us
I20260709 12:59:33.984663  1543 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:33.933753  3111 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:33.992995  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:33.979876  3109 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.993759  1545 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.979081  3201 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:33.997360  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:33.997990  1544 raft_consensus.cc:2368] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:33.979727  1611 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:33.986961  3212 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.991824  3251 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.007318  1540 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:34.009011  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:33.995788  3255 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.017706  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:34.018472  1538 raft_consensus.cc:2368] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3.
I20260709 12:59:34.023295  3213 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:34.023526  3264 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:34.049332  3213 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.050697  3272 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:34.051128  3272 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.051494  3272 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.051807  3213 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:34.054273  3111 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.054754  3111 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:34.055209  3111 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.056169  1443 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 2 to 3, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.057130  3111 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.058286  3111 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.061488  3261 ts_tablet_manager.cc:933] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.026060  3245 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.012503  3212 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.016151  3251 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.043069  3255 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:34.117856  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.118713  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.115521  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:34.123104  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 77599.4us
I20260709 12:59:34.114164  1442 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 3 to 5, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.081693  3244 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.144879  1442 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 4, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:34.144673  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:34.161831  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.162102  1694 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.162565  1688 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:34.163242  3255 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.122192  3111 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.206836  1545 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:34.208832  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:34.215441  1543 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:34.140403  3264 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:34.231896   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:34.232096  1611 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:34.233960  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.234715  1687 raft_consensus.cc:2368] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4.
W20260709 12:59:34.234795  3268 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:59:34.148388  3244 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.240401  3244 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:34.242806  3011 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.243233  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:34.243345  3011 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.243928  2273 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:34.244729  3201 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:34.245076  3201 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:34.245128  3011 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:34.245503  3201 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:34.249742  3109 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.126626  3245 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.266544  3264 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.267313  3114 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.267975  3114 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.270874  1509 leader_election.cc:400] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4.
I20260709 12:59:34.271263  1509 leader_election.cc:403] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:34.278242  1618 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:34.217902  3192 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:34.245898  3104 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.250463  1694 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:34.278831  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:34.289937  3160 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:34.300096  1544 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:59:34.310478  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 143386us
I20260709 12:59:34.326771  1538 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:34.309682  3251 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.303241  3192 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.316774  1615 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:34.335935  1658 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:34.333204  3147 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.336885  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:34.337380  3147 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.338784  1613 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:34.340065  3192 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.323655  3263 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4.
I20260709 12:59:34.338814  3109 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.341645  3245 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:34.328685  3160 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.344318  3168 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:34.345319  3278 raft_consensus.cc:3055] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:34.345680  3278 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:34.324436  3114 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:34.346436  3278 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.347379  1540 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:34.338512  3265 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.349747  3114 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:34.350224  3114 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:34.351984  3147 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:34.351778  3174 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.352875  1541 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:34.352937  3114 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.353876  3174 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.338143  3104 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.356514  3272 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:34.372064  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 126089us
I20260709 12:59:34.373571  1585 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:34.357432  3104 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:59:34.379767  3011 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:34.380208  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:34.382104  3011 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:34.384438  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:34.385062  1543 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:34.385874  3281 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.386355  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:34.386984  2277 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:34.386384  3281 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.389441  1585 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:34.389688  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:34.435319  2274 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
W20260709 12:59:34.436570  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 159088us
W20260709 12:59:34.435910  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44418.8us
I20260709 12:59:34.380860  3244 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:34.440605  1658 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:34.382802  2271 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:34.449229  3289 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:34.449628  3289 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.449951  3289 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.450410  3158 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3.
I20260709 12:59:34.451048  3272 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:34.451435  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45402 (request call id 460) took 1124 ms. Trace:
I20260709 12:59:34.452664  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:34.452026  3200 rpcz_store.cc:276] 0709 12:59:33.327392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.328543 (+  1151us) service_pool.cc:224] Handling call
0709 12:59:33.330543 (+  2000us) ts_tablet_manager.cc:934] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
0709 12:59:33.597777 (+267234us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:33.990939 (+393162us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:33.995120 (+  4181us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:34.346598 (+351478us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:34.374287 (+ 27689us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:34.451310 (+ 77023us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:34.451368 (+    58us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":2661,"tablet-copy.queue_time_us":523,"thread_start_us":50922,"threads_started":1}
I20260709 12:59:34.454095  3200 tablet_copy_client.cc:806] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:34.454711  3200 tablet_copy_client.cc:670] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:34.466383  3011 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:34.466879  3011 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.467252  3011 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.470503  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:34.444204  3244 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.476095  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:34.476881  1539 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.477185  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:34.478022  1537 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:34.486660  3212 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.439354  3281 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:34.524149  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:34.536845  1584 leader_election.cc:400] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:34.537127  1584 leader_election.cc:403] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:34.538147  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:34.538724  1614 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:34.539953  1584 leader_election.cc:400] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3.
W20260709 12:59:34.540220  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 65732.9us
I20260709 12:59:34.542115  1613 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:34.543638  1584 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:34.545298  3158 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:34.545439  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:34.545816  3158 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:34.536381  3192 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.546512  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:34.547045  3192 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.548156  1620 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 2: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:34.549170  3192 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.549815  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:34.550307  1613 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.549543  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.550463  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:34.551067  1694 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:34.551194  1616 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:34.552291  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:34.552307  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:34.553278  1694 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.555156  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:34.559811  3282 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.560276  3282 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:34.560477  1693 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:34.561638  1694 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:34.561085  3282 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.562212  3298 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:34.565166  1613 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:34.566406  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:34.569674  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:34.573912  3111 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.574411  2276 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:34.472270  3272 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:59:34.575601  3265 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4.
I20260709 12:59:34.579772  3158 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.518291  3244 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:34.586464  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:34.591848  1540 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:34.598867  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:34.589300  3011 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:34.609783  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 79328.3us
I20260709 12:59:34.610965  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:34.612504  1618 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:34.613742  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:34.614401  1544 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.617851  3011 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:34.591513  3298 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.618986  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:34.620373  3111 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:59:34.623001  3267 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:34.611220  2273 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:34.621558  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:34.541608  3201 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.630333  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:34.654285  3284 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.644336  1544 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:34.642503  1613 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:34.625840  3298 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.657473  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:34.656733  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:34.677173  3279 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.677827  3279 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 12:59:34.678223  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 94687.8us
I20260709 12:59:34.679045  3254 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.679592  3254 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:34.680462  3254 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.682811  3114 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:34.683220  3114 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.683094  3299 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:34.683663  3114 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.684779  3279 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.685627  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:34.687348  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 65862.7us
I20260709 12:59:34.687986  3251 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:34.714457  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:34.715101  1544 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.716131  3276 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:34.716354  3200 tablet_copy_client.cc:538] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:34.715998  3255 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:34.716553  3276 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.646570  3265 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:34.716980  3276 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:34.717060  3265 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.717483  3265 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.718721  1538 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:34.724399  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:34.724962  1616 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.727531  1615 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:34.731169  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.712940  3251 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.735522  1544 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:34.734022  1660 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:34.737453  3011 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.737540  1687 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:34.736713  3251 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.747896  1616 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:34.748247  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:34.749202  1544 raft_consensus.cc:2368] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:34.760886  1687 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:34.747882  3261 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.021s	sys 0.033s
I20260709 12:59:34.737402  3278 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:34.761689  3261 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.021s	sys 0.034s
I20260709 12:59:34.762426  1613 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:34.733332  1539 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:34.762773  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:34.768787  1687 raft_consensus.cc:2368] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:34.763358  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:34.769390  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:34.760700  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 72552.2us
I20260709 12:59:34.772809  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:34.773042  1616 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:34.774036  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:34.733379  3281 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:59:34.777261  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:34.777814  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.777348  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 90301.6us
I20260709 12:59:34.786217  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.787499  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:34.788158  1543 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:34.794118  3261 tablet_copy_client.cc:323] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:34.794010  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.796270  1542 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:34.798032  3313 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:34.798446  3201 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.799597  3270 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:34.799985  3270 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:34.800329  3270 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.798450  3313 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.801599  3313 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.803107  3011 raft_consensus.cc:697] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:34.783667  3114 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.784574  3284 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:34.816473  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.817549  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:34.764081  3299 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:59:34.816368  3011 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.822912  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:34.785022  3263 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:59:34.825309  3244 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.810736  3210 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.837438  3298 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.839107  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:34.792670  3104 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:59:34.865190  1539 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:34.883817  1690 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:34.884871  3289 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.885669  3298 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:34.887929  3251 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.833796  3270 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.826380  3290 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:59:34.833721  3276 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.814790  3160 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:34.892869  1693 raft_consensus.cc:2368] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5.
W20260709 12:59:34.896770  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 99432.9us
I20260709 12:59:34.865862  1687 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:34.896195  3251 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:34.887619  3313 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:34.894425  3210 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:34.920856  1691 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:34.920971  1694 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:34.907334  1685 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:34.921200  1611 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:34.945911  1584 leader_election.cc:400] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:34.946202  1584 leader_election.cc:403] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:59:34.946498  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:34.949288  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:34.950294  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:34.951208  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:34.951917  1618 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:34.839715  3265 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:34.956092  1541 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:34.965693  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 55365.4us
I20260709 12:59:34.956065  3109 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:34.952843  3192 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:34.969658  1544 raft_consensus.cc:2368] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:34.982998  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:34.968973  1704 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet b25acf355940411ba0ffd6483b7467c3 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:34.969156  3109 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.996483  1584 leader_election.cc:400] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:34.954339  3158 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:59:34.993479  3210 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:35.004215  1704 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet b25acf355940411ba0ffd6483b7467c3 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-b25acf355940411ba0ffd6483b7467c3
I20260709 12:59:35.004277  3297 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:59:34.995889  3270 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:35.002894  3109 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:35.025820  3114 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:35.050760  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:35.037353  3289 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:35.058921  1614 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:35.006126  3312 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:59:35.050576  3287 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 12:59:35.069826  3314 log.cc:927] Time spent T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:59:35.077404  1689 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:35.039362  3245 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:59:35.080801  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:35.086710  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:35.087268  2270 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:35.088168  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:35.089401  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:35.090296  2271 raft_consensus.cc:2368] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5.
I20260709 12:59:35.044924  3201 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:35.084856  3313 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:35.045967  3276 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:35.111776  3318 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:59:35.110050  3265 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:35.121423  1704 tablet_copy_source_session.cc:215] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:35.121622  3200 tablet_bootstrap.cc:492] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
W20260709 12:59:35.133394  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 132326us
I20260709 12:59:35.140903  2270 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:35.177044  3109 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:35.182317  3109 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:35.191967  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:35.192618  1613 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:59:35.204299  3198 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.593s	user 0.004s	sys 0.000s
I20260709 12:59:35.204263  1613 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:35.223531  1659 leader_election.cc:400] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5.
I20260709 12:59:35.223887  1659 leader_election.cc:403] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:35.224824  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:35.225423  3011 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:35.225925  3210 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:35.226440  3210 raft_consensus.cc:697] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:35.227339  3210 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:35.233232  3011 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5.
I20260709 12:59:35.243618  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 340) took 1201 ms. Trace:
I20260709 12:59:35.250782  3244 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:35.256721  1541 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:35.258502  3252 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:35.262423  3289 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:35.262997  3289 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:35.264953  3289 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:35.233507  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 332) took 1455 ms. Trace:
I20260709 12:59:35.265985  1440 rpcz_store.cc:276] 0709 12:59:33.778257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.778430 (+   173us) service_pool.cc:224] Handling call
0709 12:59:33.869397 (+ 90967us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0f090 00007f29ebdadf3a 00007f29f1b641cc 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc 00007f29f0122392 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:35.233428 (+1364031us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:33.961165 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:34.009365 (+ 48200us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:34.009936 (+   571us) write_op.cc:435] Acquired schema lock
0709 12:59:34.009952 (+    16us) tablet.cc:662] Decoding operations
0709 12:59:34.036249 (+ 26297us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:34.043275 (+  7026us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:34.044805 (+  1530us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:34.108132 (+ 63327us) tablet.cc:701] Row locks acquired
0709 12:59:34.108176 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:59:34.127236 (+ 19060us) write_op.cc:270] Start()
0709 12:59:34.141097 (+ 13861us) write_op.cc:276] Timestamp: P: 1783601974125818 usec, L: 0
0709 12:59:34.141134 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:59:34.269958 (+128824us) log.cc:844] Serialized 541 byte log entry
0709 12:59:34.615753 (+345795us) op_driver.cc:464] REPLICATION: finished
0709 12:59:34.795069 (+179316us) write_op.cc:301] APPLY: starting
0709 12:59:34.795153 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:34.795252 (+    99us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:34.795353 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:34.795598 (+   245us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:34.795745 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:34.795784 (+    39us) write_op.cc:312] APPLY: finished
0709 12:59:34.795954 (+   170us) log.cc:844] Serialized 23 byte log entry
0709 12:59:34.817147 (+ 21193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:34.821979 (+  4832us) write_op.cc:454] Released schema lock
0709 12:59:34.822021 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:34.822365 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:34.822392 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":142032640,"child_traces":[["op",{"apply.queue_time_us":156668,"apply.run_cpu_time_us":1645,"apply.run_wall_time_us":27284,"mutex_wait_us":9623,"num_ops":1,"prepare.queue_time_us":17324,"prepare.run_cpu_time_us":8827,"prepare.run_wall_time_us":331848,"replication_time_us":455514,"thread_start_us":96847,"threads_started":1}]]}
I20260709 12:59:35.236366  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:35.270334  3111 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:35.270805  3111 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:35.271627  3111 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:35.237363  1439 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:35.244076  1443 rpcz_store.cc:276] 0709 12:59:34.042095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.042350 (+   255us) service_pool.cc:224] Handling call
0709 12:59:35.243554 (+1201204us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:34.307260 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:34.339009 (+ 31749us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:34.339038 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:59:34.339054 (+    16us) tablet.cc:662] Decoding operations
0709 12:59:34.339344 (+   290us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:34.339380 (+    36us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:34.339409 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:34.339579 (+   170us) tablet.cc:701] Row locks acquired
0709 12:59:34.339595 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:59:34.339705 (+   110us) write_op.cc:270] Start()
0709 12:59:34.339805 (+   100us) write_op.cc:276] Timestamp: P: 1783601974339669 usec, L: 0
0709 12:59:34.339825 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:59:34.577735 (+237910us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5400085aa0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd22520 00007f29ebdabb42 00007f29ebda0f67 00007f29ebda0da4 00007f29ef7db581 00007f29ef7dad58 00007f29ef7df9f1 00007f29ef7df9a9 00007f29ef7df939 00007f29ef7df901
0709 12:59:34.578427 (+   692us) log.cc:844] Serialized 536 byte log entry
0709 12:59:35.208380 (+629953us) op_driver.cc:464] REPLICATION: finished
0709 12:59:35.208882 (+   502us) write_op.cc:301] APPLY: starting
0709 12:59:35.208959 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:35.209066 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:35.209089 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:35.209436 (+   347us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:35.209572 (+   136us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:35.209625 (+    53us) write_op.cc:312] APPLY: finished
0709 12:59:35.209771 (+   146us) log.cc:844] Serialized 23 byte log entry
0709 12:59:35.209900 (+   129us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:35.209957 (+    57us) write_op.cc:454] Released schema lock
0709 12:59:35.209988 (+    31us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:35.210265 (+   277us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:35.210286 (+    21us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32144,"reported_tablets":1,"spinlock_wait_cycles":6912,"child_traces":[["op",{"apply.queue_time_us":206,"apply.run_cpu_time_us":1236,"apply.run_wall_time_us":1363,"num_ops":1,"prepare.queue_time_us":236842,"prepare.run_cpu_time_us":5417,"prepare.run_wall_time_us":274669,"replication_time_us":868211,"spinlock_wait_cycles":36455680}]]}
I20260709 12:59:35.293829  1613 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:35.297178  3273 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:35.300053  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:35.303445  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 338) took 1498 ms. Trace:
I20260709 12:59:35.415211  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:35.303824  1442 rpcz_store.cc:276] 0709 12:59:33.805185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.805742 (+   557us) service_pool.cc:224] Handling call
0709 12:59:33.895805 (+ 90063us) spinlock_profiling.cc:243] Waited 82.2 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0f090 00007f29ebdadf3a 00007f29f1b641cc 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc 00007f29f0122392 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:35.303387 (+1407582us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:34.614128 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:34.681338 (+ 67210us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:34.681380 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:59:34.681404 (+    24us) tablet.cc:662] Decoding operations
0709 12:59:34.681853 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:34.681893 (+    40us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:34.681915 (+    22us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:34.682197 (+   282us) tablet.cc:701] Row locks acquired
0709 12:59:34.682214 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:34.682325 (+   111us) write_op.cc:270] Start()
0709 12:59:34.682433 (+   108us) write_op.cc:276] Timestamp: P: 1783601974682290 usec, L: 0
0709 12:59:34.682448 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:59:34.792696 (+110248us) log.cc:844] Serialized 925 byte log entry
0709 12:59:35.212062 (+419366us) op_driver.cc:464] REPLICATION: finished
0709 12:59:35.212448 (+   386us) write_op.cc:301] APPLY: starting
0709 12:59:35.212505 (+    57us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:35.212597 (+    92us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:35.212700 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:35.213020 (+   320us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:35.213202 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:35.213247 (+    45us) write_op.cc:312] APPLY: finished
0709 12:59:35.213393 (+   146us) log.cc:844] Serialized 29 byte log entry
0709 12:59:35.213503 (+   110us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:35.213569 (+    66us) write_op.cc:454] Released schema lock
0709 12:59:35.213616 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:35.256548 (+ 42932us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda0e28 00007f29ef7db581 00007f29ef7dad58 00007f29ef7df9f1 00007f29ef7df9a9 00007f29ef7df939 00007f29ef7df901 00007f29ef7deb2d 000000000038f354 000000000038f199
0709 12:59:35.256765 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:35.256791 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27108,"reported_tablets":2,"spinlock_wait_cycles":189154560,"child_traces":[["op",{"apply.queue_time_us":193,"apply.run_cpu_time_us":1381,"apply.run_wall_time_us":1416,"num_ops":2,"prepare.queue_time_us":333957,"prepare.run_cpu_time_us":8533,"prepare.run_wall_time_us":648016,"replication_time_us":529481,"spinlock_wait_cycles":121667968}]]}
I20260709 12:59:35.428392  2275 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:35.429364  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:35.420778  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:35.443078  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:35.444024  2273 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:35.447896  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:35.451582  1620 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:35.452678  1614 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:35.455369  1612 raft_consensus.cc:2368] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5.
I20260709 12:59:35.455850  3201 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:35.467417  2275 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:59:35.467787  2275 pending_rounds.cc:85] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 4
I20260709 12:59:35.467995  1660 leader_election.cc:400] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5.
I20260709 12:59:35.468039  2275 pending_rounds.cc:107] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:35.468670  2275 raft_consensus.cc:2889] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:35.475402  1615 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:35.483705  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 452726us
I20260709 12:59:35.486065  1613 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:35.487092  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:35.488039  1620 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:35.491443  3267 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.492029  3267 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:35.497375  1509 leader_election.cc:400] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5.
I20260709 12:59:35.498368  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:35.499532  3201 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:35.500082  3201 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:35.500252  1615 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:35.501566  1509 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:35.514478  3139 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:59:35.552214  3294 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:35.551564  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:35.527422  3273 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:35.532047  3212 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:35.515116  3201 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:35.582422  1540 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:35.628906  1658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.005s	sys 0.036s
W20260709 12:59:35.937038  1618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.017s
W20260709 12:59:35.955251  1618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.006s	sys 0.017s
I20260709 12:59:35.962419  3282 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:35.962992  3282 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:35.965250  3282 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:35.967872  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 12:59:35.942905  1658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.007s	sys 0.046s
W20260709 12:59:35.970237  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 999118us
W20260709 12:59:35.943642  1544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.019s	sys 0.029s
W20260709 12:59:35.944936  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 313842us
W20260709 12:59:35.971024  1544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.020s	sys 0.029s
I20260709 12:59:35.579262  3255 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:35.673053  3160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.044s	sys 0.054s
W20260709 12:59:35.702092  3298 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.009s	sys 0.035s
W20260709 12:59:35.754129  3168 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.025s	sys 0.019s
W20260709 12:59:35.821003  3200 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.015s	sys 0.045s
I20260709 12:59:35.905480  3291 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:35.997041  1688 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:35.999090  1686 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:35.982811  3160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.057s	sys 0.071s
W20260709 12:59:35.986423  3298 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.017s	sys 0.036s
W20260709 12:59:35.996259  3168 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.025s	sys 0.026s
I20260709 12:59:35.977707  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:35.995041  3255 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:35.977679  2271 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.025s	sys 0.047s
I20260709 12:59:35.651981  3273 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:35.999531  3210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.032s	sys 0.018s
W20260709 12:59:35.998729  3200 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.015s	sys 0.045s
W20260709 12:59:36.026167  1612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.013s	sys 0.017s
W20260709 12:59:36.035460  1612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.013s	sys 0.017s
I20260709 12:59:36.011819  3322 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:36.034469  2271 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.025s	sys 0.047s
I20260709 12:59:36.004503  3291 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:36.035439  3210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.032s	sys 0.018s
I20260709 12:59:36.050423  3299 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:36.047524  3267 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:36.065100  3322 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:36.075403  3299 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.100333  3273 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:36.100733  3342 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 12:59:36.164885  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 193380us
I20260709 12:59:36.166549  1584 leader_election.cc:400] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:36.168623  1686 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:36.167881  1584 leader_election.cc:403] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:36.188745  1688 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:59:36.191592  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 220710us
I20260709 12:59:36.172835  3111 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:36.187776  3110 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 12:59:36.245038  1686 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:36.247330  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 45007.6us
I20260709 12:59:36.189103  3282 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:36.258191  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:36.258740  1540 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:36.249856  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:36.198861  3255 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:36.251191  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:36.171672  3342 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.266547  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:36.249624  3350 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:59:36.262135  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:36.292460  3359 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:59:36.263319  3336 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.293172  3174 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:36.295176  3201 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:36.295492  3346 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 12:59:36.295785  3343 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:59:36.296305  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 544) took 1065 ms. Trace:
I20260709 12:59:36.296589  3322 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:36.297515  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:36.259707  3361 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:36.273221  3267 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:36.343647  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 46192.6us
I20260709 12:59:36.306773  3291 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:36.255906  3111 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:36.266530  3282 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.325310  3210 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 12:59:36.341475  3355 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:59:36.345099  3360 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:59:36.363061  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 68332.3us
W20260709 12:59:36.363394  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 89227.3us
I20260709 12:59:36.356935  3139 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:36.359918  3356 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:59:36.345146  3361 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.359282  3366 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:36.327076  3336 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:36.371713  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 177211us
W20260709 12:59:36.372661  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 178022us
I20260709 12:59:36.353304  3267 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.369947  3366 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:36.372583  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 107546us
I20260709 12:59:36.366268  3299 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.345109  3201 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.383059  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 1901) took 1075 ms. Trace:
I20260709 12:59:36.383751  3282 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.385385  3336 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.376091  3147 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:36.387058  3358 log.cc:927] Time spent T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:59:36.383467  1618 rpcz_store.cc:276] 0709 12:59:35.307253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.309615 (+  2362us) service_pool.cc:224] Handling call
0709 12:59:35.344776 (+ 35161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.417711 (+ 72935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.417747 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.420604 (+  2857us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.455252 (+ 34648us) spinlock_profiling.cc:243] Waited 8.72 ms on lock 0x7b480024c258. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f0cceaa1 00007f29f0cc5b37 00007f29f0cc59ca 00007f29f0dbd26f 00007f29f0dbcf37 00007f29f0dd155c 00007f29f0dd1508 00007f29f0dd1488 00007f29f0dd1443 00007f29f0dd06ec 00007f29efcfaa96
0709 12:59:35.955599 (+500347us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:35.955645 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.955717 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.382737 (+427020us) raft_consensus.cc:1685] finished
0709 12:59:36.382762 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.382985 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75067,"raft.queue_time_us":73018,"raft.run_cpu_time_us":704,"raft.run_wall_time_us":36203,"spinlock_wait_cycles":21437056,"thread_start_us":526131,"threads_started":1,"wal-append.queue_time_us":665112}
W20260709 12:59:36.388602  3357 log.cc:927] Time spent T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:59:36.382193  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1387) took 1048 ms. Trace:
I20260709 12:59:36.389078  1617 rpcz_store.cc:276] 0709 12:59:35.333547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.333690 (+   143us) service_pool.cc:224] Handling call
0709 12:59:35.334050 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.343443 (+  9393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.343468 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.343988 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.935419 (+591431us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:35.935489 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.935561 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.382012 (+446451us) raft_consensus.cc:1685] finished
0709 12:59:36.382031 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.382142 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10141,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":11024,"thread_start_us":496530,"threads_started":1,"wal-append.queue_time_us":694903}
I20260709 12:59:36.362504  3210 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.383495  3378 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:59:36.381012  3271 consensus_queue.cc:1059] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 12:59:36.372272  3354 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:59:36.391741  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:36.391462  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:36.394258  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:36.387274  3147 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.395967  3299 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:36.396662  3147 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.396812  3378 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:36.397244  3378 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:36.398193  3361 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.397981  3378 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.368498  3265 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:59:36.373407  3139 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:36.388787  3111 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:36.416560  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 166753us
I20260709 12:59:36.414994  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:36.377343  3366 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:36.425452  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1388) took 1061 ms. Trace:
I20260709 12:59:36.425978  3201 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:36.425845  1619 rpcz_store.cc:276] 0709 12:59:35.342153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.342271 (+   118us) service_pool.cc:224] Handling call
0709 12:59:35.343020 (+   749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.407502 (+ 64482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.407529 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.407955 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.454626 (+ 46671us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b480024c258. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f0cceaa1 00007f29f0cc5b37 00007f29f0cc59ca 00007f29f0dbd26f 00007f29f0dbcf37 00007f29f0dd155c 00007f29f0dd1508 00007f29f0dd1488 00007f29f0dd1443 00007f29f0dd06ec 00007f29efcfaa96
0709 12:59:35.837571 (+382945us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:35.837616 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.837691 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.388110 (+550419us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 12:59:36.403293 (+ 15183us) raft_consensus.cc:1685] finished
0709 12:59:36.403315 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.403423 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1222,"raft.queue_time_us":72565,"raft.run_cpu_time_us":2208,"raft.run_wall_time_us":38875,"spinlock_wait_cycles":16389120,"thread_start_us":429162,"threads_started":1,"wal-append.queue_time_us":757848}
I20260709 12:59:36.427729  3342 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.422909  3378 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:36.428781  3210 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.425738  3368 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:36.413938  3282 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:36.430572  3282 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:36.330103  2271 rpcz_store.cc:276] 0709 12:59:35.230389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.230519 (+   130us) service_pool.cc:224] Handling call
0709 12:59:35.230814 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.230974 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:36.053138 (+822164us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.295935 (+242797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.295987 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:36.296031 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.296112 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.296231 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28541,"prepare.queue_time_us":783049,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":30725,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":1010826,"threads_started":2,"wal-append.queue_time_us":292115}
I20260709 12:59:36.424216  3139 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.434828  3111 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:36.435480  3111 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.436916  3365 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:59:36.441876  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 292) took 1152 ms. Trace:
I20260709 12:59:36.442203  1541 rpcz_store.cc:276] 0709 12:59:35.289691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.289839 (+   148us) service_pool.cc:224] Handling call
0709 12:59:35.290124 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.290449 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.290477 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.290951 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.693590 (+402639us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:35.959772 (+266182us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.098274 (+138502us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b1800429d60. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c32c0a 00007f29f2372219 00007f29e8cbaa40 00007f29e8cb54e4 00007f29e8cb5455 00007f29ebd9d060 00007f29ebdaf716 00007f29ebdc0287 00007f29ebdc0208
0709 12:59:36.098438 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.098503 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.441629 (+343126us) raft_consensus.cc:1685] finished
0709 12:59:36.441706 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.441811 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8357,"prepare.queue_time_us":259733,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2119,"raft.queue_time_us":140660,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":21952,"spinlock_wait_cycles":3510656,"thread_start_us":402267,"threads_started":1,"wal-append.queue_time_us":867746}
I20260709 12:59:36.444483  1658 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:36.446069  3351 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.361s	user 0.000s	sys 0.003s
I20260709 12:59:36.447507  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 291) took 1186 ms. Trace:
I20260709 12:59:36.447908  1544 rpcz_store.cc:276] 0709 12:59:35.260720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.260824 (+   104us) service_pool.cc:224] Handling call
0709 12:59:35.261078 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.261350 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.261375 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.261751 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.971875 (+710124us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:35.971923 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.971997 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.445398 (+473401us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 12:59:36.447205 (+  1807us) raft_consensus.cc:1685] finished
0709 12:59:36.447229 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.447445 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":884,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"spinlock_wait_cycles":2395520,"thread_start_us":709804,"threads_started":1,"wal-append.queue_time_us":790917}
I20260709 12:59:36.452464  3282 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.460552  3139 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:36.479178  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 54352.2us
I20260709 12:59:36.481958  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:36.509950  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 65549.2us
I20260709 12:59:36.509179  3114 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:36.566113  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:36.569509  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.589547  3114 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:36.597755  3114 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:36.587735  2241 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.622s (SENT) [suppressed 2 similar messages]
I20260709 12:59:36.594203  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:36.605255  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 164666us
I20260709 12:59:36.562369  3378 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:36.612650  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:59:36.617781  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 193087us
I20260709 12:59:36.613636  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:36.616515  1688 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:36.626948  1544 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:36.628052  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:36.629767  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:36.631629  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:36.632799  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:36.611421  3282 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:36.633208  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:36.616879  3147 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:36.616196  3336 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:36.636652  1541 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:36.640065  3379 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:36.640455  3201 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:36.640556  3379 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.641484  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:36.625028  3322 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:59:36.642833  3382 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:36.643343  3382 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.643513  3147 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.645545  3147 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:36.645779  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:36.646092  3336 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.630995  3273 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:36.649255  3114 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.631285  3378 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:36.655058  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 67336.7us
I20260709 12:59:36.749166  3200 tablet_bootstrap.cc:492] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:36.750275  3200 tablet_bootstrap.cc:492] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:36.750978  3200 ts_tablet_manager.cc:1403] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 1.639s	user 0.044s	sys 0.053s
I20260709 12:59:36.634811  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:36.708777  3383 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.739872  3210 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:36.746026  3299 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.705114  3267 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:36.748489  3139 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:36.649731  3273 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.759706  3383 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.753130  3382 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:36.769260  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 136908us
I20260709 12:59:36.758478  3367 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:36.757411  3251 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:36.769500  3340 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:36.805086  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.808612  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:36.816424  3273 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:36.820791  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 48603.3us
I20260709 12:59:36.825827  1688 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:36.827395  3392 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:36.828167  3392 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.769408  3210 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.772145  3299 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.833582  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:36.803668  3168 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:36.839399  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 93018.1us
I20260709 12:59:36.840109  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:36.840786  1688 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.792757  3139 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:36.849920  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 230603us
I20260709 12:59:36.798715  3251 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.860482  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:36.847055  3168 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.883116  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:36.884413  1688 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:36.885926  3407 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:36.846650  3255 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:36.804030  3367 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.854434  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:36.849520  3392 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.808934  3340 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.927357  1688 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:36.886600  3407 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:36.904072  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:36.931115  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:36.889636  3383 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:36.895495  3255 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:36.983047  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 105130us
I20260709 12:59:36.961740  3378 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:36.897811  3200 raft_consensus.cc:359] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:37.014073  3251 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.014654  3210 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:37.015023  3168 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.021553  3168 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.022042  3168 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:36.939839  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82622e43412243cb95bf17b246050060"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:37.022349  3407 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.023490  1686 raft_consensus.cc:606] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:37.027544  3407 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:37.030026  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 97634.4us
I20260709 12:59:36.983112  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.050748  1542 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:37.053223  3379 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.055205  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:37.009793  3200 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:37.029142  3261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25acf355940411ba0ffd6483b7467c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:37.060141  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:37.063017  3404 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.112s	user 0.000s	sys 0.005s
I20260709 12:59:37.075791  1658 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:37.065148  2275 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:37.028133  3407 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:37.080583  3363 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:37.059291  3375 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:37.078583  3406 log.cc:927] Time spent T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:37.091811  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:37.097841  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:37.081318  3252 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.098399  2276 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:59:37.064656  3367 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:37.084699  3299 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:37.086992  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:37.089531  3139 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:37.118152  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:37.091118  3291 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.093441  3342 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:37.108520  3366 consensus_meta.cc:287] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.686s	user 0.005s	sys 0.005s
I20260709 12:59:37.129374  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:37.096375  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:37.098284  3298 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.093957  3200 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:37.115337  3377 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.113094  3388 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:37.145221  3201 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.113596  3252 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.143957  3368 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:37.198843  3410 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.207477  3411 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 12:59:37.093607  3375 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.198695  3305 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.211884  3421 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.149801  3340 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.214943  3420 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.210340  3402 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.219307  3410 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.146354  3366 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.205214  3388 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:37.216830  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:37.224877  3413 log.cc:927] Time spent T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:59:37.140033  3291 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.208962  3201 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:37.231974  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.211061  3368 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:37.226092  3408 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:37.261000  2273 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:59:37.234577  3340 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:37.268513  3201 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.312564  3378 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.313100  3378 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:37.306830  3282 consensus_meta.cc:287] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.001s
I20260709 12:59:37.315182  3378 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:37.261860  3421 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.269681  3379 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:37.269990  3392 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.317691  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:37.318004  3375 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:37.319651  3265 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.320072  3379 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:37.322279  3370 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.966s	user 0.000s	sys 0.022s
I20260709 12:59:37.306783  3366 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:37.316555  2271 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:37.331033  3407 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.331200  3111 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.324604  3392 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.332890  3255 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.262192  3420 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.335294  1539 raft_consensus.cc:2410] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:37.335672  3364 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.329005  2273 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:37.306619  3410 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:37.343079  1510 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:37.333907  3168 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:37.312156  3340 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.272490  3402 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.345824  3421 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:37.344826  3255 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.337261  3265 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.281772  3408 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:37.358534  1510 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:37.375342  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:37.367084  3282 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.375236  3255 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:37.381484  1584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.019s
W20260709 12:59:37.384020  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 289861us
I20260709 12:59:37.387710  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:37.388273  1617 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:59:37.373603  3407 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:37.390198  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:37.399821  1584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.000s	sys 0.019s
I20260709 12:59:37.379031  3111 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.420210  3111 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:37.420692  3111 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.423647  3379 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:37.425005  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:37.425613  1693 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:37.436122  3336 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.439430  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.440220  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:37.440950  3424 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:59:37.441425  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:37.442752  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.384200  3421 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:37.490218  3427 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 12:59:37.493628  2241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.013s	sys 0.022s
W20260709 12:59:37.499228  2241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.013s	sys 0.022s
W20260709 12:59:37.499552  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 540659us
I20260709 12:59:37.372288  3364 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.440966  1440 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.514837  1659 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:37.553596  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.544165  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:37.544308  3420 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.489044  3421 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.562232  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.485944  3407 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:37.490953  3427 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:37.550233  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:37.549320  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:37.554960  1612 raft_consensus.cc:2410] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:37.574805  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:37.556284  1440 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.558393  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:37.560709  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 45953.4us
I20260709 12:59:37.583758  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:37.563663  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:37.547567  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:37.564373  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:37.564834  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.602121  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.602981  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:37.562124  3430 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.586503  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:37.568506  3388 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.602628  3160 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:37.864900  3426 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 12:59:37.611680  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.863548  3427 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:37.772078  3200 ts_tablet_manager.cc:1434] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 1.021s	user 0.025s	sys 0.007s
W20260709 12:59:37.873756  3200 ts_tablet_manager.cc:1467] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Tablet startup took 1122ms
I20260709 12:59:37.612257  1686 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:37.770450  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:37.879202  3393 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.603843  3291 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:37.880285  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 109892us
I20260709 12:59:37.881125  1440 catalog_manager.cc:5697] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:37.601989  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:37.568287  3421 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.884773  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:37.614886  2276 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:37.678866  1685 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:37.775722  3433 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:37.865283  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 281573us
I20260709 12:59:37.901057  1440 catalog_manager.cc:5697] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 12:59:37.916424  3252 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:37.927783  1659 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:37.937795  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 369314us
I20260709 12:59:37.940152  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:37.774053  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:37.942269  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 315625us
I20260709 12:59:37.950153  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:37.950892  2277 raft_consensus.cc:1217] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:37.961598  1509 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:37.968022  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:37.971652  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:37.872555  3374 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:59:37.634109  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1351) took 1018 ms. Trace:
I20260709 12:59:37.980113  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:37.980587  3291 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:37.982524  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:37.983493  3419 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.952551  3160 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:37.975508  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:37.969723  3368 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:38.032289  3429 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.396s	user 0.000s	sys 0.000s
I20260709 12:59:37.892367  3433 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:37.974575  3388 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:38.097361  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:37.973316  3267 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:38.121858  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 146659us
I20260709 12:59:38.133617  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.134313  1616 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:38.094722  3160 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:37.988142  3168 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:37.997251  3255 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:38.141956  3168 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.135026  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.122886  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.129956  3408 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:38.149958  1658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.023s	sys 0.069s
W20260709 12:59:38.150295  1658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.023s	sys 0.069s
W20260709 12:59:38.125634  3201 consensus_meta.cc:287] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.807s	user 0.002s	sys 0.013s
W20260709 12:59:38.150547  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 1.05645e+06us
I20260709 12:59:38.140581  3267 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:38.152782  3267 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.151242  3368 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:38.149602  3375 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.160843  3375 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.150005  3419 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.163863  3282 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.163964  3419 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.164637  3282 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.166244  3419 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.147075  3160 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.990494  1539 rpcz_store.cc:276] 0709 12:59:36.615554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.616738 (+  1184us) service_pool.cc:224] Handling call
0709 12:59:37.602681 (+985943us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54001856d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:37.630894 (+ 28213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292516096}
I20260709 12:59:38.112293  1542 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:38.180831  3375 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.182112  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.032745  3291 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.180128  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.184981  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:38.179003  3388 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:38.181465  3368 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:38.199703  3364 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:38.203575  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.185729  3407 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.207943  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.209357  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.212431  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.217780  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 267) took 1346 ms. Trace:
I20260709 12:59:38.168246  3201 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.198874  3428 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:38.218137  1691 rpcz_store.cc:276] 0709 12:59:36.860812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.876873 (+ 16061us) service_pool.cc:224] Handling call
0709 12:59:36.895227 (+ 18354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.921341 (+ 26114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.921382 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:37.058348 (+136966us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b18003f4f60. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c862a6 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a
0709 12:59:37.059122 (+   774us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b2c0009d728. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 12:59:37.085244 (+ 26122us) log.cc:844] Serialized 26 byte log entry
0709 12:59:37.378968 (+293724us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:37.379011 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.379076 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:38.206189 (+827113us) raft_consensus.cc:1685] finished
0709 12:59:38.206215 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.206367 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16889,"raft.queue_time_us":33398,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9158,"spinlock_wait_cycles":29590784,"thread_start_us":252336,"threads_started":1,"wal-append.queue_time_us":433871}
W20260709 12:59:38.213543  3434 log.cc:927] Time spent T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.578s	user 0.003s	sys 0.001s
I20260709 12:59:38.235132  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.235857  1617 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:38.238814  1538 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:37.874472  3200 ts_tablet_manager.cc:1469] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Trace:
0709 12:59:33.327392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.328543 (+  1151us) service_pool.cc:224] Handling call
0709 12:59:33.330543 (+  2000us) ts_tablet_manager.cc:934] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
0709 12:59:33.597777 (+267234us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:33.990939 (+393162us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:33.995120 (+  4181us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:34.346598 (+351478us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:34.374287 (+ 27689us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:34.451310 (+ 77023us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:34.451368 (+    58us) inbound_call.cc:177] Queueing success response
0709 12:59:35.110302 (+658934us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:59:36.751272 (+1640970us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:59:36.815306 (+ 64034us) tablet_replica.cc:261] Starting instrumentation
0709 12:59:36.815823 (+   517us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":2661,"raft.queue_time_us":107312,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3569,"tablet-copy.queue_time_us":523,"tablet-download-pool.queue_time_us":131,"tablet-download-pool.run_cpu_time_us":1165,"tablet-download-pool.run_wall_time_us":260929,"thread_start_us":557797,"threads_started":2}
I20260709 12:59:38.241607  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.238207  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.206265  3410 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:38.233513  3435 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.232060  3428 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:38.250851  1614 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:38.252012  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.251408  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.251551  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:38.252249  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 280863us
I20260709 12:59:38.241403  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.264364  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.266526  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.267321  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.272132  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.273458  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:38.273926  3438 log.cc:927] Time spent T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:59:38.259606  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.268805  3405 consensus_queue.cc:1059] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:59:38.274884  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.275149  3405 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.275660  3405 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:38.276415  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1298) took 1046 ms. Trace:
I20260709 12:59:38.261081  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.275221  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1364) took 1376 ms. Trace:
I20260709 12:59:38.255429  3428 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.239264  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.277446  1538 rpcz_store.cc:276] 0709 12:59:36.899073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.919065 (+ 19992us) service_pool.cc:224] Handling call
0709 12:59:37.439252 (+520187us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b5800004e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:37.439506 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.239278 (+799772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.275031 (+ 35753us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b5400313154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:38.275170 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851256320}
I20260709 12:59:38.276806  1543 rpcz_store.cc:276] 0709 12:59:37.230475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.231406 (+   931us) service_pool.cc:224] Handling call
0709 12:59:37.231720 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:37.234699 (+  2979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.234726 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:37.255223 (+ 20497us) log.cc:844] Serialized 26 byte log entry
0709 12:59:37.627795 (+372572us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:37.627827 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.627924 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:38.276248 (+648324us) raft_consensus.cc:1685] finished
0709 12:59:38.276264 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.276367 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4930,"raft.queue_time_us":14803,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6284,"thread_start_us":365652,"threads_started":1,"wal-append.queue_time_us":862284}
I20260709 12:59:38.281960  3336 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.282882  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.287463  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.287739  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.288008  1614 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:38.282450  3336 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.260165  3421 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.294064  3336 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.300472  3422 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.302541  3422 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.304535  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.305291  1538 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:38.309401  3422 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.276237  3427 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:59:38.283121  3368 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.314630  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.315299  1538 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
W20260709 12:59:38.318228  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 332426us
I20260709 12:59:38.269306  3388 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.323648  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.298780  3433 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.317245  3383 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.330164  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.319674  3282 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.321514  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.325488  3291 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.332116  1536 raft_consensus.cc:2393] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:38.335377  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.340519  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.342279  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:38.300524  3405 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.347781  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.348340  1614 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:38.334262  3201 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.350317  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.352178  1538 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:38.368434  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:38.351356  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.334825  3383 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.371619  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:38.373435  3452 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.373850  3452 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.350826  3282 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:38.372393  3405 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.379969  3453 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:38.380430  3453 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.380757  3453 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.381340  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.377490  3452 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:38.377720  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 79413.6us
I20260709 12:59:38.378424  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:38.384888  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.382395  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.379738  3282 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.372948  3433 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.434734  3201 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.439579  3201 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.441663  3422 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.446257  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:38.457852  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 80366.1us
I20260709 12:59:38.459731  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.459960  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.460978  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:38.467092  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 82267.1us
I20260709 12:59:38.484741  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.492146  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.494201  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.436455  3433 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:38.435892  3448 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.505467  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.505934  3433 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.506160  3201 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.511534  3421 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.516113  3457 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:38.516402  3401 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.540024  3435 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.540541  3435 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.542398  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.523943  3160 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.548401  3435 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.552611  3267 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.553028  3340 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.553781  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.535769  3457 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.556644  3457 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.558372  3160 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.559160  3383 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.564421  3168 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.565831  3396 raft_consensus.cc:993] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
W20260709 12:59:38.566664  3111 consensus_meta.cc:287] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.145s	user 0.015s	sys 0.000s
I20260709 12:59:38.567262  3111 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.568526  1540 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.543540  3421 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.568852  3433 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.537004  3401 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.571758  3401 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.547454  1511 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:38.573647  2241 leader_election.cc:336] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.622s (SENT)
I20260709 12:59:38.574472  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.576632  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.544152  3282 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.579828  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:38.580639  3433 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.580682  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1318) took 1744 ms. Trace:
W20260709 12:59:38.581718  3454 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:38.581184  1689 rpcz_store.cc:276] 0709 12:59:36.836364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.836481 (+   117us) service_pool.cc:224] Handling call
0709 12:59:36.846580 (+ 10099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.875256 (+ 28676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.875318 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.895874 (+ 20556us) log.cc:844] Serialized 26 byte log entry
0709 12:59:37.382890 (+487016us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:37.382931 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.162492 (+779561us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 12:59:38.580404 (+417912us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b54002e4ad4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:38.580452 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:38.580503 (+    51us) raft_consensus.cc:1685] finished
0709 12:59:38.580514 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.580633 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":764,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":28849,"spinlock_wait_cycles":101598976,"thread_start_us":399946,"threads_started":1,"wal-append.queue_time_us":619828}
I20260709 12:59:38.575901  3306 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.554595  3267 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.584057  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.587601  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.588953  3396 raft_consensus.cc:1081] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:38.589172  1660 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:38.590050  3147 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:38.590415  3147 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:38.590792  3147 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.584237  3282 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.594344  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.595053  3463 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.596333  3452 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.599841  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.583729  3401 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.601258  3267 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:38.602500  3267 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.602869  3267 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.603979  2268 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:38.604497  3428 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.606334  3111 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.610550  1511 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.611546  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.612485  1511 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:38.618031  3456 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.110s	user 0.001s	sys 0.001s
I20260709 12:59:38.618932  3421 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.619493  3212 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.619612  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 466) took 1054 ms. Trace:
I20260709 12:59:38.619943  2274 rpcz_store.cc:276] 0709 12:59:37.565473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.565625 (+   152us) service_pool.cc:224] Handling call
0709 12:59:38.619018 (+1053393us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:38.619182 (+   164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.619320 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.619342 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:38.619381 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:38.619407 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.619453 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.619564 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583296}
I20260709 12:59:38.621932  3282 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.624235  3366 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:38.625626  3402 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:38.625555  3366 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.621344  3405 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:59:38.627604  3366 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:38.628235  3392 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.631385  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.632205  3432 raft_consensus.cc:3055] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:38.632050  3267 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.632539  3432 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:38.633038  3147 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.635852  3265 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.638500  3147 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:38.620056  3453 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.640902  3452 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.643181  3453 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.609535  3466 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.646247  1511 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.651464  1511 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.655612  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.655938  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.656203  1694 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:38.657176  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:38.651150  3282 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.658661  1689 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.659307  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.659657  3464 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:38.659930  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.660038  1691 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:38.660235  3265 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:38.660576  1689 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:38.660656  3265 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.661216  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:38.661485  3265 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.659991  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.660090  3464 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.662837  3464 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.670396  3111 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.645452  3428 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:38.679955  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.623021  3388 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:38.682204  1619 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.683131  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.684774  2241 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.687268  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.691835  2241 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.695786  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.692648  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.696940  1686 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:38.683831  3267 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.697752  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.703157  1544 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 1.
I20260709 12:59:38.686223  3401 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.698755  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.706722  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:38.707860  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:38.708104  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.683748  3261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45402 (request call id 466) took 4975 ms. Trace:
I20260709 12:59:38.702361  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.711963  2276 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:38.682399  3282 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.704080  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:38.693965  3402 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.706545  1509 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.705488  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.689275  3255 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.697932  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.715843  1618 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.693483  3392 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.710767  1510 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.715091  2241 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.700009  3405 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:38.729327  3392 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.730091  1509 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:38.731132  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.731408  3392 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.731892  3392 consensus_queue.cc:1059] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:38.732173  3421 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.732563  3421 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.732648  3457 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.715987  3265 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.733286  3282 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:38.735132  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.735384  3282 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.706892  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.736112  3265 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.736398  3255 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:38.736930  3336 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.736958  3255 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.703262  3168 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:38.739910  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:38.727200  3273 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.727931  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:38.729240  3405 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.737978  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:38.737340  3336 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:38.756332  3405 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.756673  3336 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.747296  3168 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:38.758319  3168 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.732926  3421 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.759052  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:38.759658  3470 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:59:38.758854  3402 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:38.724917  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 228171us
I20260709 12:59:38.723953  1510 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.769104  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:38.769768  1614 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:38.773367  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.774876  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:38.775633  1614 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:38.774927  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:38.732860  3392 raft_consensus.cc:3055] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.784794  3392 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:38.785609  3392 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.785907  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:38.786954  3433 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.786993  3392 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.792368  3255 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.781193  3464 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 12:59:38.793745  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 69895.4us
I20260709 12:59:38.794598  3464 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.795148  3464 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:38.795434  3464 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:38.795764  3464 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.796485  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.797497  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.711673  3261 rpcz_store.cc:276] 0709 12:59:33.699680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.702785 (+  3105us) service_pool.cc:224] Handling call
0709 12:59:34.061778 (+358993us) ts_tablet_manager.cc:934] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
0709 12:59:34.582163 (+520385us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29e8c9b0ac 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb4caa 00007f29e8cb4bd2 00007f29f0d19131
0709 12:59:36.773936 (+2191773us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:38.560715 (+1786779us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:38.560821 (+   106us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:38.644796 (+ 83975us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:38.645054 (+   258us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:38.645419 (+   365us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:38.674735 (+ 29316us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":27669,"spinlock_wait_cycles":43035520,"tablet-copy.queue_time_us":261373,"thread_start_us":671935,"threads_started":2}
I20260709 12:59:38.798193  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.798421  3261 tablet_copy_client.cc:806] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:38.739283  3366 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.798630  1510 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.801069  2241 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.799619  3448 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:38.799180  3282 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:38.818007  3282 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:38.817958  3448 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.818535  3282 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.798858  3457 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.821219  3448 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.822014  3255 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.770495  3402 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:38.826908  3402 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.827782  2241 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.828547  3291 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.830451  2241 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.830839  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:38.831180  3401 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.832391  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 310) took 1254 ms. Trace:
I20260709 12:59:38.832959  1543 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:38.832763  1536 rpcz_store.cc:276] 0709 12:59:37.578151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.584811 (+  6660us) service_pool.cc:224] Handling call
0709 12:59:38.832189 (+1247378us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540027fbd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:38.832316 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012471040}
I20260709 12:59:38.835717  3448 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.836719  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.840770  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.840809  1510 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.843698  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.844332  3457 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.845036  3457 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.847383  3261 tablet_copy_client.cc:670] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:38.847865  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:38.847373  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.848336  1616 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.848791  1685 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:38.851020  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.851363  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.851576  1689 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:38.852008  1685 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:38.851981  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.852371  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.783186  3273 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 12:59:38.855778  3478 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:59:38.866348  3273 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.857018  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.867237  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.858366  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.859803  3432 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.855850  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:38.868599  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:38.869083  3432 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.869239  1687 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:38.869764  1540 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.869839  3273 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.870733  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.863801  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82622e43412243cb95bf17b246050060"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 12:59:38.867174  1545 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:38.857661  1704 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-82622e43412243cb95bf17b246050060 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:38.850189  3336 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.872579  1704 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-82622e43412243cb95bf17b246050060 on tablet 82622e43412243cb95bf17b246050060 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:38.872776  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.872144  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.894516  1687 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 12:59:38.895396  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 55876.9us
I20260709 12:59:38.898020  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:38.873760  1616 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 12:59:38.874006  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.899288  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.899852  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.874598  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.872717  1542 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:38.876726  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.878504  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:38.903645  1543 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:38.881611  3421 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.878964  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.911743  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.887073  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:38.870281  3168 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.875895  2241 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.865628  3402 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.891146  3464 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.892153  3336 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:38.892529  2272 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.012s	sys 0.016s
I20260709 12:59:38.901086  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.901157  1658 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:38.918026  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.902259  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.902343  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:38.913024  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:38.919238  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.919337  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:38.919797  1691 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:38.914675  1687 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:38.919341  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.900288  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:38.919561  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:38.920382  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.920948  1694 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.914861  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:38.921813  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:38.922809  3463 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.924000  3421 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.911563  1542 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.924449  3463 raft_consensus.cc:1064] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
W20260709 12:59:38.924896  3463 raft_consensus.cc:1068] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: Unable to promote non-voter 5dd1b367d5dd4e6abfd29fc2df2bed07: Service unavailable: leader transfer in progress
I20260709 12:59:38.925874  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:38.926514  2271 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.922840  3407 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:38.928617  3407 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.930780  3435 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.932102  3464 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.932366  1658 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.933080  3430 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.933333  3460 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:38.934229  3430 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.934360  3460 raft_consensus.cc:3055] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.934830  3460 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:38.934229  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.935586  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:38.935674  3282 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.936592  3147 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.921458  3401 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.937584  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:38.937932  3282 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.940904  3402 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:38.919939  3408 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:38.941244  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:38.941906  3408 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:38.943249  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90bfe669a290453597d79375d2aadae5"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:38.943789  1691 raft_consensus.cc:606] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:38.943917  3408 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.944571  1539 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:38.921031  2272 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.013s	sys 0.016s
I20260709 12:59:38.930528  3407 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:38.922022  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.948422  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:38.954664  1545 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:38.957747  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:38.958590  1545 raft_consensus.cc:2368] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 12:59:38.962064  3463 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:38.965615  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:38.916945  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:38.969056  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.970489  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:38.945389  3168 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:38.978016  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:38.978924  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 333) took 2089 ms. Trace:
I20260709 12:59:38.982084  1545 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:59:38.982399  1545 pending_rounds.cc:85] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 1
I20260709 12:59:38.982592  1545 pending_rounds.cc:107] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:38.982825  1545 raft_consensus.cc:2889] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:38.984314  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.986054  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:38.986471  1658 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:38.978310  1439 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.988359  1439 catalog_manager.cc:5697] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:38.979272  1440 rpcz_store.cc:276] 0709 12:59:36.889843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.889997 (+   154us) service_pool.cc:224] Handling call
0709 12:59:38.978870 (+2088873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:38.378737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:38.413781 (+ 35044us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:38.413833 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:59:38.413863 (+    30us) tablet.cc:662] Decoding operations
0709 12:59:38.437423 (+ 23560us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:38.440362 (+  2939us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:38.440392 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:38.440802 (+   410us) tablet.cc:701] Row locks acquired
0709 12:59:38.440822 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:38.440959 (+   137us) write_op.cc:270] Start()
0709 12:59:38.441066 (+   107us) write_op.cc:276] Timestamp: P: 1783601978440924 usec, L: 0
0709 12:59:38.441086 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:59:38.451276 (+ 10190us) log.cc:844] Serialized 1696 byte log entry
0709 12:59:38.572831 (+121555us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29e8c9b0ac 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b
0709 12:59:38.841562 (+268731us) op_driver.cc:464] REPLICATION: finished
0709 12:59:38.951320 (+109758us) write_op.cc:301] APPLY: starting
0709 12:59:38.951400 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:38.951546 (+   146us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:38.951563 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:38.960630 (+  9067us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:38.960787 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:59:38.960830 (+    43us) write_op.cc:312] APPLY: finished
0709 12:59:38.961024 (+   194us) log.cc:844] Serialized 41 byte log entry
0709 12:59:38.961195 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:38.961290 (+    95us) write_op.cc:454] Released schema lock
0709 12:59:38.961330 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:38.961668 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:38.961703 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":109520,"apply.run_cpu_time_us":2098,"apply.run_wall_time_us":10312,"num_ops":4,"prepare.queue_time_us":391729,"prepare.run_cpu_time_us":13064,"prepare.run_wall_time_us":219486,"raft.queue_time_us":80780,"raft.run_cpu_time_us":13892,"raft.run_wall_time_us":80332,"replication_time_us":400353,"spinlock_wait_cycles":29535616,"thread_start_us":589070,"threads_started":4,"wal-append.queue_time_us":189282}]]}
I20260709 12:59:38.991006  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:38.991788  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:38.992515  1543 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:38.997721  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:38.998814  1694 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 12:59:38.998965  3464 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.999140  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:39.000159  3457 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:39.000617  3457 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:39.001492  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.001396  3457 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.001859  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.002444  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:38.996807  3428 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:59:39.010783  3451 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:39.012106  3451 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.966037  3407 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:59:39.012822  3451 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:39.013224  3407 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:39.013664  3407 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:39.014111  3361 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:39.014600  3361 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:39.015551  3361 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:38.995950  3255 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:39.017851  3255 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:39.018368  3255 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.019088  1542 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:38.976979  3463 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.011128  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.021450  1691 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.023136  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:38.992724  3436 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.003711  3420 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:39.034307  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:39.035279  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:39.035717  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:39.009305  2270 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:39.039063  1584 leader_election.cc:400] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 12:59:39.039363  1584 leader_election.cc:403] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:59:39.039286  3368 consensus_queue.cc:1059] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:39.037216  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:39.038349  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:39.042289  3368 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 12:59:39.042852  3408 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:39.043236  3408 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:39.044158  3368 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:39.044063  3408 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.045372  3368 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:39.045821  3368 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:39.047493  3463 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:39.047857  3368 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.049467  3368 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.051149  3408 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:39.057224  3392 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:39.057688  3392 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.009066  3365 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.935684  3460 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.062971  3460 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:39.064338  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:39.028261  3282 raft_consensus.cc:2764] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:39.047508  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:39.066865  3392 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:39.097213  1691 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
W20260709 12:59:39.149230  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 71620us
I20260709 12:59:39.156539  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:39.159932  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:39.175037  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 166473us
I20260709 12:59:39.014525  3407 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.191742  1511 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.195528  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.078459  3393 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.091421  3401 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:39.200390  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 190255us
I20260709 12:59:39.205168  3245 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:39.031421  3410 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 12:59:39.191665  3392 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.193222  3388 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:39.149670  3422 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:59:39.205687  3336 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.238977  2241 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.241206  3401 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.242744  3487 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:39.244012  3430 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:39.230167  3470 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:59:39.244385  3430 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:39.245527  3430 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:39.240185  3388 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.247991  3388 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:39.249080  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:39.253386  1542 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:39.227152  3421 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.264480  1545 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:39.223661  3245 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:39.265075  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 63334.7us
I20260709 12:59:39.290892  3452 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:59:39.333020  3452 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:39.333475  3452 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 12:59:39.335007  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 48238.4us
I20260709 12:59:39.335923  3245 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:39.336644  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:39.335115  1545 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:39.339531  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:39.340905  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.342692  1509 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.286979  2272 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:59:39.324611  3470 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:59:39.345069  1618 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:39.346004  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 138463us
I20260709 12:59:39.347947  1509 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.349663  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.342741  3336 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.352396  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.334298  3452 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.351280  3459 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:39.365556  3430 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:39.365938  3459 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.351578  3111 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:39.366045  3396 raft_consensus.cc:993] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:39.356725  3448 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:39.358819  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.349691  3464 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:39.373518  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:39.377792  1509 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.381145  3336 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:39.381584  1509 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.382283  3457 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.382664  1509 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.383343  3457 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:39.384380  1509 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.384968  3336 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.385192  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.385833  3336 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.386369  1509 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:39.378623  3111 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.387964  3111 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:39.388377  3111 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:39.389145  3111 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.374361  3448 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:39.391052  3448 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.397778  1536 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
W20260709 12:59:39.399897  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.401876  2271 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:39.367928  3396 raft_consensus.cc:1081] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:39.399866  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:39.413416  1618 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.405980  3255 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.411741  3448 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.370841  3459 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:39.425873  1618 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:39.427345  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:39.431907  3457 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:39.432346  3457 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:39.433290  3457 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:39.441529  3489 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:39.413014  3402 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.442600  3425 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:39.417686  3452 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.444610  2277 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:39.446653  3428 consensus_queue.cc:1059] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:39.447558  3436 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.447921  3428 raft_consensus.cc:3055] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:39.448298  2273 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:39.448369  3428 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:39.449548  3428 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.487847  2274 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:39.487859  3425 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:39.499682  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.497298  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 144949us
I20260709 12:59:39.504148  1658 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.500816  3428 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:39.513118  3252 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:39.513688  3252 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:39.518002  3252 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.518617  3255 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:39.527336  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:39.540262  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:39.528697  3448 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:39.501729  3425 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.545946  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.546496  1690 raft_consensus.cc:3055] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:39.546788  1690 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:39.547433  1690 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:39.548623  1690 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.554999  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:39.557077  1690 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
W20260709 12:59:39.560184  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.565485  3425 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:39.566514  1536 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:39.567513  3306 raft_consensus.cc:3055] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:39.567873  3306 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:39.568621  3306 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.575678  3488 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:39.587636  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 83593.5us
I20260709 12:59:39.589783  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.590615  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.596673  2241 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.579527  3425 consensus_queue.cc:1059] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:59:39.605208  3422 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.605086  3465 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:39.603335  3401 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.596695  3494 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:39.609117  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:39.617632  1540 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:39.617802  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.613253  2241 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.618793  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.620081  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:39.620390  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.621552  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.624089  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.625635  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.615259  3361 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.615940  3291 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:39.622051  3245 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.635105  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90bfe669a290453597d79375d2aadae5"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
W20260709 12:59:39.638949  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.618988  3388 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.626503  3432 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.622242  3255 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:39.640776  3261 tablet_copy_client.cc:538] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:39.627461  3393 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:39.632570  3433 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.626415  3368 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.630882  3494 raft_consensus.cc:697] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:39.587301  3490 consensus_queue.cc:1059] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:59:39.658059  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38400 (request call id 225) took 2901 ms. Trace:
W20260709 12:59:39.659540  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.653726  1442 catalog_manager.cc:5697] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:39.672917  3437 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:39.673334  3437 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:39.674114  3437 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.675244  3437 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.644954  3460 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.677870  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:39.681540  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.682281  1694 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.670157  1442 catalog_manager.cc:5697] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 2 to 4, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:39.687088  1442 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:39.693032  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.693660  1694 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
W20260709 12:59:39.695950  3501 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:59:39.698120  3252 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.698616  3494 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.699517  3306 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:39.660539  3425 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:39.704579  3407 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.695165  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.709297  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.709578  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.709996  1694 raft_consensus.cc:2368] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 12:59:39.710917  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:39.713907  3502 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:59:39.714919  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.715238  1691 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:39.717546  1689 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:39.711370  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.722632  3408 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:39.723034  3408 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:39.723702  3393 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:39.724094  3393 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:39.725670  1541 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:39.726104  1541 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:39.724910  3393 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.682518  3491 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:39.723845  3408 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.730254  3393 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.730837  3421 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:39.740173  3421 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:39.741001  3421 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.745047  1541 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.748929  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:39.730520  3408 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.686085  3460 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.751794  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:39.663211  1439 rpcz_store.cc:276] 0709 12:59:36.749279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.749462 (+   183us) service_pool.cc:224] Handling call
0709 12:59:39.651020 (+2901558us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:39.000140 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:39.000642 (+   502us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:39.000679 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:59:39.000696 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:39.001092 (+   396us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:39.001141 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:39.001168 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:39.001457 (+   289us) tablet.cc:701] Row locks acquired
0709 12:59:39.001473 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:59:39.001608 (+   135us) write_op.cc:270] Start()
0709 12:59:39.001698 (+    90us) write_op.cc:276] Timestamp: P: 1783601979001569 usec, L: 0
0709 12:59:39.001717 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:59:39.035679 (+ 33962us) log.cc:844] Serialized 919 byte log entry
0709 12:59:39.250103 (+214424us) op_driver.cc:464] REPLICATION: finished
0709 12:59:39.250908 (+   805us) write_op.cc:301] APPLY: starting
0709 12:59:39.250996 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:39.251123 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:39.251211 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:39.251466 (+   255us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:39.251614 (+   148us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:39.251655 (+    41us) write_op.cc:312] APPLY: finished
0709 12:59:39.251831 (+   176us) log.cc:844] Serialized 29 byte log entry
0709 12:59:39.251968 (+   137us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:39.252049 (+    81us) write_op.cc:454] Released schema lock
0709 12:59:39.252087 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:39.252371 (+   284us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:39.252395 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6053,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":636,"apply.run_cpu_time_us":1440,"apply.run_wall_time_us":1440,"num_ops":2,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":2860,"prepare.run_wall_time_us":77450,"replication_time_us":248245}]]}
I20260709 12:59:39.730062  3491 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.760653  1689 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:39.769075  1541 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:39.770015  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:39.757879  3368 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:39.771968  2277 raft_consensus.cc:2393] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 2: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:39.772167  3368 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:39.775019  3452 raft_consensus.cc:3055] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:39.775360  3452 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:39.775624  3368 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:39.776151  3452 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.777137  3452 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.779011  1510 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:39.781673  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.782841  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:39.783577  1536 raft_consensus.cc:2393] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 2: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:39.783730  3460 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:39.785055  3448 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:39.785987  3491 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:39.788133  1689 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:39.789901  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:39.790738  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.792222  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 89327.5us
I20260709 12:59:39.793363  1693 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:39.795722  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:39.812371  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:39.813494  2277 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:39.813545  2268 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:39.815869  3448 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:39.816964  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:39.824433  1612 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:39.825845  3273 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:39.828958  1689 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:39.830432  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:39.831988  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:39.835525  1545 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:39.836520  1584 leader_election.cc:400] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 12:59:39.837245  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.838956  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.839673  1692 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:39.841614  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.849195  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.849231  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:39.855966  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.862608  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:39.864068  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.869786  1658 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.869916  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:39.869303  3388 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.846455  3368 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.846591  3407 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.860414  3255 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.863806  3490 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.866338  3432 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.883297  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:39.870028  3488 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:39.874105  3245 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:39.860322  3433 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:59:39.874032  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:39.874516  3463 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.893270  3488 raft_consensus.cc:697] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:39.869747  3453 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:59:39.917265  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.889386  3493 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:39.921599  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:39.922737  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:39.925442  3306 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.936568  3261 tablet_bootstrap.cc:492] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 12:59:39.945925  3488 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.924124  1690 raft_consensus.cc:606] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:39.959160  3361 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.959692  3361 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:39.961659  3361 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:39.975637  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:39.955281  3490 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.078449  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:40.075610  3464 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:40.080009  3464 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:40.082741  3509 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:59:40.083748  3245 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:40.106097  3504 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:59:40.111931  1685 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:40.115728  3464 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.126643  3453 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.127213  3453 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.130119  3453 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.129082  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:40.129052  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44143.7us
W20260709 12:59:40.135408  3505 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.277s	user 0.000s	sys 0.000s
I20260709 12:59:40.136118  3490 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:40.182871  1690 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:40.189159  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:40.199718  3453 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.214797  3430 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:40.218178  2270 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Advancing to term 3
I20260709 12:59:40.218701  3361 raft_consensus.cc:993] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:40.218392  3490 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:40.220717  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:40.221284  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:40.241673  1689 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:40.233839  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:40.244807  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:40.237468  3460 raft_consensus.cc:1081] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:40.233143  3453 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.245960  2271 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:40.254469  3282 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:40.256172  3452 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:40.256816  3452 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:40.249586  3437 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:40.243233  3464 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:59:40.247576  1539 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
W20260709 12:59:40.252122  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 63082.6us
I20260709 12:59:40.271426  1689 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:40.272480  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:40.273088  1612 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:40.274919  3452 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:40.280690  3453 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.283321  1611 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:40.289923  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:40.324599  2270 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:40.326313  3517 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:40.334725  1584 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:40.339239  1618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53894
I20260709 12:59:40.339838  1618 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:40.340178  1618 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.346733  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:40.348384  1618 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.352641  1690 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:40.357164  3464 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:40.357683  3464 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:40.358162  3464 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.364678  3261 tablet_bootstrap.cc:492] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:40.365578  3261 tablet_bootstrap.cc:492] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 12:59:40.366262  3261 ts_tablet_manager.cc:1403] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.430s	user 0.051s	sys 0.074s
I20260709 12:59:40.370258  1539 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:40.371927  3488 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:40.373958  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:40.374646  1542 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:40.351162  3448 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:59:40.351193  3453 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:40.376726  3453 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.376996  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 341) took 3570 ms. Trace:
I20260709 12:59:40.377094  3453 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.379288  1611 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:40.377461  1442 rpcz_store.cc:276] 0709 12:59:36.806892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.807096 (+   204us) service_pool.cc:224] Handling call
0709 12:59:40.376938 (+3569842us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:39.922048 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:40.118930 (+196882us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:40.118963 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:59:40.118981 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:40.126947 (+  7966us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:40.127025 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:40.127052 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:59:40.127376 (+   324us) tablet.cc:701] Row locks acquired
0709 12:59:40.127394 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:59:40.127515 (+   121us) write_op.cc:270] Start()
0709 12:59:40.127637 (+   122us) write_op.cc:276] Timestamp: P: 1783601980127477 usec, L: 0
0709 12:59:40.127659 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:40.129408 (+  1749us) log.cc:844] Serialized 1317 byte log entry
0709 12:59:40.259131 (+129723us) op_driver.cc:464] REPLICATION: finished
0709 12:59:40.333166 (+ 74035us) write_op.cc:301] APPLY: starting
0709 12:59:40.333246 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:40.333387 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:40.333486 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:40.333998 (+   512us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:40.334172 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:59:40.334221 (+    49us) write_op.cc:312] APPLY: finished
0709 12:59:40.334427 (+   206us) log.cc:844] Serialized 35 byte log entry
0709 12:59:40.334588 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:40.334708 (+   120us) write_op.cc:454] Released schema lock
0709 12:59:40.334768 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:40.335134 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:40.335169 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":623242,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":73801,"apply.run_cpu_time_us":1957,"apply.run_wall_time_us":1957,"num_ops":3,"prepare.queue_time_us":170610,"prepare.run_cpu_time_us":3352,"prepare.run_wall_time_us":238765,"replication_time_us":131347,"thread_start_us":178006,"threads_started":2}]]}
I20260709 12:59:40.352367  1443 catalog_manager.cc:5697] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 4, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:40.381676  1584 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:40.392802  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:40.381548  1443 catalog_manager.cc:5697] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 3, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:40.395006  1443 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 4, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:40.393810  3517 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:59:40.393338  1690 raft_consensus.cc:606] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:40.380587  3432 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:40.407609  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:40.411276  2270 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.412698  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:40.413249  1692 raft_consensus.cc:3055] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:40.413523  1692 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:40.410717  3428 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:40.391278  3490 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:40.414325  3490 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.414222  1692 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.405787  3491 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:40.415232  3491 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.414547  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:40.417004  1690 raft_consensus.cc:606] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:40.409848  3261 raft_consensus.cc:359] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:40.417806  3261 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 12:59:40.418424  3261 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:40.414273  3428 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:40.420614   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:40.422233   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:40.414789  3490 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:40.389361  3282 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:59:40.402601  3457 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:59:40.431968  3432 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:40.433876  3432 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:40.436086  3392 raft_consensus.cc:1064] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
W20260709 12:59:40.436535  3392 raft_consensus.cc:1068] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Unable to promote non-voter 5dd1b367d5dd4e6abfd29fc2df2bed07: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:40.436116  1618 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.438097  1537 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:40.443744  3453 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.445622  3453 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.447249  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:40.447594  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:40.447842  2277 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.448416  1536 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 12:59:40.450809  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46804.9us
I20260709 12:59:40.453107  3491 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.453495  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:40.454016  3428 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:40.454097  1619 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:40.454829  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:40.455387  1687 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:40.458392  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:40.460368  1618 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:40.460563  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:40.450475  1692 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.467023  3168 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:40.467543  3168 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.469467  3168 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:40.469826  1619 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:40.470824  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:40.485759  1439 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 3 to 5, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:40.471675  1536 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:40.499251  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:40.499903  1689 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:40.502985  2277 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:40.503520  3368 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:40.503952  3368 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:40.504197  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:40.504443  3368 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:40.504631  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:40.503981  3261 ts_tablet_manager.cc:1434] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.137s	user 0.010s	sys 0.000s
I20260709 12:59:40.508548  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:40.509649  1660 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:40.514640  3492 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:40.515092  3492 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:40.515450  3492 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.517558  3168 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:40.517926  3168 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:40.518257  3168 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.511297  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:40.519852  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 339) took 3590 ms. Trace:
I20260709 12:59:40.527390  1692 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:40.539855  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:40.522626  1443 rpcz_store.cc:276] 0709 12:59:36.929983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.930105 (+   122us) service_pool.cc:224] Handling call
0709 12:59:40.519798 (+3589693us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:40.407333 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:40.425913 (+ 18580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:40.425947 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:59:40.425964 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:40.426532 (+   568us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:40.426598 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:40.426623 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:59:40.426974 (+   351us) tablet.cc:701] Row locks acquired
0709 12:59:40.426994 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:40.427113 (+   119us) write_op.cc:270] Start()
0709 12:59:40.427219 (+   106us) write_op.cc:276] Timestamp: P: 1783601980427072 usec, L: 0
0709 12:59:40.427237 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:59:40.427834 (+   597us) log.cc:844] Serialized 1317 byte log entry
0709 12:59:40.429393 (+  1559us) op_driver.cc:464] REPLICATION: finished
0709 12:59:40.429710 (+   317us) write_op.cc:301] APPLY: starting
0709 12:59:40.429787 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:40.429909 (+   122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:40.429985 (+    76us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:40.430324 (+   339us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:40.430486 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:59:40.430528 (+    42us) write_op.cc:312] APPLY: finished
0709 12:59:40.430716 (+   188us) log.cc:844] Serialized 35 byte log entry
0709 12:59:40.430985 (+   269us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:40.431068 (+    83us) write_op.cc:454] Released schema lock
0709 12:59:40.431105 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:40.431422 (+   317us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:40.431450 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6205,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":1692,"apply.run_wall_time_us":1693,"num_ops":3,"prepare.queue_time_us":94,"prepare.run_cpu_time_us":2756,"prepare.run_wall_time_us":22094,"replication_time_us":2033}]]}
I20260709 12:59:40.520128  3453 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:40.489677  3494 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:59:40.560775  3306 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:40.548161  3464 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.529960  3361 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.563562  3361 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:40.563942  3361 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.564126  1542 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.564749  3464 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.568301  3490 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.570333  3490 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.571641  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:40.572242  2271 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:40.581959  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:40.582883  2277 raft_consensus.cc:2368] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5.
I20260709 12:59:40.585035  1510 leader_election.cc:400] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5.
I20260709 12:59:40.585312  1510 leader_election.cc:403] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:40.589474  1685 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:40.598140  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:40.574391  3492 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:40.606894  1544 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 2: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:40.610646  1542 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:40.611320  3448 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5.
I20260709 12:59:40.618355  3368 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:40.606177  3410 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:59:40.648629  3168 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.650789  3168 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:40.652872  2270 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:40.644081  3361 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.657315  3361 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.665407  3368 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:40.666882  3492 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:40.670462  2271 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:40.673580  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:40.680835  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:40.683314  3494 raft_consensus.cc:993] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:40.683764  2274 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:40.690725  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:40.683743  3494 raft_consensus.cc:1081] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:40.705940  1541 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:40.674630  2268 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:40.713949  3422 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:40.714896  3453 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 12:59:40.713948  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 174173us
I20260709 12:59:40.715754  3453 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.718286  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:40.719058  1537 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:40.720206  3494 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.720383  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:40.720752  1544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 12:59:40.720986  1541 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:40.721305  1544 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:40.721514  3490 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.721681  1544 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.722012  3490 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:40.725620  3490 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:40.722882  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:40.714496  3422 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:40.726895  3422 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.732173  1611 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:40.736565  1541 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:40.737107  3517 raft_consensus.cc:1064] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:40.740072  1440 catalog_manager.cc:5697] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 6, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 12:59:40.720698  3494 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.762163  3452 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.762696  3452 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.741766  1440 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.764127  3494 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.765513  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:40.765882  1543 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.766319  1537 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:40.752106  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:40.770234  1689 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:40.772259  1541 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:40.773216  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:40.773594  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:40.773852  1536 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:40.774876  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:40.759433  3517 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:40.776221  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 171386us
I20260709 12:59:40.778611  3452 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.761626  1585 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:40.782709  2273 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:40.783722  3245 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:40.784451  3457 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:40.784735  1544 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:40.785583  3245 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:40.786458  3245 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.789996  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:40.791432  1543 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:40.792121  3430 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.791472  1536 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 2: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:40.792685  3430 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:40.793555  3430 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.741986  1685 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:40.796595  1703 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-b25acf355940411ba0ffd6483b7467c3 received from {username='slave'} at 127.0.0.1:52426
I20260709 12:59:40.796981  1703 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-b25acf355940411ba0ffd6483b7467c3 on tablet b25acf355940411ba0ffd6483b7467c3 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:40.798231  3460 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.798586  3460 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.798911  3460 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.800957  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:40.806330  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:40.806886  3490 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:40.802376  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:40.807464  3488 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.809650  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:40.812428  3460 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.813041  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:40.838840  2274 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:40.839047  3453 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:40.815919  1544 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:40.817618  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 44088.7us
I20260709 12:59:40.818919  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:40.842157  1693 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:40.842024  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:40.842833  1687 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:40.843211  1687 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:40.819051  2277 raft_consensus.cc:1217] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:40.846479  1691 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:40.844105  1687 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:40.842890  3488 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.860513  1687 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.861763  3488 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:40.822715  3490 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.822424  3494 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.896384  3490 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:40.868037  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:40.822592  3368 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:40.905761  1618 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:40.894578  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:40.841997  3425 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 12:59:40.910017  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 78925.7us
I20260709 12:59:40.909930  1660 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:40.924089  1620 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:40.931959  1687 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:40.919162  2268 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 1.
I20260709 12:59:40.923059  2271 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:40.926169  3428 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:40.930508  3517 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:59:40.938357  3490 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:40.939438  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:40.939981  1611 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.897228  3494 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.941900  1585 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:40.948426  3460 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.950661  3432 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:40.951090  3432 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.951403  3432 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.954991  3494 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.932343  3368 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:40.957021  3368 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:40.960940  3425 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.961408  3425 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:40.963186  3425 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:40.971109  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:40.971680  1615 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:40.971956  3428 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:40.972932  3428 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:40.985239  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:40.984711  3282 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:40.985805  1536 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.987643  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:40.987910  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:40.988262  1543 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:40.988442  1544 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:40.994729  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:41.005046  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:40.989399  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:41.005604  1685 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:40.988086  1614 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:41.008876  1584 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:41.002835  1439 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:41.009480  1687 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:41.022514  1544 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:41.116291  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 12:59:41.013020  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 153270us
I20260709 12:59:41.019054  3490 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:41.097123  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48705us
I20260709 12:59:41.013783  1692 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:41.139093  1687 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:41.069808  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 80478.7us
I20260709 12:59:41.012588  1439 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 3, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:41.146025  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:41.121567  1536 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:41.023406  3422 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:41.149432  1439 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.025059  3421 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:41.026510  3392 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.070111  3463 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:41.078433  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:41.153982  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:41.003649  3517 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
W20260709 12:59:41.151641  3544 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
I20260709 12:59:41.158311  2271 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:41.151881  3422 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.158486  3536 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:41.167635  3422 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.167836  3536 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:41.168733  3536 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:41.169394  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:41.171800  3408 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:41.155170  3463 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.156665  3538 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:41.174628  3463 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.164752  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:41.178097  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:41.174477  1543 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:41.026854  3537 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
I20260709 12:59:41.155581  1687 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:41.024794  3432 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.188139  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:41.188712  2272 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:41.189895  1536 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:41.184672  3538 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:41.194188  3538 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.199108  3452 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:41.201803  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:41.202524  2268 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.213944  1692 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:41.185138  3421 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:41.230347  1443 catalog_manager.cc:5697] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 12:59:41.162554  3392 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:41.243381  3430 raft_consensus.cc:993] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 12:59:41.245903  2268 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:41.254606  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:41.256434  3489 raft_consensus.cc:1081] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
W20260709 12:59:41.256815  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 87484.3us
I20260709 12:59:41.257277  3361 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:41.257612  3457 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.261178  1611 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:41.262060  3437 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.263568  3432 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:41.245715  3422 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.264282  3421 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:41.252990  1443 catalog_manager.cc:5697] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 4 to 5, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.274791  3490 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:41.287911  3539 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:41.311450  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 64504.4us
I20260709 12:59:41.289525  3457 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.304057  3437 raft_consensus.cc:697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 12:59:41.416162  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 102494us
I20260709 12:59:41.287755  3361 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.307677  3539 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:41.427397  3535 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.119s	user 0.003s	sys 0.006s
I20260709 12:59:41.461476  3457 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:41.466539  3422 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:41.314894  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82622e43412243cb95bf17b246050060"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:41.493031  3361 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:41.495049  3437 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.495996  3463 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.432060  3539 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.507823  3549 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.508242  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:41.509191  1611 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:41.512934  3549 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:41.518286  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:59:41.518532  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 209511us
I20260709 12:59:41.518870  1538 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.527514  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:41.528074  1689 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:41.510397  1542 raft_consensus.cc:606] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:59:41.536453  1685 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:41.514823  3392 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:41.547607  3451 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:59:41.559114  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 120248us
I20260709 12:59:41.565016  1543 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:41.571491  2274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45402
I20260709 12:59:41.572032  2274 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:41.572368  2274 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.537367  3549 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:41.578433  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:41.579645  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:41.580246  1620 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:41.587167  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:41.588187  1544 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:41.589114  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82622e43412243cb95bf17b246050060"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:41.589632  1543 raft_consensus.cc:606] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:59:41.606432  1538 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:41.582895  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:41.611352  1428 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 82622e43412243cb95bf17b246050060 already in progress [suppressed 3 similar messages]
I20260709 12:59:41.611809  3463 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:41.581977  3432 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:59:41.617785  2268 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:41.602632  2273 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:41.621644  3147 raft_consensus.cc:1064] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 12:59:41.621323  2274 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.623185  2274 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:41.633041  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:41.636579  1619 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.638108  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:41.639070  2268 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:41.640616  3553 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 12:59:41.638267  3539 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.641650  2270 raft_consensus.cc:2368] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4.
I20260709 12:59:41.645646  3147 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.650388  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:41.659957  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:41.658288  3539 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:41.662961  2269 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:41.664134  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 126213us
I20260709 12:59:41.659047  3421 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:41.665627  3421 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.665936  3421 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:41.666225  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:41.666857  2271 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.673698  2268 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:41.675117  1619 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:41.677541  2243 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:41.681353  1611 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:41.682948  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:41.683671  1620 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:41.685205  3490 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:41.688136  2274 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:41.689009  2268 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:59:41.689575  3550 log.cc:927] Time spent T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 12:59:41.693573  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:41.656705   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:41.701685  2276 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:41.704473  1544 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.703096  1509 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:41.707522  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:41.707242  3147 consensus_queue.cc:1059] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:41.706211  1659 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:41.708811  1691 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:41.707471  3252 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:41.709906  3364 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.715176  3361 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:41.719867  3361 raft_consensus.cc:697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:41.719653  3364 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.718096  3111 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:41.720883  3111 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.720711  3361 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.721272  3111 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.721693  3364 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:41.721176  2271 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:41.724169  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:41.724746  3306 raft_consensus.cc:3055] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:41.725142  3306 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:41.725873  3306 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.727190  1585 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:41.718598  3536 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:59:41.728865  1541 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:41.736492  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:41.737071  1691 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
W20260709 12:59:41.738116  1428 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 126845us
I20260709 12:59:41.738962  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:41.743644  1544 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:41.732170  3252 raft_consensus.cc:697] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:41.748539  1659 leader_election.cc:400] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4.
I20260709 12:59:41.749027  1659 leader_election.cc:403] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:41.748970  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:41.750574  1694 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.746919  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:41.727626  3306 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.751639  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:41.763834  1694 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:41.764441  3147 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4.
I20260709 12:59:41.766191  1439 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.777407  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:41.779327  1439 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 5, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.785663  1694 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:41.791702  1509 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:41.776036  3537 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:41.776278  3539 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:41.806123  3552 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:41.818519  3552 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.818877  3552 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:41.794945  3368 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:59:41.750309  3111 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.759157  3437 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:59:41.836333  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82622e43412243cb95bf17b246050060"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:41.847301  1544 raft_consensus.cc:606] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:59:41.843876  2270 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:41.786748  3430 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:59:41.844419  3252 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.781394  3425 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:59:41.807257  3537 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 12:59:41.852514  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 95300.9us
I20260709 12:59:41.830420  3539 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:41.879478  1611 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:59:41.881244  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 82791.5us
I20260709 12:59:41.885074  3537 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:41.885896  3552 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:41.889475  1539 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:41.855851  3430 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:59:41.896564  1689 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:41.899653  3282 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:59:41.920266  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 160556us
I20260709 12:59:41.926643  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:41.932039  1584 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:41.933797  1691 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:41.935470  1689 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:41.942629  1685 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:41.928025  1542 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.992509  3463 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 12:59:42.003988  3569 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:59:42.004634  1541 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:42.006184  3428 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:42.011514  1537 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:41.957212  3557 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:59:42.013254  3448 raft_consensus.cc:993] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:42.016534  3111 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:41.956683  3570 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:42.018360  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 12:59:42.020498  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 82948.7us
I20260709 12:59:41.964268  3552 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:41.943470  3421 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:42.044080  3392 raft_consensus.cc:1081] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Signalling peer e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:42.064625  1538 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:41.991498  3539 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:42.140583  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 113900us
I20260709 12:59:42.050408  3573 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:59:42.060796  3557 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:59:42.140631  3252 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:42.587739  2277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.068s	sys 0.112s
W20260709 12:59:42.588454  2277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.068s	sys 0.112s
I20260709 12:59:42.603950  3168 raft_consensus.cc:3055] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:42.604487  3168 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:42.605190  3168 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:42.582653  3553 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:59:42.606494  3168 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:42.586524  3580 log.cc:927] Time spent T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:59:42.610338  2274 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:42.632997  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.794977  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.121s	sys 0.298s
W20260709 12:59:42.795498  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.121s	sys 0.298s
I20260709 12:59:42.600610  3422 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.191s
I20260709 12:59:42.819263  3168 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:42.821741  3168 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:42.827776  3168 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:42.826596  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 614) took 1279 ms. Trace:
W20260709 12:59:42.833889  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 53166.1us
I20260709 12:59:42.828083  3421 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:42.861156  1491 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:59:42.861650  1491 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 82622e43412243cb95bf17b246050060 already in progress
I20260709 12:59:42.861737  3573 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:42.861830  3586 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
W20260709 12:59:42.861928  1491 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 82622e43412243cb95bf17b246050060 already in progress
I20260709 12:59:42.862267  3573 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:42.864327  3573 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:42.865875  3583 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:59:42.866972  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 585) took 1016 ms. Trace:
W20260709 12:59:42.869508  3579 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.615s	user 0.001s	sys 0.000s
W20260709 12:59:42.893383  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 47673.3us
I20260709 12:59:42.900331  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:42.902539  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:42.972043  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1452) took 1269 ms. Trace:
I20260709 12:59:42.972558  1538 rpcz_store.cc:276] 0709 12:59:41.703012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.703140 (+   128us) service_pool.cc:224] Handling call
0709 12:59:41.703387 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.065127 (+361740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.971755 (+906628us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400283054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:42.971955 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830202752}
I20260709 12:59:42.974922  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:42.975463  1692 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:42.978823  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1542) took 1073 ms. Trace:
I20260709 12:59:42.979894  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:42.981037  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82622e43412243cb95bf17b246050060"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:52958
I20260709 12:59:42.981550  1691 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:42.981794  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:42.982159  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:42.981838  1691 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.983536  3596 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:42.984263  3451 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:42.990249  1692 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 12:59:42.979530  1611 rpcz_store.cc:276] 0709 12:59:41.905259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.910229 (+  4970us) service_pool.cc:224] Handling call
0709 12:59:41.910558 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:41.911235 (+   677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.911276 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:41.911748 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.034924 (+123176us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:42.034976 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.035061 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.938024 (+902963us) raft_consensus.cc:1685] finished
0709 12:59:42.938049 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.978766 (+ 40717us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7339,"raft.queue_time_us":1511,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":11764,"thread_start_us":122816,"threads_started":1,"wal-append.queue_time_us":151892}
I20260709 12:59:42.993377  1691 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:42.997208  1689 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:42.984637  3451 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:43.004223  3451 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.005261  1691 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:43.005376  3451 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:43.005561  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:43.006151  1538 raft_consensus.cc:3055] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:43.006486  1538 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:43.008683  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:43.007221  1538 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:43.016111  3589 log.cc:927] Time spent T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:59:43.017335  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1456) took 1008 ms. Trace:
I20260709 12:59:43.017774  1541 rpcz_store.cc:276] 0709 12:59:42.009240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.011026 (+  1786us) service_pool.cc:224] Handling call
0709 12:59:42.011304 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.019543 (+  8239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.019571 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.019956 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.795962 (+776006us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:42.796013 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.796097 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.017085 (+220988us) raft_consensus.cc:1685] finished
0709 12:59:43.017116 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.017270 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7886,"raft.queue_time_us":14643,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":21169,"thread_start_us":737598,"threads_started":1,"wal-append.queue_time_us":858828}
I20260709 12:59:43.032212  3601 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.034132  3601 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.034508  3282 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:43.038874  1584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.016s	sys 0.069s
W20260709 12:59:43.039299  1584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.016s	sys 0.069s
W20260709 12:59:43.039597  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 787156us
I20260709 12:59:43.042748  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:43.053447  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:59:43.059543  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.007s	sys 0.004s
W20260709 12:59:43.059921  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.007s	sys 0.004s
I20260709 12:59:43.035266  3396 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:43.062407  1611 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:59:43.064939  1694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.105s	user 0.003s	sys 0.011s
W20260709 12:59:43.070093  1694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.003s	sys 0.011s
I20260709 12:59:43.071319  3147 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.071835  3147 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:42.845569  2273 rpcz_store.cc:276] 0709 12:59:41.547140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.549046 (+  1906us) service_pool.cc:224] Handling call
0709 12:59:41.602125 (+ 53079us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:41.602318 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.602521 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:41.849443 (+246922us) log.cc:844] Serialized 14 byte log entry
0709 12:59:42.776424 (+926981us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.780477 (+  4053us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:42.790243 (+  9766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.798518 (+  8275us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.824518 (+ 26000us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1768,"raft.queue_time_us":360497,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":49946,"spinlock_wait_cycles":31007872,"thread_start_us":633900,"threads_started":2,"wal-append.queue_time_us":290269}
I20260709 12:59:43.073566  3421 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 12:59:43.045287  3585 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:59:43.038049  3598 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:43.079304  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.005s	sys 0.011s
W20260709 12:59:43.086386  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.005s	sys 0.011s
W20260709 12:59:43.089025  2268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.010s	sys 0.007s
W20260709 12:59:43.090070  2268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.010s	sys 0.007s
I20260709 12:59:43.035023  3282 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:43.079408  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.096264  3452 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:43.097868  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.012s	sys 0.003s
W20260709 12:59:43.098652  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.013s	sys 0.003s
I20260709 12:59:43.074033  3421 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.103606  1691 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:59:43.099458  3452 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.092799  3392 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.105397  3392 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.074894  3396 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.106791  3488 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:43.107306  3488 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.108378  3396 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:43.109397  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:43.113190  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 587) took 1214 ms. Trace:
I20260709 12:59:42.877662  2270 rpcz_store.cc:276] 0709 12:59:41.850918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.851674 (+   756us) service_pool.cc:224] Handling call
0709 12:59:41.877773 (+ 26099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:41.878168 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.878199 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:41.901648 (+ 23449us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.068384 (+166736us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:42.069737 (+  1353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.141505 (+ 71768us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.866757 (+725252us) raft_consensus.cc:1685] finished
0709 12:59:42.866782 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.866909 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2652,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":20483,"thread_start_us":93232,"threads_started":1,"wal-append.queue_time_us":220249}
I20260709 12:59:43.113659  2277 rpcz_store.cc:276] 0709 12:59:41.898877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.899037 (+   160us) service_pool.cc:224] Handling call
0709 12:59:41.899500 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:41.899818 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.899844 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:41.900800 (+   956us) log.cc:844] Serialized 564 byte log entry
0709 12:59:42.588858 (+688058us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:42.588911 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.588998 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.112944 (+523946us) raft_consensus.cc:1685] finished
0709 12:59:43.112969 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.113127 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":687734,"threads_started":1,"wal-append.queue_time_us":924660}
W20260709 12:59:43.118736  1657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.021s
W20260709 12:59:43.134794  1657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.001s	sys 0.022s
I20260709 12:59:43.109669  3488 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.069307  3599 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:59:43.121017  2275 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:43.110021  3421 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:43.116382  3490 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:43.117115  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.000s	sys 0.012s
I20260709 12:59:43.107851  3392 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.172577  3490 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.173484  3598 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:43.176648  3598 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.177299  3282 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.177464  3490 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.177824  3282 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.178227  3604 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:43.178294  3282 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.178854  3604 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.145792  3452 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:43.180927  3604 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.139947  3581 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.146224  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.188911  3619 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.189471  3619 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.191534  3619 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.193002  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 331) took 1178 ms. Trace:
I20260709 12:59:43.186532  3581 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.193344  1690 rpcz_store.cc:276] 0709 12:59:42.014331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.017053 (+  2722us) service_pool.cc:224] Handling call
0709 12:59:42.017508 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.017874 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.017911 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.018410 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.060272 (+1041862us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:43.060318 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.060394 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.192827 (+132433us) raft_consensus.cc:1685] finished
0709 12:59:43.192848 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.192954 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7969,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":18645,"thread_start_us":1041455,"threads_started":1,"wal-append.queue_time_us":1081208}
I20260709 12:59:43.195418  1615 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:43.196067  3581 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.196406  3601 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:43.174310  3620 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.196765  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1369) took 1264 ms. Trace:
I20260709 12:59:43.172346  3421 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.197160  3620 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.197209  1694 rpcz_store.cc:276] 0709 12:59:41.932693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.934368 (+  1675us) service_pool.cc:224] Handling call
0709 12:59:41.934610 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:41.934921 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.934947 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:41.935306 (+   359us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.071112 (+1135806us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:43.071146 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.071221 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.196557 (+125336us) raft_consensus.cc:1685] finished
0709 12:59:43.196583 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.196711 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19813,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6356,"spinlock_wait_cycles":1891584,"thread_start_us":1110891,"threads_started":1,"wal-append.queue_time_us":1163105}
I20260709 12:59:43.198616  3421 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.199923  3620 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.191156  3282 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:43.200547  3421 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:43.182556  3537 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:43.202163  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 535) took 1444 ms. Trace:
I20260709 12:59:43.178541  3598 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.203220  3598 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.202546  2268 rpcz_store.cc:276] 0709 12:59:41.757614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.769100 (+ 11486us) service_pool.cc:224] Handling call
0709 12:59:42.007172 (+238072us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:42.007414 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.046922 (+ 39508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.048829 (+  1907us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.246927 (+198098us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.978717 (+731790us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29e8c9b0ac 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b
0709 12:59:43.144411 (+165694us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:43.147049 (+  2638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.173369 (+ 26320us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.201945 (+ 28576us) raft_consensus.cc:1685] finished
0709 12:59:43.201972 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.202091 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18340,"raft.queue_time_us":20424,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7569,"spinlock_wait_cycles":24861184,"thread_start_us":556142,"threads_started":1,"wal-append.queue_time_us":919236}
I20260709 12:59:43.202550  3537 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.204777  3451 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.205340  3451 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.206990  3537 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:43.204015  3598 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.209782  3598 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.212754  3451 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:43.213502  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.000s	sys 0.012s
I20260709 12:59:43.217720  3392 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.218379  3392 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.220604  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:43.220834  3392 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.226275  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:43.228560  3554 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:43.235278  1543 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 12:59:43.238801  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 100118us
I20260709 12:59:43.247248  3430 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:43.247758  3430 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.256274  3147 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:43.256743  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:43.256992  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:43.257682  1545 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:43.258432  3623 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:43.261235  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:43.262580  3437 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:43.263123  3437 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.265102  3437 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:43.265615  3437 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:43.240710  3630 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.244068  3617 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:43.244156  3598 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.244402  3542 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.270112  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:43.272756  3573 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.285903  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:43.273571  3584 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.133s	user 0.010s	sys 0.023s
I20260709 12:59:43.275777  3147 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 12:59:43.278249  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 240618us
I20260709 12:59:43.286710  1614 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:59:43.431133  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.472028  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:43.478092  1691 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
W20260709 12:59:43.364743  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 72559.6us
I20260709 12:59:43.486774  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:43.495903  1509 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:43.500180  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:43.505064  3147 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:43.578776  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 82968.9us
I20260709 12:59:43.580397  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:43.580674  1509 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:43.450280  3212 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.452634  3451 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 12:59:43.577804  3608 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:59:43.466706  3623 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.375907  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:43.286191  3573 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.415676  3570 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.430466  3407 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.430948  3436 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.588267  3421 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.580909  3430 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:43.504321  3539 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:59:43.601037  3573 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.592411  3552 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.592664  3571 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.593626  3488 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:43.285954  3598 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.594411  3559 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:43.619676  1509 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:43.603452  3620 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.280598  3617 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.625835  3617 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:43.280737  3630 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.601920  2268 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:59:43.598655  3451 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.597317  3212 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:43.652657  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.652262  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:43.662391  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:43.663107  1618 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.675890  3147 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:43.300261  3542 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.604739  3436 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.682106  3436 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:43.682322  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.599162  3623 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.684319  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.685156  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.685644  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.685936  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.687148  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.689013  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.690254  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.691758  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.605038  3407 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.627368  3559 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.611656  3552 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.604094  3570 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.621111  3488 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.688580  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:43.841524  3634 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:59:43.841890  3640 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.842422  3640 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.840269  3306 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.843545  3306 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.842875  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.847132  1619 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:43.698391  1618 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:43.847689  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:43.777395  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.841348  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:43.856034  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:43.802762  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 296268us
I20260709 12:59:43.647006  3620 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:43.693012  1694 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:43.893313  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:43.692390  3489 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.618974  3571 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:43.840243  3598 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.692178  3425 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:43.802850  3437 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:43.777691  3453 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:43.906983  2268 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:43.929092  3489 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.927863  3620 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:44.007407  3617 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.946488  3437 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.030745  3640 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:44.036561  3451 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:43.969841  3453 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:44.119388  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.122927  1509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.000s
W20260709 12:59:44.229616  1509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.006s	sys 0.001s
W20260709 12:59:44.123497  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.000s
I20260709 12:59:44.230396  3364 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:44.230845  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.006s	sys 0.000s
W20260709 12:59:44.231181  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 611460us
I20260709 12:59:44.231348  3364 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.128161  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.133438  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1459) took 1287 ms. Trace:
I20260709 12:59:44.134790  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1384) took 2418 ms. Trace:
I20260709 12:59:44.141325  3649 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:44.137490  1442 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.149446  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1545) took 1011 ms. Trace:
I20260709 12:59:44.153055  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.160594  3368 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:44.161054  3212 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.141934  1440 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 5 to 6, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.234424  1537 rpcz_store.cc:276] 0709 12:59:42.845706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.847008 (+  1302us) service_pool.cc:224] Handling call
0709 12:59:44.123384 (+1276376us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b5800004e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80eee 0000000000375939 00007f29f0cf41e0 00007f29f0dbd0c4 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:44.123754 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.124223 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.124261 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.124348 (+    87us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:44.124391 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.124465 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.133226 (+  8761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3316480}
I20260709 12:59:44.174005  3407 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:43.946343  3425 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:43.947413  3306 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.072029  3489 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:44.036288  3488 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.059330  3542 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.070289  3559 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.060554  3570 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.058609  3571 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.067981  3573 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:44.038900  3617 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.324826  3617 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.325026  3453 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.325803  1691 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:44.073680  3620 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:44.059648  3623 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.046461  3630 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.235037  3642 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.327816  3642 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.172170  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 540) took 1053 ms. Trace:
I20260709 12:59:44.330749  2273 rpcz_store.cc:276] 0709 12:59:43.119005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.132027 (+ 13022us) service_pool.cc:224] Handling call
0709 12:59:44.170751 (+1038724us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:44.171148 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.171574 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.171603 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.171666 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:44.171722 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.171794 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.171929 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4057472}
I20260709 12:59:44.236097  1611 rpcz_store.cc:276] 0709 12:59:43.138329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.166902 (+ 28573us) service_pool.cc:224] Handling call
0709 12:59:43.167204 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.199370 (+ 32166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.199399 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:43.199437 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:43.199463 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.148886 (+949423us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b5400111cd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:44.148972 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.149252 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73528192}
I20260709 12:59:44.331943  3425 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.332635  3425 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:44.333112  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.333346  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.333225  3425 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:44.234504  3364 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.239638  3368 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.336350  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.337548  3368 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.241462  3437 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.238494  3536 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.340446  3536 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.235234  1539 rpcz_store.cc:276] 0709 12:59:41.715970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.718258 (+  2288us) service_pool.cc:224] Handling call
0709 12:59:41.840027 (+121769us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5800004e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:41.840249 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.889972 (+ 49723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.134172 (+2244200us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b540025b7d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:44.134543 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122998272}
W20260709 12:59:44.270835  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 315259us
I20260709 12:59:44.271360  3655 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:59:44.322448  3573 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:44.347294  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.348905  3536 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.349306  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.350940  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 538) took 2431 ms. Trace:
I20260709 12:59:44.351392  2276 rpcz_store.cc:276] 0709 12:59:41.919350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.919865 (+   515us) service_pool.cc:224] Handling call
0709 12:59:41.920183 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:41.925395 (+  5212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.925433 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:41.926124 (+   691us) log.cc:844] Serialized 52 byte log entry
0709 12:59:42.024596 (+ 98472us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.070392 (+ 45796us) log.cc:844] Serialized 14 byte log entry
0709 12:59:42.070745 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 12:59:43.244191 (+1173446us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b1800402be0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb8522 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 12:59:44.350219 (+1106028us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b540071fd20. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd20733 00007f29ebda5dbf 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c
0709 12:59:44.350283 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.350412 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.350476 (+    64us) raft_consensus.cc:1685] finished
0709 12:59:44.350490 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.350745 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4763,"prepare.queue_time_us":996428,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":8042,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":163159,"spinlock_wait_cycles":391762048,"thread_start_us":143556,"threads_started":2,"wal-append.queue_time_us":98469,"wal-append.run_cpu_time_us":4509,"wal-append.run_wall_time_us":1808749}
I20260709 12:59:44.296773  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.274796  1509 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:44.308386  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 586) took 2457 ms. Trace:
I20260709 12:59:44.283380  3407 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:44.394819  3407 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:44.393674  2271 rpcz_store.cc:276] 0709 12:59:41.851215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.853187 (+  1972us) service_pool.cc:224] Handling call
0709 12:59:44.279977 (+2426790us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:44.307512 (+ 27535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.307921 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.307946 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.308000 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.308040 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.308099 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.308224 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40604032}
I20260709 12:59:44.395988  3407 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:44.397133  3407 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.397161  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 1979) took 1416 ms. Trace:
I20260709 12:59:44.397764  1689 rpcz_store.cc:276] 0709 12:59:42.980799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.985350 (+  4551us) service_pool.cc:224] Handling call
0709 12:59:42.985588 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.997674 (+ 12086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.396767 (+1399093us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5400124b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:44.396984 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26178304}
I20260709 12:59:44.399369  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.400666  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.401216  1689 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:44.402011  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.318017  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1375) took 1034 ms. Trace:
I20260709 12:59:44.322144  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.337862  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.330353  3642 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.353318  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.289140  1538 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.354513  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.355165  3592 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:44.355513  3562 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.358121  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.358626  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.356650  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.359309  3396 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.359267  3551 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.362792  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.363649  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.360719  1618 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:44.368151  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.370011  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.376157  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.380632  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:44.306375  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.425539  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.374575  3425 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.387483  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.381433  1660 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.391986  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.405571  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:44.407022  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 85161.2us
I20260709 12:59:44.407702  3643 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.408578  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.409080  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:44.409950  3635 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.775s	user 0.005s	sys 0.011s
W20260709 12:59:44.423707  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 149168us
I20260709 12:59:44.403519  1692 rpcz_store.cc:276] 0709 12:59:43.283339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.676459 (+393120us) service_pool.cc:224] Handling call
0709 12:59:44.299711 (+623252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.300144 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.300167 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.300217 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.300243 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.300334 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.317664 (+ 17330us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54002e45d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:44.317809 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386383616}
I20260709 12:59:44.427038  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.430495  1611 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:44.436671  1542 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
W20260709 12:59:44.437024  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 55859.2us
I20260709 12:59:44.437299  3642 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:44.437698  3642 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:44.438079  3642 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:44.438735  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 1983) took 1156 ms. Trace:
I20260709 12:59:44.438988  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.439100  1690 rpcz_store.cc:276] 0709 12:59:43.282351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.282493 (+   142us) service_pool.cc:224] Handling call
0709 12:59:43.286846 (+  4353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.626478 (+339632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.626542 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:43.626596 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:43.626637 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.417854 (+791217us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001603d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:44.424401 (+  6547us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.438548 (+ 14147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780522368}
I20260709 12:59:44.440596  3396 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.442893  3551 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.446795  3592 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.448220  2272 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:44.449141  1539 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:44.449710  3463 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:44.450239  1543 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:44.451741  3147 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.453506  1510 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.424453  3368 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.454602  3368 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.456704  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:44.457427  3562 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.458022  1686 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:44.434005  1687 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:44.458606  1691 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:44.464797  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.468219  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.469485  3643 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:44.470952  1538 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
W20260709 12:59:44.471477  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1464) took 1466 ms (client timeout 1663 ms). Trace:
W20260709 12:59:44.471796  1538 rpcz_store.cc:269] 0709 12:59:43.005205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.005333 (+   128us) service_pool.cc:224] Handling call
0709 12:59:44.280761 (+1275428us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b580049e2d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd010aa 00007f29ebd83447 00007f29ebd9bfe7 00007f29ebd9d7de 00007f29ebda927c 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c
0709 12:59:44.471396 (+190635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2904688384}
I20260709 12:59:44.479141  3552 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.479436  3561 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 12:59:44.482352  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 43673.4us
I20260709 12:59:44.484014  1509 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:44.489199  3396 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.489223  3562 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.491473  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.493214  1543 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:44.495834  3430 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:44.495970  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.496299  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45390 (request call id 629) took 1220 ms. Trace:
I20260709 12:59:44.496495  3430 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:44.499091  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.500610  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.501608  3552 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:44.501997  3552 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:44.502365  3552 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.502884  3396 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.503638  3396 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.506243  3396 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.506906  3364 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:44.507551  3364 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.508328  3615 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.480072  3561 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.509112  3615 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.509447  3364 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.496757  2272 rpcz_store.cc:276] 0709 12:59:43.276124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.280112 (+  3988us) service_pool.cc:224] Handling call
0709 12:59:44.296416 (+1016304us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 12:59:44.496105 (+199689us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x7b540071f554. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:44.496228 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315451904}
I20260709 12:59:44.491740  3551 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.511855  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.525568  3643 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.513491  3536 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.537734  3594 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.543931  1541 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:44.544716  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 80829.7us
I20260709 12:59:44.528154  3643 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.552222  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.538329  3594 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.567054  3421 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:44.567965  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.569090  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.569890  2269 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:44.572680  2268 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:44.573354  3603 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.576375  1612 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:44.577848  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.578122  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.578825  2277 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:44.579258  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:44.579981  3661 log.cc:927] Time spent T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:59:44.552842  3562 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.587414  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.565600  3592 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:44.590488  1509 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:44.595538  3561 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.596896  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.599141  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.604048  3430 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:44.604696  1585 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:44.559641  3536 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:44.611537  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 125665us
I20260709 12:59:44.616142  3407 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:44.616796  1545 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 12:59:44.622630  3407 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.622507  3592 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:44.623740  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.623764  3592 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.617125  3628 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:44.625039  3628 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.625437  3628 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.626204  3592 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.627624  3451 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:44.629220  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:44.625459  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.630120  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:44.573915  3603 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.641916  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.646225  3430 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:44.646338  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.646750  3430 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.622385  3552 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.610653  3642 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:44.655918  3336 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.656271  3561 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:44.657296  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:44.657975  3407 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.659004  3594 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.659595  3643 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.660267  3615 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.661486  1440 catalog_manager.cc:5697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 4 to 5, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.663407  3536 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:44.663708  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 80606.6us
I20260709 12:59:44.666043  3603 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.665129  3282 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.667837  3368 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.647158  3430 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.691737  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.688953  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.678930  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.682750  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 340) took 3406 ms. Trace:
I20260709 12:59:44.682971  3592 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:44.683012  1660 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.683921  3594 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:44.684227  3336 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.686774  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.654767  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:44.700206  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.677088  3561 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 12:59:44.711715  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.703907  3594 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:44.715394  2269 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.719295  1440 catalog_manager.cc:5697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.721251  1440 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 3 to 5, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:44.709975  3592 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.726944  3282 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.727605  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.718371  3396 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:44.731014  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.716861  3594 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.734716  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.735248  3368 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:44.735975  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.735792  3368 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:44.736616  3642 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.737056  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.737900  3368 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.711751  3561 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.738199  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.738214  1658 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:44.739652  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:44.740170  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:44.740737  3396 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:44.741261  3396 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:44.742223  3396 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.727021  3592 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:44.747686  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.748247  2277 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:44.751286  3554 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:44.753106  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 71844us
I20260709 12:59:44.747346  1440 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.756107  3554 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.756119  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.765949  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.767544  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.768805  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.772544  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.776600  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.777844  3562 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:44.778445  3562 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.779450  3451 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:44.780026  3451 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:44.780521  3562 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.781127  3650 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:44.781683  3650 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.782002  3451 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:44.758549  3554 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.783779  3650 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.783507  3552 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.785934  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.783191  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.788549  1510 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.699329  1439 rpcz_store.cc:276] 0709 12:59:41.275991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.276103 (+   112us) service_pool.cc:224] Handling call
0709 12:59:44.682470 (+3406367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:41.810149 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:41.810790 (+   641us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:41.810841 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:59:41.810868 (+    27us) tablet.cc:662] Decoding operations
0709 12:59:41.811320 (+   452us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:41.811404 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:41.811443 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:41.811824 (+   381us) tablet.cc:701] Row locks acquired
0709 12:59:41.811846 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:59:41.812020 (+   174us) write_op.cc:270] Start()
0709 12:59:41.812154 (+   134us) write_op.cc:276] Timestamp: P: 1783601981811969 usec, L: 0
0709 12:59:41.812184 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:59:41.812899 (+   715us) log.cc:844] Serialized 924 byte log entry
0709 12:59:41.859193 (+ 46294us) op_driver.cc:464] REPLICATION: finished
0709 12:59:41.900269 (+ 41076us) write_op.cc:301] APPLY: starting
0709 12:59:41.900343 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:41.900451 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:41.900526 (+    75us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:41.900797 (+   271us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:41.900943 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:41.900982 (+    39us) write_op.cc:312] APPLY: finished
0709 12:59:41.919793 (+ 18811us) log.cc:844] Serialized 29 byte log entry
0709 12:59:41.943843 (+ 24050us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:41.956091 (+ 12248us) write_op.cc:454] Released schema lock
0709 12:59:41.957456 (+  1365us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:42.029613 (+ 72157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:42.045234 (+ 15621us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23656,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":21654,"apply.run_cpu_time_us":1824,"apply.run_wall_time_us":92116,"num_ops":2,"prepare.queue_time_us":725,"prepare.run_cpu_time_us":3121,"prepare.run_wall_time_us":40968,"replication_time_us":41504}]]}
I20260709 12:59:44.787704  2276 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:44.786983  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.791898  3619 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.791880  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.792119  3600 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:44.792922  3619 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.794142  3600 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.796011  3647 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:44.792798  2273 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:44.702579  3628 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.775710  3368 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:44.811358  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.811506  3657 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:44.811861  1510 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.812116  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.812769  1685 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:44.813376  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.811893  1691 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:44.814316  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.815043  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.816219  3643 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:44.816797  1690 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:59:44.811944  3657 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:44.819613  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.819792  3657 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.820209  1688 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:44.796607  3647 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.823024  1660 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.825563  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.748755  3430 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:44.829367  3368 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:44.830896  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:44.831094  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:44.832314  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.834404  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.826119  1688 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:44.840862  1620 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:44.838704  1585 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:44.844350  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.845949  3453 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:44.846302  3453 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:44.846913  3453 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.847469  3600 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.849756  1693 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:44.839192  1440 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.799078  3650 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:59:44.857298  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.848017  3559 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:44.859380  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.846359  3561 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:44.866740  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.877012  2269 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:44.876899  3396 consensus_queue.cc:1059] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:44.879557  1440 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.869639  1536 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:44.885840  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.886561  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.891619  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.890486  2270 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 12:59:44.894793  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.894824  3368 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:44.896763  1543 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:44.908759  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.911917  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.914953  1692 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:44.919778  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.922869  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.923645  1537 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:44.924719  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.883898  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.931519  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.936058  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.953464  1692 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:44.939982  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.959710  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.962244  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:44.965881  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:44.952685  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:44.987797  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 137556us
I20260709 12:59:44.989821  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:44.990322  2274 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.968531  3628 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:44.991873  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:44.998440  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:44.999133  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.967665  3594 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:44.978818  3407 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:44.971803  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:44.982239  1542 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:45.008186  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:44.998929  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.012001  1687 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:45.000352  3619 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.000957  3430 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.012415  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.011343  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.003749  3407 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:45.015388  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.016281  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.017769  3517 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:45.018357  3571 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:45.018863  3571 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:45.018474  3517 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.019248  3571 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.020311  3659 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:45.019106  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:45.023429  3675 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 12:59:45.023556  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.021550  3407 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.025008  3590 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.025852  3539 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:59:45.028700  3536 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:45.029062  3536 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:45.029922  3536 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:45.031277  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:45.031059  3407 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.033047  1612 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:45.034386  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.036106  3407 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.037518  3647 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.041180  3603 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.042240  3603 raft_consensus.cc:3055] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:45.042568  3603 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:45.043533  3603 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.044710  3603 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.044153  3453 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.037380  3463 raft_consensus.cc:3055] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:45.046929  3463 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:45.047789  3463 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.048892  3463 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:45.049437  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.051198  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:45.051103  3657 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.051434  3453 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.052263  1539 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:45.034441  3336 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.061853  2241 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.069092  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:45.020705  3659 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:45.022891  3561 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:45.075215  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.077076  1536 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:45.077117  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.079532  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.075840  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.067476  3430 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.071782  3536 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.088392  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.088896  1692 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 1.
I20260709 12:59:45.089390  1691 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:45.073421  3659 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.082156  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.090778  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.091084  1537 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:45.091332  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.091601  1693 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:45.092446  1544 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:45.093039  3602 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:45.093434  3602 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 12:59:45.094373  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 115238us
I20260709 12:59:45.093782  3602 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:45.081732  3517 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.081504  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:45.096714  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:45.101516  2241 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.109484  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.110374  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.118258  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:45.119527  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.119912  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.100641  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:45.105225  3592 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:45.125362  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.107089  3590 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:45.125870  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.127158  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:45.140218  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:45.095381  3430 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:45.123819  3364 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:45.155479  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 70788us
W20260709 12:59:45.129200  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 53671.2us
I20260709 12:59:45.129771  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.130787  3592 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.137763  3590 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:45.128479  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.163012  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.124802  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.157778  1691 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:45.164038  3655 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:45.165361  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.159394  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:45.159926   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:45.160367  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:45.132067  1693 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:45.151144  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.153681  3594 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:45.173147  1618 raft_consensus.cc:2410] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:45.163331  2275 raft_consensus.cc:2376] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4. Re-sending same reply.
I20260709 12:59:45.164572  3655 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.158833  3430 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:45.178655  1509 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.180333  2274 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:45.180590  3517 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.181455  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:45.174013  3368 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:45.183615  3368 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:45.165640  3590 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.188938  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:45.163532  3592 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.170903  3463 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.205056  3571 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.207660  1612 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:45.196436  3539 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:45.210068  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 85395.5us
I20260709 12:59:45.205360  3559 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:45.220034  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 49262.3us
I20260709 12:59:45.222335  3433 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:45.224396  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.224673  3433 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.223908  1585 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:45.224682  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:45.230532  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.233417  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:45.235540  3368 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:45.236639  3628 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:45.237147  3628 raft_consensus.cc:697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:45.238395  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:45.218324  3559 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:45.238956  3559 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.239244  3602 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.240309  2272 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:45.241997  3602 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:45.243017  3562 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.243500  1659 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:45.243166  3686 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:45.244556  3562 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.245471  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:45.246862  3561 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:45.247242  3561 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:45.238034  3628 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.246572  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.257042  1659 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:45.262579  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 46637.3us
I20260709 12:59:45.263441  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.261438  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:45.261291  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:45.251544  3561 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.262235  3562 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:45.265815  1617 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:59:45.274854  1617 pending_rounds.cc:85] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 4
I20260709 12:59:45.276975  1659 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.279596  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.279887  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.280990  1659 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.275104  1617 pending_rounds.cc:107] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:59:45.281991  1617 raft_consensus.cc:2889] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:45.275633  1509 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.284138  3147 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.284250  1659 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.285327  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:45.281543  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 104906us
I20260709 12:59:45.286556  1658 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.282411  3451 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.292866  3451 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.293449  3451 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.293619  3147 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.272048  3463 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.300463  3364 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.282087  3603 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.305182  2275 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:45.286923  3594 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.274821  3562 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 12:59:45.319380  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 45744.7us
I20260709 12:59:45.320717  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.319916  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.321331  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:45.309684  3517 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.323781  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:45.326391  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 46596.2us
I20260709 12:59:45.328552  3556 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.329324  3619 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:45.329862  3619 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:45.330318  3619 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.328070  1511 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:45.331247  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.334508  3642 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.336154  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.322566  3562 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:45.337565  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 51079us
I20260709 12:59:45.338428  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.323431  3552 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:45.341331  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 56031.1us
I20260709 12:59:45.327272  3336 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:45.347404  3336 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:45.347908  3336 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.349426  3696 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:45.349882  3590 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.343015  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.344236  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.327598  3695 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.347522  3643 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.357260  1658 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.358790  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:45.358970  1658 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.360086  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.351441  3571 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.354965  3642 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.363551  2241 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.356822  3554 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.364845  1659 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.366909  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.367441  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.365772  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.373395  1694 raft_consensus.cc:2410] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:45.367292  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.368685  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.368973  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.374511  3571 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:45.374969  3571 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:45.375326  3571 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.375349  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.376040  3659 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.378086  3659 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.364410  3700 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.370874  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.379832  1685 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.371433  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.371526  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.388276  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.381560  3592 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.363395  3407 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.392148  3463 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.397496  3699 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.404007  2270 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:45.401209  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.391045  3590 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:45.392802  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 56777.8us
I20260709 12:59:45.414023  1509 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.396150  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.382386  3594 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.420037  1685 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:45.420717  3536 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.421514  3556 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:45.404372  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.421056  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.363581  3628 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:45.424405  3623 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:45.424777  3623 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:45.399812  3453 consensus_queue.cc:1059] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:59:45.425381  3692 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.425576  3623 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:45.426470  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.419356  3642 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.428022  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.429410  3590 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.429154  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.430051  3590 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.430693  3590 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.430819  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.431514  3536 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.429119  3336 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.438474  3336 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.433076  1616 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:45.439263  3453 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:45.383787  3695 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.439682  3453 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:45.433661  3623 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.440699  3453 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:45.441933  3655 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.434303  3396 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.436549  3643 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.442632  1509 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.443562  3453 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.443970  3562 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.446863  3643 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.447311  3692 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:45.447700  3692 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:45.447567  3643 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:45.450829  1687 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:45.451980  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.452700  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.453665  3657 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.457195  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:45.457454  3428 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:45.458314  1616 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:45.458835  3430 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:45.459287  3430 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:45.459535  3433 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.460105  3430 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.404755  3559 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.461241  3430 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.470958  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.403798  3592 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:45.462632  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38400 (request call id 228) took 3799 ms. Trace:
I20260709 12:59:45.464371  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:45.486090  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.465894  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:45.448624  3692 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.492259  1584 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.464720  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.516702  3605 consensus_queue.cc:1059] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:45.432475  3628 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:45.520648  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:45.517870  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:45.518564  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 52757.2us
I20260709 12:59:45.463049  3559 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.486150  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.490206  3603 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.414229  3561 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.525547  2241 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.521965  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.550235  3433 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:45.550431  3602 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.550843  3655 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.550845  3433 raft_consensus.cc:697] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:45.553210  3433 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.525799  3695 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:45.559808  3692 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.518205  3536 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:59:45.515702  3633 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:59:45.522214  3407 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.529896  3364 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:59:45.533449  3605 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.459571  3571 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.516494  1442 rpcz_store.cc:276] 0709 12:59:41.663694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.665302 (+  1608us) service_pool.cc:224] Handling call
0709 12:59:45.462575 (+3797273us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:44.836063 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:44.887476 (+ 51413us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:44.887523 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:59:44.887540 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:44.887957 (+   417us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:44.888034 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:44.888060 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:44.888344 (+   284us) tablet.cc:701] Row locks acquired
0709 12:59:44.888388 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:59:44.888543 (+   155us) write_op.cc:270] Start()
0709 12:59:44.888689 (+   146us) write_op.cc:276] Timestamp: P: 1783601984888485 usec, L: 0
0709 12:59:44.888726 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:59:44.889481 (+   755us) log.cc:844] Serialized 536 byte log entry
0709 12:59:45.157916 (+268435us) op_driver.cc:464] REPLICATION: finished
0709 12:59:45.421461 (+263545us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5400321328. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f21619e1 00007f29f216064c 00007f29ef7dc845 00007f29ef7e0d61 00007f29ef7e0d19 00007f29ef7e0ca9 00007f29ef7e0c71 00007f29ef7dfe9d 000000000038f354 000000000038f199 00007f29e8cb8475
0709 12:59:45.421540 (+    79us) write_op.cc:301] APPLY: starting
0709 12:59:45.421648 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:45.421745 (+    97us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:45.421765 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:45.422013 (+   248us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:45.422186 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:45.422227 (+    41us) write_op.cc:312] APPLY: finished
0709 12:59:45.424293 (+  2066us) log.cc:844] Serialized 23 byte log entry
0709 12:59:45.424463 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:45.424534 (+    71us) write_op.cc:454] Released schema lock
0709 12:59:45.424590 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:45.424966 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:45.424993 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2551449,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":10262,"apply.run_cpu_time_us":5259,"apply.run_wall_time_us":238380,"num_ops":1,"prepare.queue_time_us":163386,"prepare.run_cpu_time_us":28359,"prepare.run_wall_time_us":175863,"raft.queue_time_us":54029,"raft.run_cpu_time_us":38284,"raft.run_wall_time_us":81241,"replication_time_us":269038,"spinlock_wait_cycles":5064064,"thread_start_us":210022,"threads_started":4,"wal-append.queue_time_us":178203}]]}
I20260709 12:59:45.588589  1538 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:45.562532  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.590437  1659 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.591997  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 12:59:45.517377  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 178997us
I20260709 12:59:45.526595  3628 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:45.451181  3619 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.530753  1509 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.572093  1687 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:45.572805  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:45.575786  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.593410  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.593926  1686 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.582785  1540 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:45.566489  3695 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:45.613790  3364 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:45.615048  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 84388.7us
I20260709 12:59:45.617411  2274 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:45.618023  3623 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.620851  3561 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.621379  1686 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:45.629997  3642 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:45.626941  3364 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:45.632835  3600 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.632723  3364 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.633886  3364 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.637521  1614 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:45.643855  1510 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.612165  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:45.624027  3437 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.659411  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:45.641701  3699 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.626588  3695 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:45.661636  1538 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:45.640218  3659 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.656617  3703 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.673751  3619 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.684924  1686 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:45.690658  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.693550  2274 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:45.695849  3655 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:59:45.701074  1617 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:45.695353  3659 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 12:59:45.703953  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 110543us
I20260709 12:59:45.705209  3659 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:45.706007  3571 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.706143  3592 consensus_queue.cc:1059] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:45.707468  3603 raft_consensus.cc:3055] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:45.707813  3603 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:45.708722  3603 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.710498  3603 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.712014  3147 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.718950  1614 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:45.720718  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 169796us
I20260709 12:59:45.721874  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 12:59:45.723567  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.725845  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:45.706493  3562 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:45.695761  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.729108  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.738135  3571 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.728276  3600 consensus_queue.cc:1059] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 12:59:45.763230  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.763027  2243 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:59:45.763903  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 73727.7us
I20260709 12:59:45.769389  3556 raft_consensus.cc:3055] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:45.771910  3628 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:45.773211  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 59873.6us
I20260709 12:59:45.775153  3628 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:45.776405  1510 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.779325  3713 consensus_queue.cc:1059] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:45.778439  3517 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.779706  2241 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.780192  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:45.773245  3556 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:45.780753  1545 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.781304  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.780409  3364 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:45.783459  3699 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.786041  3713 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:45.786394  3713 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:45.788200  3650 raft_consensus.cc:3055] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:45.788568  3650 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:45.781278  3556 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.797955  3556 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.766693  3603 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:45.787268  3713 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.789945  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.792487  1540 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:45.804662  3628 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.808027  3695 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.809098  2270 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:45.808079  3433 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:45.809763  3433 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:45.810878  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.810634  3433 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.811671  3628 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.812036  3433 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:45.816299  3368 raft_consensus.cc:3055] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:45.816659  3368 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:45.817394  3368 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:45.823113  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.818449  3368 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:45.793694  3647 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.793736  3539 raft_consensus.cc:3055] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:45.838335  3539 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:45.794889  3650 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.839016  3628 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.792886  3709 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:59:45.840062  3650 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.841044  3539 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.820622  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.841331  1545 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:45.847105  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:45.845115  3562 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:59:45.844225  3696 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:45.873586  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:59:45.875216  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 54680.5us
I20260709 12:59:45.876853  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.844396  3603 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:45.841728  3517 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:59:45.884754  3517 raft_consensus.cc:3055] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:45.885125  3517 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:45.885973  3517 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.886868  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:45.863955  3696 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:45.888389  3696 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.889516  3696 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.882232  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:45.870100  3364 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:45.858227  3592 consensus_queue.cc:1059] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:45.897619  3364 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:45.881392  3407 consensus_queue.cc:1059] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:59:45.882309  3628 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.875000  3433 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.896270  3603 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.905508  3517 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:45.898527  3364 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:45.908380  3407 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:45.916931  2275 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:45.916953  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.918623  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.919886  3433 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.922389  3453 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.914508  3407 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:45.924767  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.924496  3407 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:45.913462  3368 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.937837  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:45.925930  3407 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.947764  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 335) took 4432 ms. Trace:
I20260709 12:59:45.949751  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:45.937178  3453 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:45.955505  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.956524  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.948185  1440 rpcz_store.cc:276] 0709 12:59:41.515508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.515669 (+   161us) service_pool.cc:224] Handling call
0709 12:59:41.647155 (+131486us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0f090 00007f29ebdadf3a 00007f29f1b641cc 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc 00007f29f0122392 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:45.947680 (+4300525us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:45.068987 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:45.140733 (+ 71746us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:45.143490 (+  2757us) write_op.cc:435] Acquired schema lock
0709 12:59:45.149601 (+  6111us) tablet.cc:662] Decoding operations
0709 12:59:45.211560 (+ 61959us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:45.211604 (+    44us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:45.211634 (+    30us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:59:45.212190 (+   556us) tablet.cc:701] Row locks acquired
0709 12:59:45.212206 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:59:45.212357 (+   151us) write_op.cc:270] Start()
0709 12:59:45.212463 (+   106us) write_op.cc:276] Timestamp: P: 1783601985212297 usec, L: 0
0709 12:59:45.212485 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:45.213069 (+   584us) log.cc:844] Serialized 2909 byte log entry
0709 12:59:45.239580 (+ 26511us) op_driver.cc:464] REPLICATION: finished
0709 12:59:45.341381 (+101801us) write_op.cc:301] APPLY: starting
0709 12:59:45.341504 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:45.341777 (+   273us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:45.341952 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:45.370448 (+ 28496us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:45.370814 (+   366us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:59:45.370879 (+    65us) write_op.cc:312] APPLY: finished
0709 12:59:45.371188 (+   309us) log.cc:844] Serialized 59 byte log entry
0709 12:59:45.413893 (+ 42705us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:45.422354 (+  8461us) write_op.cc:454] Released schema lock
0709 12:59:45.431685 (+  9331us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:45.432045 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:45.432078 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":456802,"reported_tablets":12,"spinlock_wait_cycles":71801600,"child_traces":[["op",{"apply.queue_time_us":101499,"apply.run_cpu_time_us":7414,"apply.run_wall_time_us":90667,"num_ops":7,"prepare.queue_time_us":134736,"prepare.run_cpu_time_us":4095,"prepare.run_wall_time_us":147742,"replication_time_us":26957,"thread_start_us":76040,"threads_started":1}]]}
I20260709 12:59:45.959757  1545 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:45.961158  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.961259  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.961731  1443 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 4 to 5, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:45.965153  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.966982  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:45.965456  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.968413  1540 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:45.954097  3571 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.970804  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:45.971244  1688 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:59:45.972999  1688 pending_rounds.cc:85] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 5
I20260709 12:59:45.973251  1688 pending_rounds.cc:107] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:59:45.973461  1688 raft_consensus.cc:2889] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:45.974496  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:45.973802  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:45.964758  3706 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.985348  3695 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.000244  3712 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:46.011027  3368 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:46.001878  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:46.017982  3647 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:46.004732  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.006458  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:46.024873  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:46.033747  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:46.039712  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:46.041508  1693 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:46.024415  3539 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.046208  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:46.049450  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:46.059638  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:46.045502  3407 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:46.048462  3713 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.055464  3368 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:46.063409  3650 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:46.080899  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:46.068171  3433 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:46.085073  3433 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:46.085961  3433 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.087580  3602 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:46.087971  3602 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:46.088764  3602 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.089941  3602 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.064431  3628 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:59:46.093412  3451 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:46.067483  3364 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:46.139431  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:46.143322  3650 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:46.156811  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:46.158247  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:46.175122  1688 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:46.163051  3453 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:46.169960  3650 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:46.183629  3368 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:59:46.167788  3628 consensus_queue.cc:1059] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:59:46.312747  3453 raft_consensus.cc:3055] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:59:46.302407  3724 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:46.314719  3453 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:46.333534  2273 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:46.334797  1539 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.343158  1539 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:46.333993  3453 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.348361  3453 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:46.359656  3517 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:46.371857  3602 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:46.367463  3517 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.383100  3628 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.389150  3628 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.390374  3517 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.391607  3628 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.382520  3407 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:59:46.394448  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:46.395066  1614 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:46.396124  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:46.399505  3600 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:46.400148  3600 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.400998  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:46.401556  1693 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:46.401980  1511 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:46.402663  3600 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:46.403221  3600 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:46.403477  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:46.404299  2273 raft_consensus.cc:2393] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:46.405195  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:46.405941  1693 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:46.407102  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:46.407759  1614 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 12:59:46.406958  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:46.403600  3600 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:46.410766  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:46.412992  3628 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:46.413376  3628 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.413765  3628 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.418164  3706 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:46.418633  3706 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:46.419188  3706 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.428061  1545 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:46.429378  3602 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:46.410598  3600 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.475297  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:46.476068  1688 raft_consensus.cc:606] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:46.477872  3600 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.480146  3628 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.493752  3628 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.494907  1688 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:46.496904  3602 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:46.497551  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:46.498127  1693 raft_consensus.cc:606] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:46.498461  1693 raft_consensus.cc:614] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:46.493791  3600 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.501972  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:46.502544  1693 raft_consensus.cc:606] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:46.504019  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:46.504710  1688 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:46.504918  1614 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:46.507151  3602 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:46.507989  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:46.508433  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:46.508558  1693 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.508849  1685 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:46.510663  3433 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:59:46.517535  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:46.533562  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea97e615db7549b797908560563dd608"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:46.534150  1689 raft_consensus.cc:606] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:46.526345  1693 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:46.542376  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 12:59:46.545670  1693 raft_consensus.cc:606] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:46.543073  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:46.548947  3433 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:46.550812  3433 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:46.553650  3615 raft_consensus.cc:993] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:46.554103  3615 raft_consensus.cc:1081] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:46.554412  1614 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:46.551878  3433 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.555807  1536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea97e615db7549b797908560563dd608"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 12:59:46.556510  1536 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:46.556866  1536 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.567337  1442 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 3 to 4, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.569550  1442 catalog_manager.cc:5697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.556814  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 343) took 4742 ms. Trace:
I20260709 12:59:46.546118  1693 raft_consensus.cc:614] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:46.571127  3706 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.566502  1536 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.573030  1443 rpcz_store.cc:276] 0709 12:59:41.814116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.814260 (+   144us) service_pool.cc:224] Handling call
0709 12:59:44.120306 (+2306046us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0f090 00007f29ebdadf3a 00007f29f1b641cc 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc 00007f29f0122392 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:46.556755 (+2436449us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:46.186213 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:46.209729 (+ 23516us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:46.209766 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:59:46.209783 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:46.210100 (+   317us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:46.210157 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:46.210181 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:46.210356 (+   175us) tablet.cc:701] Row locks acquired
0709 12:59:46.210373 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:46.210501 (+   128us) write_op.cc:270] Start()
0709 12:59:46.210595 (+    94us) write_op.cc:276] Timestamp: P: 1783601986210464 usec, L: 0
0709 12:59:46.210613 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:59:46.211228 (+   615us) log.cc:844] Serialized 541 byte log entry
0709 12:59:46.380200 (+168972us) op_driver.cc:464] REPLICATION: finished
0709 12:59:46.537618 (+157418us) write_op.cc:301] APPLY: starting
0709 12:59:46.537693 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:46.537785 (+    92us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:46.537876 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:46.538083 (+   207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:46.541510 (+  3427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:46.541575 (+    65us) write_op.cc:312] APPLY: finished
0709 12:59:46.541748 (+   173us) log.cc:844] Serialized 23 byte log entry
0709 12:59:46.541912 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:46.541989 (+    77us) write_op.cc:454] Released schema lock
0709 12:59:46.543953 (+  1964us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:46.547161 (+  3208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:46.547188 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25653,"reported_tablets":9,"spinlock_wait_cycles":79850880,"child_traces":[["op",{"apply.queue_time_us":157160,"apply.run_cpu_time_us":1671,"apply.run_wall_time_us":9569,"num_ops":1,"prepare.queue_time_us":205110,"prepare.run_cpu_time_us":2383,"prepare.run_wall_time_us":30390,"replication_time_us":169431,"spinlock_wait_cycles":2432,"thread_start_us":266698,"threads_started":2}]]}
I20260709 12:59:46.660379  1536 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.664932  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:46.665570  1614 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.668479  1442 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 3 to 4, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.670646  1442 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 12:59:46.674199   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:46.676148   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:46.678660  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:46.679443  2273 raft_consensus.cc:2393] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:46.672290  3706 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:46.681664  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:46.682502  1693 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:46.683832  1693 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:46.696317  1614 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:46.693246  1693 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.711151  1693 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.724664  1693 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:46.726331  1509 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:46.727252  3706 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:46.727725  3706 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:46.728614  3706 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.753364  1536 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:46.755092  3699 raft_consensus.cc:993] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:46.755600  3699 raft_consensus.cc:1081] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:46.764180  3709 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:46.770202  3463 raft_consensus.cc:993] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:46.770900  3463 raft_consensus.cc:1081] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 12:59:46.772804  3643 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.773308  3643 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.775547  3643 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.776275  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 12:59:46.776906  1539 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:46.777279  1539 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.779014  1536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 12:59:46.779834  1536 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:46.780339  1536 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:46.790907  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:46.791661  1689 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:46.807926  1511 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:46.811738  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:46.810552  3643 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:46.813971  3643 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:46.814795  3643 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.820748  1539 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.823293  3741 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:46.823848  3741 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.824229  3741 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.831977  1539 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.832093  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:46.839031  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:46.839649  1616 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:46.840226  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:46.840843  1617 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.845057  1619 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 12:59:46.848511  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:46.849203  3706 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:46.849684  3706 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:46.850471  3706 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.851627  3741 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.856695  3741 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.857864  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:46.858704  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:46.860095  1686 raft_consensus.cc:3055] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:46.860394  1686 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:46.861080  1686 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.862198  1686 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.859376  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:46.864694  1689 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.865944  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 341) took 1115 ms. Trace:
I20260709 12:59:46.866907  1439 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.868279  1693 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.871420  3694 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:46.872160  3694 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.875962  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:46.876569  1616 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 12:59:46.877074  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:46.877727  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:46.877949  1540 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:46.878544  3463 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:46.879000  3463 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:46.879141  1619 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.879415  3463 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.871628  1689 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:46.884298  1686 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:46.888893  3463 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.893639  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:46.894351  1540 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:46.896289  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:46.897245  1509 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:46.900420  2273 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:46.908805  3643 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:46.900750  1617 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:46.868414  1439 catalog_manager.cc:5697] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 3, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.909336  3643 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:46.902045  3694 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:46.906488  3602 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.910538  3602 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.910216  3643 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.912684  3602 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.902724  1616 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:46.910254  3699 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:59:46.917536  1439 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 5 to 6, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.919405  1619 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:46.932353  3602 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.932946  3602 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.924676  3562 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:46.937973  3562 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:46.939844  1439 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 6 to 7, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } }
I20260709 12:59:46.939649  2273 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:46.941324  1439 catalog_manager.cc:5697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.944710  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:46.945452  1619 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:46.946483  2243 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:46.947305  3713 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:46.947638  3713 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.947934  3713 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.866320  1442 rpcz_store.cc:276] 0709 12:59:45.764077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.765495 (+  1418us) service_pool.cc:224] Handling call
0709 12:59:46.865886 (+1100391us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:46.706981 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:46.707675 (+   694us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:46.707735 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:59:46.707755 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:46.708435 (+   680us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:46.708505 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:46.708550 (+    45us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:46.709101 (+   551us) tablet.cc:701] Row locks acquired
0709 12:59:46.709121 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:46.709312 (+   191us) write_op.cc:270] Start()
0709 12:59:46.709440 (+   128us) write_op.cc:276] Timestamp: P: 1783601986709257 usec, L: 0
0709 12:59:46.709464 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:59:46.716538 (+  7074us) log.cc:844] Serialized 1817 byte log entry
0709 12:59:46.794494 (+ 77956us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b180022bfa0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29ef7dc41d 00007f29ef7de71a 00007f29ef7de6a8 00007f29ef7de628 00007f29ef7de5e3 00007f29ef7dd7fc 00007f29f1c10626 00007f29f1c0add8 00007f29ebdb1310
0709 12:59:46.794546 (+    52us) op_driver.cc:464] REPLICATION: finished
0709 12:59:46.822975 (+ 28429us) write_op.cc:301] APPLY: starting
0709 12:59:46.823048 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:46.823186 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:46.823206 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:46.823650 (+   444us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:46.823815 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:59:46.823854 (+    39us) write_op.cc:312] APPLY: finished
0709 12:59:46.824067 (+   213us) log.cc:844] Serialized 41 byte log entry
0709 12:59:46.824213 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:46.824313 (+   100us) write_op.cc:454] Released schema lock
0709 12:59:46.824353 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":208983,"reported_tablets":14,"spinlock_wait_cycles":11264,"child_traces":[["op",{"apply.queue_time_us":144,"apply.run_cpu_time_us":1652,"apply.run_wall_time_us":1653,"num_ops":4,"prepare.queue_time_us":1138,"prepare.run_cpu_time_us":3579,"prepare.run_wall_time_us":16334,"replication_time_us":23532,"spinlock_wait_cycles":136650112}]]}
I20260709 12:59:46.897895  3706 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:46.967053  3706 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:46.967918  3706 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.968739  3713 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.970759  3713 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.970891  3694 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.971395  3694 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:46.972579  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:46.929497  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:46.973783  1617 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:46.930145  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:46.974068  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:46.974599  1619 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.922976  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:46.978318  3694 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:46.978945  1689 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:46.980063  2241 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:46.980274  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:46.980806  1617 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:46.907119  1536 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.981755  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:46.982601  1536 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.982911  3539 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:46.983392  3539 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.983759  3539 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.985229  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:46.985739  1617 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:46.982690  3699 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.988590  3699 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:46.990499  3699 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:46.990937  1614 raft_consensus.cc:2955] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:46.945467  3602 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:46.974488  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:46.993121  2272 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:46.992923  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:46.991760  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:46.993743  1618 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:46.994285  1616 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 12:59:46.927376  3463 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:46.963428  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:46.999130  1617 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:47.008049  1511 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:47.008795  3556 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:47.009248  3556 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:47.009102  1440 catalog_manager.cc:5697] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.010051  3556 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:47.010706  1440 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.011265  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:47.014395  3539 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.016955  3699 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:47.017310  3699 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.017654  3699 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.017786  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:47.018357  1616 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.018823  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:47.019392  1686 raft_consensus.cc:3055] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:47.020069  1686 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:47.020152  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:47.021039  3615 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:47.021639  3615 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:47.022428  3615 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:47.024972  1686 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:47.026461  1686 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.041853  1619 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 12:59:47.031678  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b25acf355940411ba0ffd6483b7467c3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:47.036593  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:47.054526  1689 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.063107  2243 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:47.066551  3602 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:47.067073  3602 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:47.067845  3602 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.069252  3605 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:47.069731  3605 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.037577  3539 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:47.029222  3699 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:47.071720  3605 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:47.072324  3699 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:47.073083  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:47.073458  1689 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:47.076918  3699 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:47.077828  3700 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:47.078338  3700 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.078451  3699 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.079237  2241 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:47.080456  3700 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.080688  3699 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.081766  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:47.049048  1539 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.081991  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:47.082468  1545 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:47.082535  2274 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:47.083406  3605 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:47.083923  3605 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:47.084288  1439 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 4 to 5, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:47.085397  3605 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.085991  1439 catalog_manager.cc:5697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.090197  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:47.090970  1614 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.050829  1686 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:47.081707  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:47.084498  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 12:59:47.131171  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 46743.7us
I20260709 12:59:47.053752  1616 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:47.117714  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:47.133461  1619 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:47.134545  2243 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:47.134819  3615 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:47.120750  1686 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:47.135247  3615 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:47.118546  1539 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:47.122753  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:47.135707  3615 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.136232  1617 raft_consensus.cc:2368] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5.
I20260709 12:59:47.137974  3539 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:47.139717  3539 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:47.140125  3539 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.080482  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:46.982683  3694 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:47.143499  3694 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.143872  3694 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.144312  3709 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:47.146004  3709 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:47.147176  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet b25acf355940411ba0ffd6483b7467c3 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38012
I20260709 12:59:47.152412  1443 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 4 to 5, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.157667  3694 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.158699  1689 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:47.161024  1660 leader_election.cc:400] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5.
I20260709 12:59:47.161386  1660 leader_election.cc:403] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:47.161883  3699 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.125734  1614 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:47.166620  3694 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.167555  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:47.168385  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:47.177855  3700 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:47.178236  1614 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.178449  3463 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:47.178453  1689 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:47.179033  3463 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.181011  3463 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.181447  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:47.182229  3700 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:47.182449  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:47.182960  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:47.183503  2273 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.169797  3699 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5.
I20260709 12:59:47.171161  3615 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.190399  2273 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:47.191454  1659 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:47.191742  3615 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.192461  3615 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:47.192950  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:47.193032  3615 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:47.174935  3643 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.195019  3643 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.197669  3643 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.200323  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:47.201097  1617 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:47.176158  3754 tablet_replica.cc:333] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 12:59:47.160058  1443 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 6 to 7, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.187131  1614 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:47.183284  3706 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:47.183104  3700 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:47.183149  2272 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 2: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:47.271610  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:47.182075  1545 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:47.272853  3754 raft_consensus.cc:2243] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:47.273609  1443 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 3 to 4, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.204155  2274 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:47.275238  1443 catalog_manager.cc:5697] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 3 to 4, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.276629  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:47.276883  1443 catalog_manager.cc:5697] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.202260  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:47.281476  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:47.238372  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:47.285408  3754 raft_consensus.cc:2272] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:47.286204  3699 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:47.286734  3699 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:47.287573  3699 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.290614  1536 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:47.278460  1443 catalog_manager.cc:5697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:47.313150  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 108950us
I20260709 12:59:47.194169  3615 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.280556  3364 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.339380  3571 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.313465  3463 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:47.317111  3741 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:47.316861  3562 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:47.355733  3741 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.342881  3364 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.355962  3562 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:47.349953  3571 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.353542  3463 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.386642  3741 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.390865  3562 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.413614  3364 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:47.414958  3756 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:59:47.402232  3605 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:47.422998  3605 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.430727  3463 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.433709  3571 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.464115  2275 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:59:47.512586  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:47.513239  1688 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
W20260709 12:59:47.516681  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 213441us
I20260709 12:59:47.524185  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:47.524808  2275 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:47.526111  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:59:47.539434  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 181869us
I20260709 12:59:47.512145  3759 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.542091  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:47.505975  3760 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:59:47.512986  3763 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.584854  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:47.551632  3754 ts_tablet_manager.cc:1916] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:47.555927  3759 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.598426  3368 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:47.615787  3368 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.616199  3368 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.628693  1617 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:47.634187  1617 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:59:47.580296  3763 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.612565  3774 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.621809  3605 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:47.622107  3777 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.656654  2274 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
W20260709 12:59:47.658393  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 73608.6us
I20260709 12:59:47.661260  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:47.618534  3539 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.654578  3364 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:47.672029  3364 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.672395  3364 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:47.656996  3777 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.676360  3787 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:47.676836  3777 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.680181  3539 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:47.681357  3562 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.683594  3791 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:47.669718  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:47.685887  1536 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 12:59:47.688126  1614 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:47.688715  1619 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:47.690485  3777 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:47.697999  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:47.699860  1688 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:47.701417  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:47.701170  1443 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.702119  2272 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 2: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:47.698688  1689 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:47.704067  3763 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:47.705855  3539 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:47.709275  1617 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:47.655884  3699 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.710116  3699 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.710426  3760 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:47.712024  3699 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:47.721943  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 174407us
I20260709 12:59:47.688158  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:47.728916  1686 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:47.702621  1443 catalog_manager.cc:5697] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.720130  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:47.746923  1688 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:47.759199  1616 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:47.780273  1616 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:47.779623  2243 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:47.669931  3775 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.795326   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:47.790939  3789 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:47.800531  3789 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:47.785151  3700 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:47.801307  3700 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.801421  3789 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.802109  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:47.803184  3700 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.649178  3774 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.805531  3774 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.806093  1688 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:47.748467  3562 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:47.812382  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:47.813045  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:47.813073  2273 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:47.783031  3760 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.834987  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:47.843325  2274 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:47.670543  3741 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:47.857225  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 72848.1us
W20260709 12:59:47.867766  3786 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:59:47.783663  3602 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:59:47.843566  3769 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:47.904634  3713 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:47.812323  3775 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.905403  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:47.907598  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:47.833877  3782 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:47.916211  1659 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:47.922222  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:47.857633  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:47.922638  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:47.925094  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:47.932188  1536 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:47.930558  1545 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:47.930311  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:47.907660  3769 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.910836  3695 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.860857  3760 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.926525  3782 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:47.943252  3699 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:47.932544  3713 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:47.954972  3770 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.975688  3773 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.848500  3763 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:59:48.047063  1689 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:48.288782  1543 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
W20260709 12:59:48.038962  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 81425.9us
I20260709 12:59:48.345134  1536 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:48.002175  3779 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.045404  1539 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 12:59:48.313283  3368 consensus_meta.cc:287] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.697s	user 0.011s	sys 0.000s
I20260709 12:59:48.392657  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:48.393332  3802 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:59:48.393867  3775 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:48.393033  3801 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:59:48.392665  3368 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.338871  3799 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:59:48.073340  1613 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:48.406344  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:48.168983  3759 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:48.408867  1685 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:47.964242  3769 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.412391  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:47.952271  3789 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.102769  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 51800.3us
I20260709 12:59:48.416129  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:48.040086  3684 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:59:48.412426  3773 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:48.121013  3755 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:59:48.458922  1538 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
W20260709 12:59:48.460017  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 309615us
I20260709 12:59:48.415879  3782 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.461684  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:48.462255  2275 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:48.412139  3699 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 12:59:48.463990  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 413899us
I20260709 12:59:48.387670  3779 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.453321  3741 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.466382  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:48.466694  1509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.014s	sys 0.015s
I20260709 12:59:48.459201  3773 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.470003  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:48.471352  2273 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.472078  1510 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 12:59:48.470642  1509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.014s	sys 0.015s
I20260709 12:59:48.420360  3695 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.459141  3463 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:48.464690  3364 consensus_meta.cc:287] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.792s	user 0.010s	sys 0.000s
I20260709 12:59:48.471691  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:48.466974  3699 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.479099  2273 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:48.468343  1537 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:48.457270  3789 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.423691  3770 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.475817  3709 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:48.481588  1537 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:48.485085  3368 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.599466  1612 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:48.482587  3463 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.481170  3364 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.597824  3785 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.598143  3571 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.551157  3709 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.550865  3784 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.605125  3700 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.687032  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 214971us
I20260709 12:59:48.701388  1510 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:48.702325  1694 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.710335  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:48.595700  3780 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.711185  1616 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:48.712913  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:48.657295  3776 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.718909  1616 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:48.539045  3790 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.163s
I20260709 12:59:48.685580  3808 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.694202  3364 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:48.724085  3790 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:59:48.725088  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.002s	sys 0.009s
W20260709 12:59:48.730796  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.002s	sys 0.009s
I20260709 12:59:48.694684  3713 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:48.692307  3779 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:48.691174  3709 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.609797  3754 ts_tablet_manager.cc:1929] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:59:48.694737  3760 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.687307  3818 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.710296  3368 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.688647  3571 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.725941  3602 raft_consensus.cc:2764] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:59:48.720727  3811 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.724951  3763 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.710067  3700 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.740025  3818 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.734789  3808 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.688176  3785 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.692343  3784 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.744129  3754 log.cc:1199] T b25acf355940411ba0ffd6483b7467c3 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/b25acf355940411ba0ffd6483b7467c3
I20260709 12:59:48.742040  3779 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:48.743055  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:48.761530  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48988.2us
I20260709 12:59:48.767760  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:48.774762  2241 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:48.781203  3602 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:48.716638  3780 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.783591  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:48.745206  3368 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.765199  3818 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.727309  3776 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.772830  3781 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:48.775243  3695 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:48.758893  3817 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:48.736363  1537 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.761209  3763 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.788457  2268 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
W20260709 12:59:48.801290  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 88563.5us
I20260709 12:59:48.790980  3779 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:48.756350  3811 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.809737  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:48.814826  3825 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.815232  3825 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.807525  3602 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.807736  1537 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.807614  3768 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.821426  3824 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:48.853894  3824 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:48.805560  3817 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.854512  3824 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.854012  3785 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:48.824664  3754 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38012 (request call id 88) took 1678 ms. Trace:
I20260709 12:59:48.817673  3825 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.803912  3781 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.825476  3571 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.852300  3770 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.875238  3463 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:48.877035  3763 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:48.880394  3808 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.880298  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:48.881157  1611 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 1.
I20260709 12:59:48.882953  3700 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:48.884352  3780 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:48.885171  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:48.885419  3368 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:48.906816  3781 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:48.908807  3602 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:48.860574  3817 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.914122  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:48.915355  3776 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.898473  3790 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:48.897292  3780 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.860436  3754 rpcz_store.cc:276] 0709 12:59:47.146697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.146899 (+   202us) service_pool.cc:224] Handling call
0709 12:59:47.175743 (+ 28844us) ts_tablet_manager.cc:1151] Deleting tablet b25acf355940411ba0ffd6483b7467c3
0709 12:59:47.175845 (+   102us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:59:47.873113 (+697268us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:48.547374 (+674261us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:48.824592 (+277218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10731,"tablet-delete.queue_time_us":27116,"thread_start_us":26720,"threads_started":1}
I20260709 12:59:48.891947  3784 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:48.835805  3768 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.901625  3700 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.922786  3780 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:48.925745  3700 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.928769  3834 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.929296  3834 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.930068  3780 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:48.931327  3834 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.931658  3700 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:48.931833  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.931768  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:48.919688  3790 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.911028  3782 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.959779  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:48.955737  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:48.933864  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:48.963541  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:48.947314  3824 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:48.964437  3790 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.936501  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:48.949102  3694 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:48.936853  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:48.967444  3815 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:48.899179  3779 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.980531  1510 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:48.947693  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:48.989508  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:48.977115  3815 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:48.993139  3837 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:48.993633  3837 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.993992  3837 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:49.000152  3794 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.847s	user 0.013s	sys 0.020s
I20260709 12:59:49.009465  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:49.010134  1690 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.012221  1686 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:49.012471  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.013141  1693 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
W20260709 12:59:48.980197  3769 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.002s
I20260709 12:59:49.014310  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.016597  1693 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:49.018934  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.021387  1689 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:48.959503  3808 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:59:49.032516  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2097) took 1326 ms. Trace:
I20260709 12:59:49.033970  1614 rpcz_store.cc:276] 0709 12:59:47.689997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.690320 (+   323us) service_pool.cc:224] Handling call
0709 12:59:47.690730 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.691114 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.691150 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.691670 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.920517 (+228847us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:47.920564 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.920624 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.999501 (+1078877us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 12:59:49.003109 (+  3608us) raft_consensus.cc:1685] finished
0709 12:59:49.003132 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.016671 (+ 13539us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2726,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":37688192,"thread_start_us":228432,"threads_started":1,"wal-append.queue_time_us":264549}
I20260709 12:59:48.981019  3694 raft_consensus.cc:697] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:49.022656  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.052642  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:49.060356  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 248802us
I20260709 12:59:48.975996  3836 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 12:59:49.073312  1616 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:49.074684  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.056354  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:49.084436  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 95318.4us
I20260709 12:59:49.024181  3769 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.054136  3813 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:59:49.162932  1616 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:49.169570  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:49.162287  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:49.178681  1690 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 12:59:49.178994  1614 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:49.179277  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:49.179883  1543 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
W20260709 12:59:49.082908  3773 consensus_meta.cc:287] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
I20260709 12:59:49.162616  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:49.133270  3811 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:49.133601  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 74040.7us
I20260709 12:59:49.181054  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:49.184755  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2096) took 1495 ms. Trace:
I20260709 12:59:49.185000  3811 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.180922  3760 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:59:49.180985  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:49.065233  3834 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.185729  3811 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:49.175762  3539 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.189040  3539 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.185104  1619 rpcz_store.cc:276] 0709 12:59:47.689671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.752326 (+ 62655us) service_pool.cc:224] Handling call
0709 12:59:47.752631 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.836125 (+ 83494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.836165 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:48.948565 (+1112400us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b2c00010828. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 12:59:48.974623 (+ 26058us) log.cc:844] Serialized 26 byte log entry
0709 12:59:49.083835 (+109212us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:49.083891 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.083976 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:49.184508 (+100532us) raft_consensus.cc:1685] finished
0709 12:59:49.184522 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.184706 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41126,"raft.queue_time_us":104081,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":18456320,"thread_start_us":62948,"threads_started":1,"wal-append.queue_time_us":196066}
I20260709 12:59:49.144855  3782 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:49.191133  3539 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:49.191758  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:49.192523  2271 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:49.192323  3818 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.196128  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1574) took 1291 ms. Trace:
I20260709 12:59:49.196534  1538 rpcz_store.cc:276] 0709 12:59:47.905046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.905148 (+   102us) service_pool.cc:224] Handling call
0709 12:59:49.195963 (+1290815us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54002107d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:49.196060 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229832064}
I20260709 12:59:49.198302  1614 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:49.199045  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:49.200680  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1567) took 1344 ms. Trace:
I20260709 12:59:49.201112  1539 rpcz_store.cc:276] 0709 12:59:47.856158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.857386 (+  1228us) service_pool.cc:224] Handling call
0709 12:59:49.200513 (+1343127us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5400281754. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:49.200631 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50325888}
I20260709 12:59:49.207713  1510 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:49.165176  2269 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:49.211932  3782 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:49.232120  2275 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:49.169332  3780 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.206605  3709 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:49.233356  3539 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 12:59:49.231868  3841 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 12:59:49.235823  3699 consensus_meta.cc:287] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.750s	user 0.005s	sys 0.005s
I20260709 12:59:49.238425  3768 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:49.239749  3825 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.441751  3833 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.442236  3833 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:49.443318  3825 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:49.444237  3833 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:49.448113  3808 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.186230  3846 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:49.190085  3845 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:49.248374  1537 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:49.250471  3778 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.252121  3762 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.232342  3791 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:49.181125  3773 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.421908  3823 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:49.349099  3790 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.433725  3539 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.422852  3643 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.427517  3709 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:49.436672  3831 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:49.348901  3782 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.440464  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:49.441452  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:49.437661  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:49.504949  1616 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 12:59:49.454674  1540 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:49.207540  3787 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.231s
I20260709 12:59:49.465739  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 435) took 1523 ms. Trace:
I20260709 12:59:49.101370  3694 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.457829  1537 pending_rounds.cc:85] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 2
I20260709 12:59:49.448590  3808 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.453446  3846 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.453022  3784 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:49.453118  3825 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:49.431371  3780 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.512316  1545 rpcz_store.cc:276] 0709 12:59:47.942467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.942664 (+   197us) service_pool.cc:224] Handling call
0709 12:59:48.036595 (+ 93931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.465199 (+1428604us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b2c00109aa8. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea055291 00007f29ea0700ca 00007f29ebd9e4ad 00007f29ebda4e1b 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 12:59:49.465333 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:49.465368 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:49.465406 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:49.465442 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.465524 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.465675 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47330688}
I20260709 12:59:49.519104  1686 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:49.465301  3706 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.449050  3699 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.453410  3837 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.469668  3778 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:49.461048  3845 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:49.489666  3762 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:49.666817  1693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.033s	sys 0.062s
W20260709 12:59:49.675998  1693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.034s	sys 0.063s
W20260709 12:59:49.685125  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.003s	sys 0.002s
W20260709 12:59:49.685527  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.003s	sys 0.002s
I20260709 12:59:49.561517  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2054) took 1415 ms. Trace:
I20260709 12:59:49.598042  2272 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:49.687379  3825 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.688092  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:49.673527  1658 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:42041 timed out after 1.951s (SENT) [suppressed 5 similar messages]
W20260709 12:59:49.698916  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.536929  1537 pending_rounds.cc:107] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:49.513825  3791 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.685977  1688 rpcz_store.cc:276] 0709 12:59:48.146619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.150797 (+  4178us) service_pool.cc:224] Handling call
0709 12:59:48.757621 (+606824us) spinlock_profiling.cc:243] Waited 987 us on lock 0x7b5800003698. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:48.757803 (+   182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:48.856636 (+ 98833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.856691 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:48.860178 (+  3487us) log.cc:844] Serialized 26 byte log entry
0709 12:59:48.964209 (+104031us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:48.964242 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.964301 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:49.520455 (+556154us) raft_consensus.cc:1685] finished
0709 12:59:49.520481 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.561436 (+ 40955us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93087,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":2269568,"thread_start_us":149642,"threads_started":2,"wal-append.queue_time_us":95207}
I20260709 12:59:49.717972  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:49.697886  1539 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:49.715246  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:49.732468  1692 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 12:59:49.732522  1537 raft_consensus.cc:2889] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:49.722977  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:49.735834  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.736023  2269 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.736209  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1578) took 1321 ms. Trace:
I20260709 12:59:49.736653  1537 rpcz_store.cc:276] 0709 12:59:48.415012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.419348 (+  4336us) service_pool.cc:224] Handling call
0709 12:59:48.465551 (+ 46203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.735930 (+1270379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.736151 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:49.736954  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.737205  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.737825  1694 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:49.738608  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.738262  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:49.519435  3818 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:49.646569  3772 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.656952  3764 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:49.753456  3699 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:49.753413  3764 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.754235  3774 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:49.514855  3643 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.754693  3774 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:49.756600  3643 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:49.757005  3774 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:49.643500  3814 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:49.749902  3782 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:49.751789  3539 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:49.713025  3846 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.752117  3762 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:49.752645  3772 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.740007  1688 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:49.643034  3851 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:49.494531  3823 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:49.807335  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:49.758633  3769 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:49.597098  3562 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:59:49.739550  3809 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.807525  2270 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:49.695966  3706 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.765059  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:49.560905  3831 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.833678  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:49.834528  2271 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:49.835456  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:49.837179  1545 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 12:59:49.837817  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 670) took 1119 ms. Trace:
I20260709 12:59:49.838253  2270 rpcz_store.cc:276] 0709 12:59:48.717954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.720963 (+  3009us) service_pool.cc:224] Handling call
0709 12:59:49.803721 (+1082758us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:49.807143 (+  3422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.832381 (+ 25238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.837737 (+  5356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3895168}
I20260709 12:59:49.841296  3709 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:49.841984  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45390 (request call id 673) took 1376 ms. Trace:
I20260709 12:59:49.842303  2275 rpcz_store.cc:276] 0709 12:59:48.465999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.466145 (+   146us) service_pool.cc:224] Handling call
0709 12:59:49.841834 (+1375689us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b5400570154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:49.841936 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1725907840}
I20260709 12:59:49.844633  3790 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:49.741103  3791 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:49.845916  3809 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.878413  3837 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:49.880100  3773 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:49.898073  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:49.956059  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2059) took 1807 ms. Trace:
I20260709 12:59:49.956527  1691 rpcz_store.cc:276] 0709 12:59:48.148212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.150902 (+  2690us) service_pool.cc:224] Handling call
0709 12:59:48.757285 (+606383us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b5800003698. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:48.757455 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.822890 (+ 65435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.822938 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:48.822988 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:48.823027 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.955800 (+1132773us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b540010a9d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:49.955852 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.955989 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289755264}
I20260709 12:59:49.959283  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1669) took 1793 ms. Trace:
I20260709 12:59:49.959897  1620 rpcz_store.cc:276] 0709 12:59:48.165551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.165666 (+   115us) service_pool.cc:224] Handling call
0709 12:59:49.958426 (+1792760us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:49.958668 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.958903 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:49.958939 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:49.958990 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:49.959031 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.959098 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.959215 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7213824}
I20260709 12:59:49.961040  3771 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:49.961699  3771 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:49.992794  3851 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:49.994114  2277 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:59:49.787966  3814 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:48.933799  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet b25acf355940411ba0ffd6483b7467c3 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
W20260709 12:59:50.014825  1428 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 1.08084e+06us
I20260709 12:59:50.021104  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:49.715123  3784 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.026788  3771 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.027685  3772 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.028682  3784 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.028791  3778 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.029119  3825 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.029549  2274 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:50.030184  3851 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:50.030691  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 357118us
I20260709 12:59:50.035398  3823 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.036052  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.036875  1545 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:50.039117  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.041815  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2065) took 1023 ms. Trace:
I20260709 12:59:50.042176  1686 rpcz_store.cc:276] 0709 12:59:49.018147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.018689 (+   542us) service_pool.cc:224] Handling call
0709 12:59:50.041635 (+1022946us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54001a7f54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:50.041758 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148134272}
W20260709 12:59:50.043316  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1668) took 1878 ms (client timeout 1621 ms). Trace:
I20260709 12:59:50.043427  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:59:50.043678  1612 rpcz_store.cc:269] 0709 12:59:48.165231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.165379 (+   148us) service_pool.cc:224] Handling call
0709 12:59:50.043111 (+1877732us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400140fd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:50.043229 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373139712}
I20260709 12:59:50.044420  3763 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:50.044950  3813 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:50.045130  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.045432  3763 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.050096  3763 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.022948  3811 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.051276  3809 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.055931  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.056496  1539 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:50.059180  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 346) took 2144 ms. Trace:
I20260709 12:59:50.059528  1439 rpcz_store.cc:276] 0709 12:59:47.915136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.915336 (+   200us) service_pool.cc:224] Handling call
0709 12:59:50.059126 (+2143790us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":296604,"reported_tablets":1}
I20260709 12:59:50.061794  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38400 (request call id 231) took 2539 ms. Trace:
I20260709 12:59:50.062968  1443 rpcz_store.cc:276] 0709 12:59:47.555394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.577855 (+ 22461us) service_pool.cc:224] Handling call
0709 12:59:50.061726 (+2483871us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:47.810480 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:47.856181 (+ 45701us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:47.856215 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:59:47.856232 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:47.856614 (+   382us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:47.856669 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:47.856693 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:47.856989 (+   296us) tablet.cc:701] Row locks acquired
0709 12:59:47.857006 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:47.857151 (+   145us) write_op.cc:270] Start()
0709 12:59:47.857252 (+   101us) write_op.cc:276] Timestamp: P: 1783601987857103 usec, L: 0
0709 12:59:47.857272 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:59:47.857849 (+   577us) log.cc:844] Serialized 919 byte log entry
0709 12:59:48.760355 (+902506us) op_driver.cc:464] REPLICATION: finished
0709 12:59:48.769035 (+  8680us) write_op.cc:301] APPLY: starting
0709 12:59:48.769144 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:48.770412 (+  1268us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:48.770808 (+   396us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:48.771224 (+   416us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:48.771474 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:48.771536 (+    62us) write_op.cc:312] APPLY: finished
0709 12:59:48.771756 (+   220us) log.cc:844] Serialized 29 byte log entry
0709 12:59:48.784872 (+ 13116us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:48.789359 (+  4487us) write_op.cc:454] Released schema lock
0709 12:59:48.792052 (+  2693us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:48.809330 (+ 17278us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:48.811010 (+  1680us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42849,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":8438,"apply.run_cpu_time_us":2377,"apply.run_wall_time_us":36998,"num_ops":2,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":2587,"prepare.run_wall_time_us":73472,"replication_time_us":895629,"thread_start_us":8107,"threads_started":1}]]}
I20260709 12:59:50.024839  3815 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.024935  3706 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.025746  3831 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.092993  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.025856  2269 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:50.026177  3780 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.046466  3713 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:50.046712  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 12:59:50.114509  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 67869.5us
I20260709 12:59:50.046959  3813 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:50.047855  3789 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.124562  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.022433  3845 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.023895  3791 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.065784  3823 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:50.132139  3823 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.133441  2241 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:50.133911  3823 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.070247  3817 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.134476  3817 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.071588  3807 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:50.072423  3844 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.075603  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:50.079414  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.080574  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.156132  1540 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:50.081140  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.081338  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.081749  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:50.157286  1619 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.081862  3809 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.082548  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:50.082949  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 92927.9us
I20260709 12:59:50.083588  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.083618  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.085620  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:49.819171  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 368684us
I20260709 12:59:50.164503  1536 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
W20260709 12:59:50.091725  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.001s	sys 0.013s
I20260709 12:59:50.153373  3807 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.178270  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.178846  1620 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:50.122023  3831 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:50.108376  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 45977.5us
I20260709 12:59:50.108570  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:50.180603  1544 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.086395  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.181315  1658 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:50.184974  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.116145  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:50.129767  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.185685  2273 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:50.185897  2274 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:50.130815  3764 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.151877  3790 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:50.189924  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:50.187350  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.192977  1542 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:50.147660  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:59:50.167975  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.001s	sys 0.013s
I20260709 12:59:50.109057  3763 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.125550  3772 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:50.046962  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.201444  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:50.135365  3830 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:50.168875  2269 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:50.162344  3811 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:59:50.169446  3817 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.170203  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.154534  3706 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:59:50.173998  3846 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.190587  3790 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.174806  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:50.174988  3813 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.153820  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.122483  3867 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:50.176594  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.177484  3809 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.023358  3808 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.182616  1619 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 12:59:50.169452  3844 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.183542  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.184016  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.183781  3831 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.195894  1620 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:50.197352  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.199002  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:50.199888  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.200353  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:50.200452  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 52872us
I20260709 12:59:50.203174  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:50.186758  3784 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.204337  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.202942  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:50.206072  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:50.279778  1687 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:50.207306  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.280158  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:50.280881  1686 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.184391  3713 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.208534  3825 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:50.186646  3838 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:59:50.209379  3807 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:50.292748  3868 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.084s	user 0.002s	sys 0.000s
I20260709 12:59:50.289315  3713 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.209693  3778 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:50.213353  2273 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:50.188498  3647 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:50.214975  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:50.192845  3814 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.222246  2241 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.204357  3772 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.227349  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.204466  3863 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:50.298976  1545 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:50.227891  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.232875  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.233006  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.234025  1538 raft_consensus.cc:2368] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6.
I20260709 12:59:50.204140  3463 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:50.312376  2274 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:50.237959  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.312969  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2066) took 1260 ms. Trace:
I20260709 12:59:50.239084  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.239363  3847 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:50.239847  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.241729  3809 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.242225  1544 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:50.242960  3822 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:50.218873  3815 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:50.247957  3846 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.249495  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.249794  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.222474  3790 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.228166  2272 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.276942  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.275424  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:59:50.279673  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 73635.1us
I20260709 12:59:50.325520  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.207137  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:50.327059  1694 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:50.281497  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.204421  3763 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.297010  1510 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:50.327849  1620 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:50.306355  1617 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:50.213841  3830 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:50.329465  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 54097.5us
I20260709 12:59:50.293936  3771 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:50.274788  3764 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.237175  3706 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:59:50.314039  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 91898.9us
I20260709 12:59:50.340739  2241 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.304358  2268 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:50.313498  1693 rpcz_store.cc:276] 0709 12:59:49.053065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.054353 (+  1288us) service_pool.cc:224] Handling call
0709 12:59:49.055720 (+  1367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:49.676415 (+620695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:49.676443 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:49.694987 (+ 18544us) log.cc:844] Serialized 26 byte log entry
0709 12:59:50.187690 (+492703us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:50.187742 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.187846 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.292210 (+104364us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 12:59:50.294131 (+  1921us) raft_consensus.cc:1685] finished
0709 12:59:50.294149 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.312906 (+ 18757us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6907,"raft.queue_time_us":11350,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":13433088,"thread_start_us":1036174,"threads_started":2,"wal-append.queue_time_us":466244}
I20260709 12:59:50.323416  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.322135  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.249255  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.327766  3787 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:50.297667  3778 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:50.297819  3647 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.331103  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:50.313336  3772 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:50.370152  3787 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:50.370607  3787 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:50.307190  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.232785  3867 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:50.316715  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 77687us
I20260709 12:59:50.313488  3863 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.344779  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:50.355194  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:50.398103  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 53418.9us
I20260709 12:59:50.330268  1686 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 12:59:50.358418  2277 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:59:50.359053  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.359019  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.361881  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:50.291337  3825 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.367074  3647 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.367444  3778 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.367960  1537 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:50.288298  3784 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.338713  3706 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:50.345890  3764 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.375906  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.379295  2274 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:50.337222  1620 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:50.338573  3777 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:50.399358  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.411741  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.320115  3463 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.342290  3709 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:50.415297  3709 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:50.415359  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:50.415726  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.415894  3709 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.416261  3804 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:50.416675  3804 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:50.417019  3804 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.418517  3825 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.419404  3792 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.419811  3792 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.420236  3763 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.421038  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.421218  3830 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.421855  3643 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:50.406049  3866 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:59:50.428073  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.400249  3863 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.338315  3771 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.403275  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.428076  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.432850  1612 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:50.432420  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.435727  1611 raft_consensus.cc:2410] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:50.406867  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.360702  3846 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.435822  2241 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.411810  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.438163  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.399801  1688 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:50.412245  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.412853  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.359658  3364 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:50.402618  3838 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.427703  2275 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:50.458317  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.432791  1694 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 12:59:50.440358  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.441589  3695 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.443639  2272 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 12:59:50.445219  3709 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.463943  1543 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:50.465338  3709 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.448738  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.430341  3784 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.449069  3647 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.451542  3844 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:50.451722  3874 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.241s	user 0.004s	sys 0.002s
I20260709 12:59:50.467736  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.468102  3647 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.467954  3804 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.468693  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:50.469081  2273 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:50.469412  1616 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:50.470116  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.470377  3804 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.455485  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.455881  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.459018  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.433307  3771 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.462323  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.462666  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.479779  1690 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:50.480494  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.479794  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.481482  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:50.431425  3777 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:50.473011  3831 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.473372  3814 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:50.477018  1617 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:50.460644  1510 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:50.477807  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.454232  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.483114  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.486313  1510 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.486459  1611 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:50.486600  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.484167  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.485008  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:50.463186  1658 leader_election.cc:400] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6.
I20260709 12:59:50.488265  1658 leader_election.cc:403] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:59:50.489185  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.479457  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:50.489121  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.483451  3826 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.492014  1694 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.489097  3772 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.490710  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:50.490383  1618 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:50.500203  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.496210  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.502839  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.491065  3825 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:50.510617  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.505729  3825 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.511417  3825 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.508857  3827 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:59:50.514542  3463 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.516800  3772 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.517378  1616 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:50.491314  3836 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6.
I20260709 12:59:50.520725  3787 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.521718  1540 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:50.509920  3364 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:50.523130  3364 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.512984  3763 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.523538  3364 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.523748  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:50.525504  1585 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:50.526149  3784 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:50.526501  1585 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.509509  3838 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:50.527122  3838 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:50.527529  3838 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.485435  3706 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.529220  3706 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.493391  3847 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:50.530778  3847 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:50.531093  3790 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.530921  3777 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.531656  3847 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:50.534942  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.535043  1585 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.536070  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:50.536243  1585 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:50.530009  3771 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.491128  3846 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:50.539042  1689 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:50.539597  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:50.558800  3709 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:50.559782  3771 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.538246  3831 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:50.538120  3784 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:50.537026  3787 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.577414  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.578275  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.585592  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:50.579489  1660 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.579982  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:50.590749  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 181978us
I20260709 12:59:50.565799  3846 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:50.592278  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:50.593542  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.593593  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:50.569085  3709 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:50.592329  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:50.595350  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.571558  3831 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.603645  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.572391  3784 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:50.566553  3778 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.591998  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:50.598142  3836 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.619771  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:50.608215  3831 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:50.610663  3808 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:50.611382  3826 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.612373  3784 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.600692  3771 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:59:50.627954  3808 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:50.632054  3709 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:50.632225  3808 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.633229  3709 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.621611  3463 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:50.643749  3846 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.634959  3826 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:50.654487  3876 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:59:50.654804  3881 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:59:50.639981  3838 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.639191  3463 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:50.669898  3463 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.692341  3792 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:50.695271  3880 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.273s	user 0.003s	sys 0.000s
I20260709 12:59:50.692216  3814 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.751173  3790 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.755180  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.768860  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.771476  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:50.771564  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:50.774634  1659 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:50.777057  3771 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:50.777632  3771 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:50.784822  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:50.787895  3827 consensus_queue.cc:1059] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:50.790318  3791 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:50.790776  3845 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:50.790980  3791 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.791414  3845 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.793608  3791 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.795181  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:50.795967  2273 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:50.798501  3819 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:50.798974  3819 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:50.799916  3819 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.801358  3819 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.803654  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:50.805395  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.802822  3845 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.823923  1690 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.712087  3364 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.836370  3364 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.837646  3863 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.838742  1613 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:50.852422  3825 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.854046  3764 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.855667  3825 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.857860  3463 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.858366  1585 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:50.859539  3845 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:50.859925  3845 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:50.860229  3713 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.860282  3845 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:50.867242  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 275732us
I20260709 12:59:50.710997  3814 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:50.862111  3808 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.883697  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:50.886520  2275 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:50.891356  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.892027  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:50.894357  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.895100  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.839164  3826 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:50.900810  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 307279us
I20260709 12:59:50.902850  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:50.903513  1660 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.906150  1693 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:50.907332  1545 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:50.907702  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.913916  1443 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 7 to 8, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 12:59:50.916146  1443 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:50.910830  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.919157  3824 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:50.919515  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:50.919603  3824 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:50.920153  3824 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.920195  3791 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:50.921610  3791 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:50.922647  3556 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:50.922976  3556 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:50.923655  3556 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.924899  3867 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.926357  3867 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:50.926857  3867 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:50.928799  3867 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:50.941973  1491 auto_rebalancer.cc:629] Failed to schedule move for tablet 8f9fcd10c7c244bf918f2218237f5b3a: Illegal state: Replica 0cccd9c43f9747529680a8e7463961c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 12:59:50.942634  3863 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:50.942572  3694 consensus_queue.cc:1059] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:50.944742  2269 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.945699  3808 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:50.946292  3808 raft_consensus.cc:3055] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:50.946610  3808 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:50.947431  3808 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.949554  3778 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:50.952447  2269 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.954032  3867 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:50.955065  3764 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:50.955382  3764 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:50.956463  1541 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:50.956148  3764 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.957451  3894 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:50.958160  3764 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:50.966203  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 62754.5us
I20260709 12:59:50.808563  3771 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.958684  3894 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:50.981855  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.939919  3643 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.985556  1660 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.901499  3831 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:50.991722  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.995222  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.982197  3780 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.987011  3887 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.962257  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.003616  1660 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:51.011608  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 49427.6us
I20260709 12:59:50.984537  3894 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:51.012212  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.015497  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:51.015944  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:51.016067  1612 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
W20260709 12:59:51.016842  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.017736  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:50.999809  3842 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.020042  3804 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.020682  3804 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:51.021481  3792 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:51.021888  3792 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:51.022238  3792 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.023433  3784 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.025635  3845 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.005573  3778 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.026906  3838 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:51.027061  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:50.989833  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:51.028323  3826 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.029493  3780 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.989395  3836 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.030740  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.031800  1616 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:51.033910  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:51.021394  2243 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.045994  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:51.047046  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.047797  2243 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.060832  2243 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.061550  1660 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.074261  3824 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.076870  3824 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:51.078611  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:51.059957  3816 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.048506  3826 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:51.049157  3713 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:51.051707  3815 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:51.091595  3815 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:51.091923  3845 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:51.093397  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:51.093973  2272 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:51.095367  3784 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:51.097503  3814 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.097966  3808 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.098503  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:51.050025  3364 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:51.091995  3815 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.093107  3894 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.084417  1660 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.100485  3894 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.071681  3813 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.109699  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:51.111241  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:51.119112   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:51.123322  1612 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:51.126597  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 188045us
I20260709 12:59:51.105846  3842 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.125581  2243 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.109275  3772 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:51.107234  3826 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:51.132690  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:51.134212  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:51.134793  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.137087  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:59:51.137382  3895 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 12:59:51.138602  3897 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:59:51.134284  3813 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.145471  3813 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.133687  3556 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.150024  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.150646  1612 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:51.160028  1616 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:51.160264  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:51.129616  3811 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.165212  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:51.166981  1543 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:51.136229  3772 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.176270  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:51.179109  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:51.181206  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:51.177870  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.187945  2272 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 12:59:51.188313  3815 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:51.189519  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:51.189846  1585 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:51.191497  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:51.194828  1693 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:51.197352  2275 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:51.198967  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:51.174592  3772 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.206713  2275 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:51.202390  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:51.202800  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 182824us
I20260709 12:59:51.211230  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 12:59:51.211534  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 127170us
I20260709 12:59:51.212473  1660 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.211795  1612 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:51.216367  1694 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:51.216971  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:51.218091  2275 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:51.219632  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.196653  3709 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:51.199589  3814 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:51.219606  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:51.229678  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.209668  3463 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:51.209493  3831 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:51.301575  3898 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:59:51.305809  1620 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:51.306752  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.308087  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.308985  1617 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:51.215619  3815 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:51.311785  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:51.215812  3811 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.314431  2275 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:51.315629  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.317622  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.310318  3836 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:59:51.318598  2273 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:51.322371  2275 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:59:51.230156  3901 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:59:51.222635  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:51.326373  2269 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 4: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:51.331238  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:59:51.331734  3819 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.003s
I20260709 12:59:51.231276  3647 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.337195  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.338979  3815 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:51.339322  3815 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:51.340047  3815 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:51.341005  3815 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:51.345448  3792 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.346518  1541 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
W20260709 12:59:51.352031  3884 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:59:51.302143  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:51.313230  3709 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:51.359586  3709 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.314940  3842 consensus_queue.cc:1059] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:59:51.233265  3826 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.363515  3842 raft_consensus.cc:3055] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:51.363904  3792 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:51.364535  3836 raft_consensus.cc:3055] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:51.365012  3836 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 12:59:51.366008  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 50459us
I20260709 12:59:51.366977  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.368165  1618 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 12:59:51.369207  1509 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.386592  1510 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.392601  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:51.392664  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.395167  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.402081  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:51.402920  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 90879.4us
I20260709 12:59:51.363957  3842 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:51.404645  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.383315  3867 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.373497  3822 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.412431  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.413538  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.398085  3556 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.398940  3845 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.419138  3647 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.399595  3831 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.419514  3899 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.417227  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:51.420327  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:51.420792  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.421494  3883 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.421851  3883 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:51.422209  3883 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.422820  3831 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:51.423489  1694 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:51.426333  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:51.428570  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.431022  3845 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.432156  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.429199  3899 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:51.435011  3899 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:51.435395  3899 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:51.436444  3883 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:51.436170  3899 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:51.437960  3899 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.408424  3778 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.438824  3830 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.429982  3831 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:51.440747  3883 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:51.441180  3831 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:51.441570  3831 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:51.407612  3643 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:59:51.404708  3836 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.434090  3906 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:51.449565  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 223908us
I20260709 12:59:51.435178  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.450613  2243 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:51.433670  3823 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.432547  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:51.383610  3772 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.463848  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:51.464875  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:51.460197  1693 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:51.399618  3791 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:59:51.465507  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:51.408613  3784 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.467897  1540 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:51.468842  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:51.472167  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:51.473011  1693 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:51.469915  1511 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:51.470363  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.471407  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:51.481037  1694 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:51.484376  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:51.484515  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:51.484935  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:51.485746  1688 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:51.486260  1689 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:59:51.486613  1689 pending_rounds.cc:85] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 6
I20260709 12:59:51.486135  3842 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.486835  1689 pending_rounds.cc:107] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:59:51.487151  1689 raft_consensus.cc:2889] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.487483  3842 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:51.462246  3867 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:51.399860  3777 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:59:51.492349  1539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:51.492908  1539 raft_consensus.cc:606] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.494848  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:51.497008  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:51.407785  3825 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:59:51.499081  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.500591  3647 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:51.510640  1690 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:51.473482  3814 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:51.519443  3706 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.521093  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.522241  3845 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.523173  3822 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.524187  3647 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:51.524384  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.523571  2241 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.525457  3647 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:51.526163  3713 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.526840  2268 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:51.529428  3713 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:51.529652  3784 consensus_queue.cc:1059] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:51.530972  3784 raft_consensus.cc:3055] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:51.531363  3784 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:51.532193  3784 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.532613  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.533473  3784 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:51.533511  3694 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.533999  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.535002  3694 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.535516  1660 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.540086  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.499655  3836 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.550097  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.498875  3556 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.471776  3863 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:59:51.442377  3831 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:51.591264  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.595849  1617 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:51.548040  3643 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:51.570861  1544 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:51.552410  3894 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.570729  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:51.566780  3845 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.541448  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 12:59:51.610638  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.592500  3816 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.591449  3814 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:51.607601  1543 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:51.551352  3791 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 12:59:51.615628  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 74228.2us
W20260709 12:59:51.480059  3827 consensus_queue.cc:1175] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0cccd9c43f9747529680a8e7463961c9" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 12:59:51.567128  3847 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:59:51.587926  3777 consensus_queue.cc:1059] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:59:51.618304  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.624719  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:51.601577  3643 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:51.567379  3826 consensus_queue.cc:1059] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:59:51.608282  3846 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:51.603679  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 53665.9us
I20260709 12:59:51.627957  1543 raft_consensus.cc:606] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.612764  3831 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.628526  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:51.616636  3830 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.637281  1511 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:51.639613  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.631429  3709 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.660085  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:51.688788  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 55141.7us
I20260709 12:59:51.660451  3822 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:51.650220  3847 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:51.645442  3894 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.645726  3807 raft_consensus.cc:3055] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.718742  1614 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:51.706712  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:51.661366  3830 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:59:51.712800  3556 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.724251  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.686539  3846 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:51.726361  1618 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:51.727190  3917 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:59:51.717420  3807 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:51.713748  3847 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:51.724236  3772 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:51.735580  1618 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:51.738287  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:51.706496  3643 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.733276  3847 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:51.766276  3923 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:59:51.735333  3816 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:59:51.785907  3816 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.786237  3816 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:51.787002  3816 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.787705  3824 consensus_queue.cc:1059] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:51.787868  3556 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:51.788233  3816 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.788650  3824 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:51.789026  3824 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:51.789748  3824 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:51.720520  3814 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:51.779110  3916 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:59:51.770089  3807 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.769084  3772 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:51.819242  1692 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
W20260709 12:59:51.829295  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 140781us
I20260709 12:59:51.837564  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.823837  3643 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:51.841528  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.823897  3846 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:51.860229  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.870718  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.840735  3777 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:51.880903  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 96630.2us
I20260709 12:59:51.840864  3772 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:51.848924  3846 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:51.923015  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 83090.3us
I20260709 12:59:51.923736  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:51.928378  3706 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.935438  1617 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:51.936268  1616 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:59:51.935196  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 51525.4us
I20260709 12:59:51.917865  3777 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:59:51.943095  1537 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:51.938611  3847 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:51.946218  3847 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:51.935432  3706 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:59:51.947153  3929 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:51.948272  1539 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:51.949751  1440 catalog_manager.cc:5697] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:51.938961  3772 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:51.955453  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:51.958709  3933 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:51.959079  3933 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:51.959852  3933 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:51.961058  3933 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.964037  2273 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:59:51.966212  3784 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:51.958413  3807 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.973769  3846 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:51.979254  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:51.979866  2272 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 12:59:51.985247  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:51.994405  3824 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:51.999336  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 61603.2us
I20260709 12:59:52.002630  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:52.003700  1687 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:52.005404  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:52.009274  3784 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:52.009546  3940 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:59:52.013617  3922 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.288s	user 0.003s	sys 0.000s
I20260709 12:59:52.015511  3928 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:52.015877  3928 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:52.016675  3928 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.017620  3928 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.004632  3936 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:52.017978  3845 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:52.051469  3764 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:52.031414  3825 raft_consensus.cc:3055] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:52.051883  3764 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:52.052728  3764 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.053856  3764 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.056113  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b4609f4058b459f804e03408773bd69"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:59:52.056679  1543 raft_consensus.cc:606] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:52.058215   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:52.051961  3825 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:52.078521  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 339) took 1664 ms. Trace:
I20260709 12:59:52.080185  1543 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:59:52.081694  1542 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:52.079288  1443 rpcz_store.cc:276] 0709 12:59:50.413684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.413809 (+   125us) service_pool.cc:224] Handling call
0709 12:59:52.078462 (+1664653us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:51.354198 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:51.441924 (+ 87726us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:51.441956 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:59:51.441973 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:51.442352 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:51.442425 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:51.442452 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:51.491056 (+ 48604us) tablet.cc:701] Row locks acquired
0709 12:59:51.491075 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:51.491204 (+   129us) write_op.cc:270] Start()
0709 12:59:51.491306 (+   102us) write_op.cc:276] Timestamp: P: 1783601991491161 usec, L: 0
0709 12:59:51.491326 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:59:51.501390 (+ 10064us) log.cc:844] Serialized 924 byte log entry
0709 12:59:51.827505 (+326115us) op_driver.cc:464] REPLICATION: finished
0709 12:59:51.925104 (+ 97599us) write_op.cc:301] APPLY: starting
0709 12:59:51.925187 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:51.925299 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:51.926759 (+  1460us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:51.927085 (+   326us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:51.927311 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:51.927362 (+    51us) write_op.cc:312] APPLY: finished
0709 12:59:51.927566 (+   204us) log.cc:844] Serialized 29 byte log entry
0709 12:59:51.927726 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:51.927805 (+    79us) write_op.cc:454] Released schema lock
0709 12:59:51.927842 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:51.928189 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:51.928215 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4034,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":97353,"apply.run_cpu_time_us":1956,"apply.run_wall_time_us":3070,"num_ops":2,"prepare.queue_time_us":310664,"prepare.run_cpu_time_us":61598,"prepare.run_wall_time_us":314291,"raft.queue_time_us":42195,"raft.run_cpu_time_us":34765,"raft.run_wall_time_us":71901,"replication_time_us":336002,"thread_start_us":464618,"threads_started":4,"wal-append.queue_time_us":132302}]]}
W20260709 12:59:52.086194  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 79853.6us
I20260709 12:59:52.021781  3941 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:59:52.088747  1510 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:52.092245  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.094372  1615 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:52.096261  3811 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:52.101403  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:52.086690  3807 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:59:52.108342  3822 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:52.110546  3811 consensus_queue.cc:1059] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:59:52.122562  3907 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:52.122941  3907 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:52.123641  3907 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.124405  1619 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:52.127712  3713 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:59:52.139365  1543 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:52.148154  3643 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:52.148983  3643 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:52.149812  3643 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.151870  3816 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:52.127846  3907 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:52.153662  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.158324  3643 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.160115  2272 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:52.170439  3945 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.182585  3825 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.182225  3945 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.189668  3945 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:52.190174  3945 raft_consensus.cc:993] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:52.170447  3831 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:59:52.193359  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:52.190577  3945 raft_consensus.cc:1081] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Signalling peer e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 12:59:52.195750  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:52.197383  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:52.198652  1686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:52958
I20260709 12:59:52.199357  3945 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:52.199589  1686 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:52.199988  1686 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.170709  3709 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:59:52.203229  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 347) took 1264 ms. Trace:
I20260709 12:59:52.205885   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:52.206066  1686 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.207387  1439 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.209852  1686 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:52.210634  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:52.203624  1440 rpcz_store.cc:276] 0709 12:59:50.939095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.940170 (+  1075us) service_pool.cc:224] Handling call
0709 12:59:52.203170 (+1263000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:51.960303 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:51.961002 (+   699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:51.961054 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:59:51.961079 (+    25us) tablet.cc:662] Decoding operations
0709 12:59:51.961496 (+   417us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:51.961568 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:51.961609 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:51.961816 (+   207us) tablet.cc:701] Row locks acquired
0709 12:59:51.961840 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:59:51.962004 (+   164us) write_op.cc:270] Start()
0709 12:59:51.962134 (+   130us) write_op.cc:276] Timestamp: P: 1783601991961952 usec, L: 0
0709 12:59:51.962169 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:59:52.005929 (+ 43760us) log.cc:844] Serialized 536 byte log entry
0709 12:59:52.015860 (+  9931us) op_driver.cc:464] REPLICATION: finished
0709 12:59:52.021148 (+  5288us) write_op.cc:301] APPLY: starting
0709 12:59:52.025851 (+  4703us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:52.031491 (+  5640us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:52.038865 (+  7374us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:52.046119 (+  7254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:52.046333 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:52.046398 (+    65us) write_op.cc:312] APPLY: finished
0709 12:59:52.046629 (+   231us) log.cc:844] Serialized 23 byte log entry
0709 12:59:52.046850 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.046949 (+    99us) write_op.cc:454] Released schema lock
0709 12:59:52.047005 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:52.047417 (+   412us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.047446 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34750,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":2068,"apply.run_cpu_time_us":2126,"apply.run_wall_time_us":27345,"num_ops":1,"prepare.queue_time_us":5978,"prepare.run_cpu_time_us":3067,"prepare.run_wall_time_us":48613,"replication_time_us":53569}]]}
I20260709 12:59:52.211194  1544 raft_consensus.cc:3055] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:52.211544  1544 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:52.212296  1544 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.213339  1544 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.215672  3867 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:52.216101  3867 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:52.217407  3867 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.206035  3825 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.225169  1544 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:52.226404  1658 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:52.237371  1584 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:52.233991  3824 consensus_queue.cc:1175] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 12:59:52.244694  3827 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:52.246496  3867 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.246861  3831 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:52.287567  3933 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:52.300294  1491 auto_rebalancer.cc:629] Failed to schedule move for tablet 7a24aaf5c9514244ae333d411f1fb4f5: Illegal state: Replica e12d7b3551014757ba7dda3e83605b83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 12:59:52.300650  3831 raft_consensus.cc:697] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:52.297669  3827 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:52.243122  3709 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:59:52.320946  3831 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.311116  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:52.324046  2268 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.324220  1619 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:52.325716  3772 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:52.347100  3827 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.359494  1689 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 12:59:52.368021  3955 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:59:52.368515  3933 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:52.378806  3933 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.390266  2268 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:52.436966  3933 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.440546  1542 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:52.476614  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38400 (request call id 232) took 1560 ms. Trace:
W20260709 12:59:52.486096  1659 consensus_peers.cc:597] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d53120c1adf947fd992e5950edf26301. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:52.491339  1612 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:52.460244  3867 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:59:52.509166  3764 raft_consensus.cc:3055] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:52.509644  3764 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:52.510496  3764 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.511752  3764 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.513899  1537 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:52.520661  3827 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:52.524168  3819 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:52.526906  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:52.531014  3824 raft_consensus.cc:993] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:52.531494  3824 raft_consensus.cc:1081] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 12:59:52.536242  1615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b4609f4058b459f804e03408773bd69"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53910
I20260709 12:59:52.537108  1615 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:52.540908  1615 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.551098  1613 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 12:59:52.552361  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:52.478753  1439 rpcz_store.cc:276] 0709 12:59:50.916688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.916815 (+   127us) service_pool.cc:224] Handling call
0709 12:59:52.476525 (+1559710us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:52.243486 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:52.257904 (+ 14418us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:52.257940 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:59:52.257960 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:52.289488 (+ 31528us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:52.291161 (+  1673us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:52.293615 (+  2454us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:52.334840 (+ 41225us) tablet.cc:701] Row locks acquired
0709 12:59:52.339905 (+  5065us) write_op.cc:260] PREPARE: finished
0709 12:59:52.357262 (+ 17357us) write_op.cc:270] Start()
0709 12:59:52.366962 (+  9700us) write_op.cc:276] Timestamp: P: 1783601992354539 usec, L: 0
0709 12:59:52.366992 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:59:52.367639 (+   647us) log.cc:844] Serialized 536 byte log entry
0709 12:59:52.389871 (+ 22232us) op_driver.cc:464] REPLICATION: finished
0709 12:59:52.390293 (+   422us) write_op.cc:301] APPLY: starting
0709 12:59:52.390369 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:52.390459 (+    90us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:52.390551 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:52.438742 (+ 48191us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b5c000f6c0c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1f97331 00007f29f1f97221 00007f29f1f91f6c 00007f29ef6f230b 00007f29ef6f1fd3 00007f29ef7f0e34 00007f29ef7dc97c 00007f29ef7e0d61 00007f29ef7e0d19 00007f29ef7e0ca9 00007f29ef7e0c71
0709 12:59:52.438969 (+   227us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:52.439118 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:52.439167 (+    49us) write_op.cc:312] APPLY: finished
0709 12:59:52.439328 (+   161us) log.cc:844] Serialized 23 byte log entry
0709 12:59:52.439492 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.439577 (+    85us) write_op.cc:454] Released schema lock
0709 12:59:52.439614 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:52.439896 (+   282us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.439934 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":145454,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":244,"apply.run_cpu_time_us":4451,"apply.run_wall_time_us":49582,"num_ops":1,"prepare.queue_time_us":419,"prepare.run_cpu_time_us":7547,"prepare.run_wall_time_us":165581,"replication_time_us":22768,"spinlock_wait_cycles":87761664}]]}
I20260709 12:59:52.559911  1442 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 5, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.561650  1442 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.555112  3643 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:52.562600  1442 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 5, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.565061  1442 catalog_manager.cc:5697] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.565775  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:52.566917  3643 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:52.569121  1615 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.578231  3643 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.597764  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:52.598318  2273 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.565514  3933 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:52.583598  1685 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.603022  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:52.604099  1539 raft_consensus.cc:3055] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:52.611027  1539 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:52.612334  1537 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:59:52.621351  1537 pending_rounds.cc:85] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 4
I20260709 12:59:52.621660  1537 pending_rounds.cc:107] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:59:52.622005  1537 raft_consensus.cc:2889] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:52.623756  3930 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:52.625348  1615 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:52.624164  3463 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.623911  1539 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.626328  3463 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.626992  1539 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.627099  3827 raft_consensus.cc:2955] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:52.629526  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:52.630160  1537 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 12:59:52.632153  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:52.632934  3811 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:52.633316  3811 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.633347  1539 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:52.633769  3811 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.635447  1685 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:52.635656  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:52.639514  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:52.640946  3764 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:52.641593  3764 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:52.641736  3930 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:52.642371  3764 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.644063  3933 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:52.644598  3933 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.646934  3933 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:52.647907  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:52.648552  1689 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:52.650545  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:52.652997  3825 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:52.653589  3825 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:52.653909  3825 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.631006  3463 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:52.644456  1615 raft_consensus.cc:2955] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:52.660215  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:52.661860  1612 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:52.662117  2272 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:52.663339  3763 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:52.666795  1685 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:52.671182  3825 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.672850  3811 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.700089  3825 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:52.700228  3811 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:52.702586  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:52.704788  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:52.706972  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:52.708199  2269 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:52.692991  1440 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 7 to 8, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 12:59:52.690970  3967 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:59:52.711797  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 342) took 1284 ms. Trace:
I20260709 12:59:52.680524  2273 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:52.711876  1440 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 4 to 6, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.714008  1440 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 5 to 6, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.716048  1440 catalog_manager.cc:5697] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 6 to 7, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 12:59:52.717561  1440 catalog_manager.cc:5697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 1 to 2, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:52.712226  1442 rpcz_store.cc:276] 0709 12:59:51.427007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.427943 (+   936us) service_pool.cc:224] Handling call
0709 12:59:52.634327 (+1206384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.634359 (+    32us) write_op.cc:454] Released schema lock
0709 12:59:52.711744 (+ 77385us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:52.626162 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:52.626690 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:52.626719 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:59:52.626732 (+    13us) tablet.cc:662] Decoding operations
0709 12:59:52.627296 (+   564us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:52.627348 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:52.627375 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:52.627751 (+   376us) tablet.cc:701] Row locks acquired
0709 12:59:52.627771 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:52.627904 (+   133us) write_op.cc:270] Start()
0709 12:59:52.627999 (+    95us) write_op.cc:276] Timestamp: P: 1783601992627861 usec, L: 0
0709 12:59:52.628015 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:59:52.628596 (+   581us) log.cc:844] Serialized 1691 byte log entry
0709 12:59:52.630504 (+  1908us) op_driver.cc:464] REPLICATION: finished
0709 12:59:52.630892 (+   388us) write_op.cc:301] APPLY: starting
0709 12:59:52.630964 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:52.631103 (+   139us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:52.631201 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:52.631620 (+   419us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:52.631783 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:59:52.631826 (+    43us) write_op.cc:312] APPLY: finished
0709 12:59:52.632016 (+   190us) log.cc:844] Serialized 41 byte log entry
0709 12:59:52.632175 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.632262 (+    87us) write_op.cc:454] Released schema lock
0709 12:59:52.632299 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":2023,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":224,"apply.run_cpu_time_us":2040,"apply.run_wall_time_us":2039,"num_ops":4,"prepare.queue_time_us":2747,"prepare.run_cpu_time_us":2681,"prepare.run_wall_time_us":2682,"replication_time_us":2376}]]}
I20260709 12:59:52.722455  1692 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:52.723556  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:52.724669  3825 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:52.715492  1537 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.733320  1539 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:52.734880  3836 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:52.735641  1613 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:52.736042  1539 raft_consensus.cc:2955] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:52.738199  3694 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:59:52.745925  1659 consensus_peers.cc:597] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbe29c0d913c42cfb39d487a69abfd46. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:52.747143  3825 raft_consensus.cc:697] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:52.748908  3825 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.738633  1537 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 12:59:52.752082  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:52.755705  3463 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:52.756134  3463 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:52.756973  3463 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.764427  1443 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 5 to 6, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.766642  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:52.770471  1443 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 12:59:52.776360  3819 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:52.772579  1443 catalog_manager.cc:5697] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 3 to 4, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.784163  1542 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:52.788594  1613 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:52.813809  3463 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.814054  3784 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:52.814368  3463 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.814561  3784 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.820779  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:52.821637  1537 raft_consensus.cc:2368] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 12:59:52.822520  3764 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.823060  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:52.823185  3764 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.827221  3831 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.827698  3831 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.832507  1439 catalog_manager.cc:5697] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.857002  3463 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:52.866650  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:52.857151  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:52.869637  1613 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:52.869588  1539 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:52.872426  3831 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:52.872898  3784 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:52.874430  3764 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:52.883360  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:52.859810  1685 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:52.892527  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:52.893052  1692 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:52.889932  1660 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:52.894152  1584 leader_election.cc:400] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 12:59:52.898546  1584 leader_election.cc:403] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:52.894344  3463 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.899215  3463 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.899554  3463 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.895206  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:52.901949  2273 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:52.902247  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:52.893503  3764 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:52.913321  3463 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.916255  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:52.916924  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:52.907115  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:52.917452  1613 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.917575  2269 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:52.918779  1585 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:52.919878  3463 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:52.920665  3463 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:52.921413  3867 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.921120  3463 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:52.921813  3867 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.923168  3867 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.904551  3784 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.928696  2273 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:52.931602  3463 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:52.907164  3831 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.932494  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:52.933383  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:52.937861  1545 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:52.941037  1612 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:52.938889  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:52.937007  1613 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 12:59:52.944224  3978 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:52.948292  1545 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:52.961372  2273 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:52.940821  3831 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.958479  3907 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:52.984445  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 50512.4us
I20260709 12:59:52.976032  3556 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:52.986240  1660 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:52.977087  3831 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.989815  3979 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.990283  3979 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:52.992168  3979 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:52.992514  3827 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:52.971146  3819 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:52.998445  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:52.999039  1539 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:52.983731  3907 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:53.000041  3463 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:53.002799  3827 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:52.987640  3556 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:53.003649  3827 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:53.005240  3556 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:53.008589  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:53.009455  2273 raft_consensus.cc:2393] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:53.015405  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:53.016181  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:53.009577  3907 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.011130  3784 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 12:59:53.028668  2273 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:53.023265  3981 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:53.044473  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:53.033519  3867 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:53.037034  3923 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:59:53.058029  2273 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:53.050076  1440 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 7 to 8, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.039247  3772 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.042666  3981 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.042853  3824 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:53.067574  1612 raft_consensus.cc:2368] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7.
I20260709 12:59:53.042932  3960 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.064839  3827 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.072263  3960 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:53.065218  3814 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.090693  3814 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:53.093237  3814 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:53.060655  3764 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:53.093887  3764 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:53.076970  3941 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:53.081867  1539 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:53.072881  3824 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:53.096796  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:53.097092  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:53.088371  3960 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:53.097644  1543 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 12:59:53.098055  3824 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:53.069835  3981 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.070245  3772 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:53.100713  3772 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:53.094955  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:53.101451  1686 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 12:59:53.101679  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:53.103245  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:53.104221  3772 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:53.104614  3772 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.105038  3772 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.109139  3867 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:53.111215  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:53.111992  1692 raft_consensus.cc:2410] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:53.114089  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 65492.6us
I20260709 12:59:53.114248  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:53.114774  1543 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.117591  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:53.118772  1511 leader_election.cc:400] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7.
I20260709 12:59:53.119115  1511 leader_election.cc:403] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:53.121826  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:53.123474  1440 catalog_manager.cc:5697] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 2 to 3, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.126060  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:53.126080  1612 raft_consensus.cc:2368] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7.
I20260709 12:59:53.125785  1440 catalog_manager.cc:5697] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: config changed from index -1 to 3, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 12:59:53.106318  3831 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:53.131860  1511 leader_election.cc:400] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7.
I20260709 12:59:53.139031  1511 leader_election.cc:403] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:53.132514  3987 ts_tablet_manager.cc:933] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:53.134258  3763 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:53.138010  3929 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:53.114125  3827 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:53.144197  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:53.162364  1612 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:53.126430  3867 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:59:53.166666  3907 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:53.155929  3941 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.189294  3930 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.190963  3930 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:53.193048  3930 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:53.198740  1442 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:53.189464  2271 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.237695  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:53.245262  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:53.246030  1693 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 12:59:53.249006  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:53.261370  1689 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:53.263760  2243 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:53.166167  3929 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:53.272857  1543 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:53.279474  3960 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:53.281877  2271 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:53.268198  3811 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:53.309963  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 50280.5us
I20260709 12:59:53.274566  3986 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7.
I20260709 12:59:53.302508  3819 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:53.346594  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 83074.8us
W20260709 12:59:53.335209  3989 log.cc:927] Time spent T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:53.304435  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:53.288647  3985 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:59:53.354403  2271 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:53.354766  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:53.338980  3764 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:53.286140  3772 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:53.392868  3929 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:53.350312  3984 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:59:53.339624  3811 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:53.379906  1615 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:53.361205  3824 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.372800  3842 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.410728  3827 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:53.411764  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:53.413265  3842 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:53.415037  3772 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:53.415320  3842 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:53.354422  3819 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:53.417866  3824 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:53.397229  3643 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:59:53.407330  3997 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:53.410598  3987 tablet_copy_client.cc:323] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
W20260709 12:59:54.532697  3933 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.009s	sys 0.005s
W20260709 12:59:54.533270  3933 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.009s	sys 0.005s
I20260709 12:59:53.989696  3997 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:55.739140  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.438s	user 0.037s	sys 0.054s
W20260709 12:59:55.740100  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.440s	user 0.038s	sys 0.054s
W20260709 12:59:55.740458  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 2.4397e+06us
I20260709 12:59:55.741770  1585 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:55.750058  4005 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:55.751742  4005 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:55.755034  4006 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:55.755178  4007 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:55.756089  4006 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.756356  4007 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.760327  4007 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.760947  4006 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.761080  4007 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.762379  4007 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.765550  4007 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.766225  4007 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:55.766636  4006 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:55.767144  4007 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.767751  4006 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.770246  4007 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.770859  4006 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.770980  4007 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:55.772470  4007 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.775756  4007 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.776364  4007 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.777016  3981 consensus_meta.cc:287] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 2.678s	user 0.022s	sys 0.013s
I20260709 12:59:55.753497  4005 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.777511  3981 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.778147  4008 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.778889  4008 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.779927  3981 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.780684  1619 raft_consensus.cc:2368] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3.
I20260709 12:59:55.780826  3981 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:55.781317  4008 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.781589  3981 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 12:59:55.783396  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 419) took 2374 ms (client timeout 1816 ms). Trace:
I20260709 12:59:55.779945  1689 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:55.783843  3981 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
W20260709 12:59:55.783862  1619 rpcz_store.cc:269] 0709 12:59:53.408878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.409004 (+   126us) service_pool.cc:224] Handling call
0709 12:59:55.783004 (+2374000us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b5400068e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:55.783227 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5444986240}
I20260709 12:59:55.785961  4007 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.787770  4007 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:53.362664  3764 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:55.789729  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08000f52e0 after lost signal to thread 431
I20260709 12:59:55.789469  3764 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:55.790143  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1940 after lost signal to thread 434
I20260709 12:59:55.792129  3764 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:55.792520  2241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.462s	user 0.011s	sys 0.030s
W20260709 12:59:55.792786  2241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.463s	user 0.011s	sys 0.030s
W20260709 12:59:55.793042  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 2.46285e+06us
I20260709 12:59:55.850786  4011 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:55.851826  4011 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.854734  4011 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.858451  3819 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:55.867122  3981 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:55.868155  3981 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:55.872273  4008 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.872606  1584 connection.cc:256] RPC call timeout handler was delayed by -1.0468907879999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 12:59:55.871002  4009 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:55.873447  4015 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:55.871977  3764 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:55.873828  4009 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.874598  4015 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.876398  4009 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.878074  4015 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.874784  3764 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.879801  3981 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.873049  4008 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.880498  4006 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:55.883834  4008 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.879483  4007 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:55.884411  4006 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.884642  4012 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:55.884935  4007 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.885664  4012 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.886874  4006 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.888451  3764 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.888690  4012 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.889336  4013 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:55.889907  4013 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.896610  4007 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.899019  4012 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:55.899066  4014 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.900198  4012 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.900658  4016 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:55.902127  4017 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.902607  4012 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:55.903229  4012 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:55.901878  4016 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.900434  4014 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.903623  4013 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.903959  4012 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.903292  4017 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.906831  4012 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.907099  4014 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.907706  4014 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.908310  4014 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.910189  4016 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.910285  4014 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:55.911336  1659 connection.cc:256] RPC call timeout handler was delayed by -1.009160846000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 12:59:55.911525  4014 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:55.912415  4014 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.910192  4017 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.915179  4014 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.916489  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:55.919893  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:55.920549  1619 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:55.923197  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:55.923823  1616 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:59:55.925148  3907 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:55.928499  3997 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.937233  4021 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:55.935489  4020 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.938011  4021 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.938082  4020 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.940346  4020 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.940850  4020 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:55.941499  4020 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.941918  4022 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:55.943128  4021 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.942801  4022 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.943709  4020 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.943681  4021 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:55.944425  4020 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:55.944614  4021 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.945113  4020 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:55.945823  4022 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.944913  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 673) took 2811 ms. Trace:
I20260709 12:59:55.946419  4022 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:55.947367  4020 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.947701  4021 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.947340  4022 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:55.946808  2272 rpcz_store.cc:276] 0709 12:59:53.133463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.135252 (+  1789us) service_pool.cc:224] Handling call
0709 12:59:55.943588 (+2808336us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80eee 0000000000375939 00007f29f0cf41e0 00007f29f0dbd0c4 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:55.943856 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.944312 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.944340 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:55.944411 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:55.944452 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.944548 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.944671 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2402048}
W20260709 12:59:55.949939  1511 connection.cc:256] RPC call timeout handler was delayed by -1.1509451879999801s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 12:59:55.950018  4022 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:55.952416  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:55.952612  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:55.952956  1616 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:55.953259  1617 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:55.953874  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:55.954519  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:55.955241  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:55.955930  1616 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 12:59:55.973865  1614 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:55.977643  3824 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:55.978155  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:55.978768  1614 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
W20260709 12:59:55.981318  3933 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.447s	user 0.012s	sys 0.014s
W20260709 12:59:55.981799  3933 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.448s	user 0.012s	sys 0.015s
W20260709 12:59:55.983809  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1485) took 2630 ms (client timeout 2794 ms). Trace:
W20260709 12:59:55.984193  1689 rpcz_store.cc:269] 0709 12:59:53.353623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.353726 (+   103us) service_pool.cc:224] Handling call
0709 12:59:55.983503 (+2629777us) spinlock_profiling.cc:243] Waited 2.42 s on lock 0x7b5400372b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:55.983660 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5557850496}
I20260709 12:59:56.007539  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.008476  1543 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
W20260709 12:59:56.008715  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.584s (SENT) [suppressed 1 similar messages]
I20260709 12:59:56.014416  3824 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.015122  3824 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.017354  3824 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.017870  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.018494  1614 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:56.018536  3643 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:56.019235  3643 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.020102  3986 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.020843  3986 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.021590  3643 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.022064  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.022775  4022 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.022917  3933 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.023661  4022 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.026371  4006 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.026814  3764 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.027094  4006 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.027362  3764 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.028642  3997 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.029307  3764 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.029251  3997 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.029670  4006 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.025969  4022 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.030421  4022 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.031414  3997 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.031032  4022 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.032684  3985 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.033625  4022 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.033372  3985 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.022828  4007 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.034806  4023 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.035503  4007 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.035709  4023 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.037724  4007 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.038348  4023 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.038985  4023 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.039515  3985 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.039681  4023 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.040717  3986 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.040148  3985 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.023773  3933 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:56.042361  1509 connection.cc:256] RPC call timeout handler was delayed by -1.1836484119999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
I20260709 12:59:56.041946  3985 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:56.042946  1509 connection.cc:256] RPC call timeout handler was delayed by -1.144048411999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:59:56.043263  1509 connection.cc:256] RPC call timeout handler was delayed by -1.0612484119999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 12:59:56.043599  1509 connection.cc:256] RPC call timeout handler was delayed by -1.0504484119999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 12:59:56.044701  3985 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.042024  4023 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.052030  4007 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.052166  3997 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.052767  4007 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.053798  4006 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.054454  4006 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.055168  4007 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.055691  4007 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.056388  4006 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.056361  4007 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:56.057065  4006 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.057772  4006 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.049521  1614 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 12:59:56.058806  4008 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.060034  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1674) took 3015 ms. Trace:
I20260709 12:59:56.059962  4008 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.060199  4007 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.060397  1545 rpcz_store.cc:276] 0709 12:59:53.044178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.045855 (+  1677us) service_pool.cc:224] Handling call
0709 12:59:53.046085 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.065030 (+ 18945us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:53.072850 (+  7820us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.262487 (+189637us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.262913 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.263023 (+   110us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:53.263049 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.263098 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:56.059583 (+2796485us) raft_consensus.cc:1685] finished
0709 12:59:56.059627 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:56.059832 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2883,"prepare.queue_time_us":6747,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":21793,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":4671,"thread_start_us":205079,"threads_started":2,"wal-append.queue_time_us":267840,"wal-append.run_cpu_time_us":15374,"wal-append.run_wall_time_us":2680807}
I20260709 12:59:56.062011  4008 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.062462  3981 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.062566  4009 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.052845  3997 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.063174  3981 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.063270  4009 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.066792  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.065769  3981 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.065711  4009 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.070528  4008 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:56.075651  4008 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.071641  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.076538  1615 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:56.077339  4008 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.077579  4006 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.078222  3997 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.081197  3811 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.070890  3933 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.074324  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.081948  1613 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:56.075610  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.082860  1616 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 12:59:56.085335  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:56.086210  1616 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.072943  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.095098  1614 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:56.096181  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.100054  1616 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 12:59:56.100944  3831 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:56.103082  1657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.699s	user 0.020s	sys 0.003s
I20260709 12:59:56.104169  3811 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.104826  3811 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.107024  3811 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:56.107867  1657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.704s	user 0.021s	sys 0.004s
I20260709 12:59:56.124704  3463 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.125397  3463 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.129199  3780 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.129952  3780 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.133131  3811 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.133793  3811 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.137485  3463 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.138638  4018 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.138718  4012 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.139549  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 672) took 3078 ms. Trace:
I20260709 12:59:56.139400  4018 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.140018  2273 rpcz_store.cc:276] 0709 12:59:53.060972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.066250 (+  5278us) service_pool.cc:224] Handling call
0709 12:59:53.066708 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.114395 (+ 47687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.114421 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.114964 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.253021 (+138057us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:53.253055 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.138944 (+2885889us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b5400660154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:56.139000 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:56.139079 (+    79us) raft_consensus.cc:1685] finished
0709 12:59:56.139090 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:56.139391 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":759,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6646,"spinlock_wait_cycles":107219328,"thread_start_us":108442,"threads_started":1,"wal-append.queue_time_us":193478,"wal-append.run_cpu_time_us":1696,"wal-append.run_wall_time_us":1068842}
I20260709 12:59:56.141705  4018 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.141875  4016 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.142189  4018 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.142462  4016 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.142797  4018 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.144548  4016 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.144632  4018 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.145260  4012 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.145610  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:56.147998  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 73432.7us
I20260709 12:59:56.146255  1545 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:56.139443  3907 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.160671  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.163005  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.163213  4012 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.156558  3907 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 12:59:56.167073  3780 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.159322  3463 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.168306  3463 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.171411  3907 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 12:59:56.135890  3811 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.173310  4012 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.174058  4012 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.176532  4012 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.177959  3780 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.178875  3694 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.180812  3898 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.183033  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.184671  3463 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.201884  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.193094  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:56.237438  1545 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:56.203722  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.239145  1544 raft_consensus.cc:2410] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:56.212487  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:56.239923  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.240386  1542 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.240854  1538 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:56.201802  3898 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.239924  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.242318  1693 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 12:59:56.246397  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800155240 after lost signal to thread 1442
I20260709 12:59:56.200985  3694 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.250439  1545 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:56.202977  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.253638  4014 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.254294  4014 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.213239  3780 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.256585  4014 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.256793  3825 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.257066  4014 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.257406  3825 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.258277  1618 raft_consensus.cc:2393] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:56.262900  3643 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.263432  4022 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.263568  3643 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:56.264207  4022 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:56.273407  1542 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:53.207032   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:56.274825  1543 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:56.266330  3985 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.267167  3824 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.276937  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.277365  3824 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.278049  1693 raft_consensus.cc:2410] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:56.279597  3824 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.270215  1442 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 5, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.276965  3985 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.281688  4023 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.274228  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.276314  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.283098  1545 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:59:56.282366  4017 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.283950  4023 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.284310  4017 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.266503  3933 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.285036  3985 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.266418  4022 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.286717  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.288748  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.289207  1538 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:56.288426  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:56.289345  1541 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:56.289420  1544 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:56.292325  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.292848  1544 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:56.275034  3898 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.295257  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.285527  3933 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.300293  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.302035  3933 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.303054  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.303324  1540 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:56.303571  1536 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 12:59:56.303720  1544 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:56.298660  4008 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.312259  4008 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.266343  3643 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.257629  4014 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.323877  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.324455  1540 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
W20260709 12:59:56.330418  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800117900 after lost signal to thread 1477
I20260709 12:59:56.330909  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.331604  1693 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:56.331785  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:59:56.331794  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5da0 after lost signal to thread 1569
W20260709 12:59:56.332949  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5dc0 after lost signal to thread 1570
I20260709 12:59:56.333456  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.333923  1543 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
W20260709 12:59:56.339169  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800374e00 after lost signal to thread 1644
W20260709 12:59:56.339476  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800325260 after lost signal to thread 1645
I20260709 12:59:56.340785  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.341305  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.341481  1618 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:56.341864  1617 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:56.343668  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.344226  1618 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:56.345182  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.345530  3825 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.345777  1612 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:56.346222  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.346796  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.346966  3780 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.347352  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.347409  1615 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:56.348030  1619 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:56.348583  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:56.349282  1618 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 12:59:56.350147  3941 consensus_meta.cc:287] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 3.157s	user 0.020s	sys 0.007s
I20260709 12:59:56.350549  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 349) took 3561 ms. Trace:
I20260709 12:59:56.350958  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.350643  3941 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7.
I20260709 12:59:56.345700  1614 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:56.352115  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.355685  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.351540  1617 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:56.356194  1537 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:56.356235  1693 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:56.357264  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.350986  1440 rpcz_store.cc:276] 0709 12:59:52.788708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.789466 (+   758us) service_pool.cc:224] Handling call
0709 12:59:52.842060 (+ 52594us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0f090 00007f29ebdadf3a 00007f29f1b641cc 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc 00007f29f0122392 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:56.350344 (+3508284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:53.140526 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:53.141014 (+   488us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:53.141045 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:59:53.141062 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:53.141550 (+   488us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:53.141604 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:53.141629 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:59:53.141938 (+   309us) tablet.cc:701] Row locks acquired
0709 12:59:53.141955 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:53.142073 (+   118us) write_op.cc:270] Start()
0709 12:59:53.142183 (+   110us) write_op.cc:276] Timestamp: P: 1783601993142034 usec, L: 0
0709 12:59:53.142204 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:53.142868 (+   664us) log.cc:844] Serialized 1365 byte log entry
0709 12:59:53.157746 (+ 14878us) op_driver.cc:464] REPLICATION: finished
0709 12:59:53.167306 (+  9560us) write_op.cc:301] APPLY: starting
0709 12:59:53.167419 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:53.167586 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:53.167734 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:53.168180 (+   446us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:53.168400 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:59:53.168467 (+    67us) write_op.cc:312] APPLY: finished
0709 12:59:53.168714 (+   247us) log.cc:844] Serialized 35 byte log entry
0709 12:59:53.168911 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:53.169018 (+   107us) write_op.cc:454] Released schema lock
0709 12:59:53.169066 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:53.169405 (+   339us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:53.169439 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":79532,"reported_tablets":6,"spinlock_wait_cycles":8142592,"child_traces":[["op",{"apply.queue_time_us":5020,"apply.run_cpu_time_us":2078,"apply.run_wall_time_us":2078,"num_ops":3,"prepare.queue_time_us":106,"prepare.run_cpu_time_us":2585,"prepare.run_wall_time_us":2598,"replication_time_us":12762,"spinlock_wait_cycles":63360}]]}
I20260709 12:59:56.357885  1689 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:56.340386  3643 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:56.360149  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800372560 after lost signal to thread 1718
W20260709 12:59:56.360442  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800329020 after lost signal to thread 1719
I20260709 12:59:56.352236  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.361413  3643 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.361901  3643 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.361832  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.362659  1689 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
W20260709 12:59:56.366367  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800306b40 after lost signal to thread 2301
W20260709 12:59:56.367805  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08003b76e0 after lost signal to thread 2302
W20260709 12:59:56.368422  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800370560 after lost signal to thread 3867
I20260709 12:59:56.369040  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:56.370273  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800370fa0 after lost signal to thread 3920
W20260709 12:59:56.370564  1474 debug-util.cc:398] Leaking SignalData structure 0x7b080022fd60 after lost signal to thread 3922
I20260709 12:59:56.370507  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:56.371001  1474 debug-util.cc:398] Leaking SignalData structure 0x7b080039b780 after lost signal to thread 3923
W20260709 12:59:56.371291  1474 debug-util.cc:398] Leaking SignalData structure 0x7b080039b560 after lost signal to thread 3926
I20260709 12:59:56.369165  4014 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.372383  1693 raft_consensus.cc:2410] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:56.372632  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.373250  1685 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
W20260709 12:59:56.393607  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08002aaac0 after lost signal to thread 3939
W20260709 12:59:56.393982  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08002a01c0 after lost signal to thread 3948
W20260709 12:59:56.399250  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 605497us
I20260709 12:59:56.399369  1511 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.400375  1511 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.400471  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:56.401727  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.403755  3824 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:56.404099  3998 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:56.404940  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6880 after lost signal to thread 3954
I20260709 12:59:56.404917  1511 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:59:56.405419  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800376320 after lost signal to thread 3955
I20260709 12:59:56.409381  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.404186  3824 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.409966  3824 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:56.410183  1614 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:56.410224  3960 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:56.410593  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.411681  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.412302  1612 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:56.413125  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.413244  3933 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:56.413717  1616 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 12:59:56.405678  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.406435  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.409091  3998 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.410778  3960 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.419596  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.419837  3960 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.419936  4000 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:56.421000  2273 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:56.421367  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.422087  2276 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 12:59:56.423187  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.423465  3364 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.424235  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.424067  3364 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.425302  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.425714  4012 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:56.425865  2274 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:56.426144  3364 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.426301  4012 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.426844  4011 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.427508  4011 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.428260  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.428575  4012 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.429559  4011 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.429611  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.430136  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.430858  2268 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:56.432075  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:56.432719  2271 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:56.414744  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.433933  1689 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:56.430404  1544 raft_consensus.cc:2368] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3.
I20260709 12:59:56.415735  4022 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:56.434906  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:56.435079  4022 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.420539  4000 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.435446  1540 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.435523  4022 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:56.435814  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.436913  4000 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.430186  3930 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:56.435354  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.438127  3930 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.438953  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.440286  3930 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.421904  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.423182  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:56.417358  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4740 after lost signal to thread 3958
W20260709 12:59:56.443773  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1e60 after lost signal to thread 3963
W20260709 12:59:56.444084  1474 debug-util.cc:398] Leaking SignalData structure 0x7b080037ebc0 after lost signal to thread 3962
W20260709 12:59:56.444351  1474 debug-util.cc:398] Leaking SignalData structure 0x7b080037ea00 after lost signal to thread 3964
W20260709 12:59:56.444617  1474 debug-util.cc:398] Leaking SignalData structure 0x7b080037e960 after lost signal to thread 3966
W20260709 12:59:56.444947  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800376940 after lost signal to thread 3972
W20260709 12:59:56.445240  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800376460 after lost signal to thread 3975
W20260709 12:59:56.445490  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08003762e0 after lost signal to thread 3976
W20260709 12:59:56.445847  1474 debug-util.cc:398] Leaking SignalData structure 0x7b0800238660 after lost signal to thread 3984
W20260709 12:59:56.446141  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08003cae20 after lost signal to thread 3987
I20260709 12:59:56.441188  2277 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:56.450999  2276 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 1.
I20260709 12:59:56.451792  4020 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:56.452199  4020 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.452554  4020 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.429486  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.448082  3907 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.454824  3694 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.435101  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.455411  3364 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.455247  3907 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.413739  3933 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.455708  4023 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.451072  3910 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.458876  2271 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:56.451125  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.466096  3931 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.468291  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.468904  1692 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
W20260709 12:59:56.469420  2243 connection.cc:256] RPC call timeout handler was delayed by -1.2490498170000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
W20260709 12:59:56.469890  2243 connection.cc:256] RPC call timeout handler was delayed by -1.0383090169999605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260709 12:59:56.470963  2269 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:56.481060  3790 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.481837  3790 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.482371  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.488613  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.503609  1537 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 12:59:56.500492  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.473012  2243 leader_election.cc:400] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3.
I20260709 12:59:56.505264  2243 leader_election.cc:403] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:56.456122  3933 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.512323  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.456039  3364 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.473304  3998 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.472231  3907 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.478164  3992 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.521871  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.478536  3994 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.472440  4000 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 12:59:56.518319  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 47859.5us
I20260709 12:59:56.472278  3930 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:56.520860  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.510601  4023 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:56.472898  3931 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.528057  1541 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:56.527674  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.534920  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.535234  2277 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:56.535447  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.535647  4017 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.536343  4017 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:56.536442  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.536722  4017 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:56.537187  4017 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.537386  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.538204  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.538888  3985 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:56.526585  3992 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.539335  3994 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.539839  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.540481  1690 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:56.540906  3992 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.541688  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.543481  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.541529  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.544320  1511 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.545059  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.545344  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.545969  1686 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 12:59:56.546209  3931 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.546300  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.547080  3556 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:56.546800  4000 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.547454  3556 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.547596  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.547863  3556 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:56.549018  4000 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.549675  3364 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.549963  4020 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.525401  3998 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3.
I20260709 12:59:56.539347  3985 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.551172  3941 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:56.551625  3941 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.552409  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.552058  3930 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.552968  1690 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:56.551275  3985 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.518177  3910 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.557055  3910 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.557847  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.557708  1540 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 12:59:56.558647  1693 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 12:59:56.558988  3825 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:56.559060  4020 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.559506  3825 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:56.559674  3772 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.559949  3825 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.560213  3772 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.562106  3772 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.554389  3930 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.563786  3790 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.541581  3994 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.551990  3941 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.567566  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.568210  1690 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 12:59:56.568533  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.528723  4023 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.569064  1692 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:56.569885  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.570133  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.569912  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.571506  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.571599  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.572163  1691 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:56.572691  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:56.572832  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.573333  1691 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:56.573405  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.574119  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.575049  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.575132  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.575626  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.576155  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.577652  3643 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.578603  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.579190  1539 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:56.580895  1692 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.571022  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.594583  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.595181  1540 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:56.596671  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.596966  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.597620  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.597744  1619 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:56.622656  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.639086  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.639346  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.639889  1536 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:56.640759  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.569135  4023 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.622778  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.642838  1619 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:56.643875  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.644567  1617 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:56.645491  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.646566  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.647167  1614 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:56.647866  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.642170  1537 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:56.637326  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.601116  1544 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:56.652959  1692 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:56.654050  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.654945  1616 raft_consensus.cc:2393] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:56.655474  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.587360  3992 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.658842  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:56.658901  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 100242us
I20260709 12:59:56.659731  1620 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:56.659986  1689 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:56.664324  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.665234  1614 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:56.566798  3985 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.622540  3931 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:56.687153  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.687851  1536 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:56.690119  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:56.690249  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:56.690727  1616 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.690973  1685 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.638510  4000 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.664228  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.694864  4034 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.690446  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.695353  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.702736  1686 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:56.703119  3772 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.703550  4022 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.703632  3772 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.699904  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.704905  3980 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:56.705703  4022 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.705772  3772 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.709071  1615 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:56.709486  3933 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.709889  4034 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.711104  2272 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:56.712097  4034 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:56.712472  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.713084  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.713490  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.713624  2272 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:56.701421  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.716806  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 12:59:56.737179  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 49005.5us
I20260709 12:59:56.715301  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.687312  3824 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.736972  1685 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 12:59:56.737989  2274 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 12:59:56.718654  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.714560  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.742950  2276 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 12:59:56.738767  2275 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 12:59:56.747365  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.746763  1658 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:56.762019  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.715417  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.763921  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.714600  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.767982  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.768335  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.691681  3992 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.746788  4008 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:56.772393  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.768635  1618 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:56.712136  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.777145  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.702814  4000 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.785483  1703 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet d53120c1adf947fd992e5950edf26301 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:56.785797  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.788944  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:56.800194  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 96216us
I20260709 12:59:56.789857  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.702417  3960 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.817006  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.784099  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:56.795442  2274 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:56.796006  1703 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet d53120c1adf947fd992e5950edf26301 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-d53120c1adf947fd992e5950edf26301
I20260709 12:59:56.796530  3992 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.783455  3907 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:56.824154  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.774940  3933 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.807490  3985 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:56.776682  4005 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:56.775175  4008 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:56.831146  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.811579  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.815047  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.827862  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:56.822657  3910 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:56.823035  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:56.799453  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.786706  3643 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.824513  3907 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.779237  4011 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:56.812462  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.854333  3819 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:56.854539  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.855051  3819 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:56.855739  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:56.855902  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.856163  3819 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.856873  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.840013  3960 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.841868  4000 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.842219  3784 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:56.857677  3824 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.835271  4008 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.842751  1616 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 12:59:56.858017  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.820596  3556 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.858774  2271 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 1.
I20260709 12:59:56.859642  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.860250  3556 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:56.860700  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.844244  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.861583  2271 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:56.862361  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.819984  1585 leader_election.cc:400] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 12:59:56.821139  1615 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 12:59:56.862876  4034 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:56.862879  1585 leader_election.cc:403] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:56.863396  4034 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:56.854344  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.864967  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.827956  2275 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 12:59:56.851203  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 61431.9us
I20260709 12:59:56.864001  4034 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.825191  4017 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:56.851923  1658 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:56.856901  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.715855  3931 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:56.866653  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:56.855748  1703 tablet_copy_source_session.cc:215] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:57.049911  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:56.847175  2272 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:57.050453  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.952185  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.882134  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.857992  3784 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.951836  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.951488  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.054549  2276 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 12:59:57.056769  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.057555  2276 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 12:59:56.997896  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.847802  3910 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:57.064215  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.065174  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.065958  1540 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:57.066962  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.067641  1540 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
W20260709 12:59:57.068210  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 250620us
W20260709 12:59:56.937250  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 55173.3us
I20260709 12:59:56.951124  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.050601  1541 raft_consensus.cc:2376] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7. Re-sending same reply.
I20260709 12:59:57.058508  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.948103  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.051633  1544 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 12:59:57.069219  3825 consensus_meta.cc:287] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.015s
I20260709 12:59:57.069101  1585 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:57.074839  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:56.851523  3907 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:57.077327  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:56.885938  4039 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:56.939057  4043 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 12:59:57.078945  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.079150  1542 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 12:59:56.988036  4005 raft_consensus.cc:697] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:57.080927  1543 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:56.931205  3978 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:57.081670  2243 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:59:57.082382  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 230460us
I20260709 12:59:57.060818  3784 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.865999  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:56.851763  3941 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.085281  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.084649  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.099733  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.100297  1585 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:57.100694  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.100785  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.101424  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:57.101886  4048 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:57.086292  1659 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:57.102849  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.103904  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.108250  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.071171  3910 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.109790  4023 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:57.114905  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.099151  3819 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:56.954226  4008 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:57.138975  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.204757  2271 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 12:59:57.124692  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:57.082193  4039 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.209086  2275 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:57.204257  1658 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:59:57.212569  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 131848us
I20260709 12:59:57.213538  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:57.205699  2276 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
W20260709 12:59:57.214363  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 114101us
I20260709 12:59:57.211994  2272 raft_consensus.cc:2368] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6.
I20260709 12:59:57.128262  4041 ts_tablet_manager.cc:933] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:57.216406  2241 leader_election.cc:400] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3.
I20260709 12:59:57.216341  1585 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:59:57.214434  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 113069us
I20260709 12:59:57.216677  4011 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.125144  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:57.220860  2270 raft_consensus.cc:2393] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:57.204252  3819 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.230858  3819 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:57.128371  4036 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.224532  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:57.080077  3825 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.225143  4011 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.225919  4012 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:57.226267  3980 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:57.229146  3907 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:57.228237  3941 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:57.124802  4044 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:57.204519  3978 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.232492  1585 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:57.204481  4048 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.214226  4039 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.251322  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:57.265995  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 84415.3us
I20260709 12:59:57.252949  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:57.221565  4043 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.220281  4045 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:57.266928  1510 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:57.278101  1536 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.278039  1690 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 12:59:57.278005  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 85123us
I20260709 12:59:57.235651  4011 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.241550  4047 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:57.283123  4047 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:57.283591  4047 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.235532  4012 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:57.240984  3980 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.286631  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.288956  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:57.233088  4036 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:57.290066  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 85860.8us
I20260709 12:59:57.254884  3978 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.254905  4044 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.291633  1510 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:57.292866  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:57.270421  3694 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:57.265877  4048 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.269821  4045 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.281461  3941 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:57.296850  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 61943.8us
W20260709 12:59:57.297789  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 84312.3us
I20260709 12:59:57.291611  3980 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.299204  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.300462  1510 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:57.269683  4043 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.291402  4012 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.305698  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:57.294245  3643 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:57.292771  4036 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.310490  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:57.309360  1659 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:57.299043  3694 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:57.297358  4044 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:57.304338  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:57.342557  1540 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
W20260709 12:59:57.343072  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 110608us
I20260709 12:59:57.343945  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:57.303712  3931 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:57.347311  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.348093  1690 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:57.306116  3556 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:57.305335  4045 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.311088  3824 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.312011  4043 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.312975  3643 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.308368  3960 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:57.345988  3694 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:57.305204  3941 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.348657  3985 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:57.347446  4017 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:57.360141  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 67320.7us
I20260709 12:59:57.351444  3556 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:57.377310  3556 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.374743  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.359789  3643 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:57.391359  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 87134.4us
I20260709 12:59:57.371927  3941 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.392678  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:57.396736  3556 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.398814  4061 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:57.402927  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.403298  4058 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:57.297502  4005 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.406241  4061 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.408047  4061 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.403759  4008 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:57.372833  3960 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:57.409929  4058 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.413569  4034 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:57.418591  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 59750.2us
I20260709 12:59:57.405174  4023 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:57.433573  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 124279us
I20260709 12:59:57.435772  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.419028  4058 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:57.446727  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 92251.6us
W20260709 12:59:57.427126  4053 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:59:57.447746  1585 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:59:57.428918  4050 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:59:57.420183  4059 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.451268  4063 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:57.451934  4063 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.452003  4066 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:57.453716  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:57.420298  4054 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:57.451428  4059 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.452461  4063 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:57.455675  2274 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:57.421241  3825 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:57.423744  3556 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:57.439677  4049 log.cc:927] Time spent T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:59:57.422307  4047 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.421180  3907 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:57.460913  1510 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:57.464102  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 12:59:57.472939  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 80963.3us
I20260709 12:59:57.485841  1510 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:57.477267  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:57.482415  4064 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:57.488528  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:57.493284  1690 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:57.488336  3933 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:57.497030  3933 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.497413  3933 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:57.476179  4059 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.512077  4059 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.492441  3985 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:57.514169  3985 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.514617  3985 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.514973  4047 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:57.460911  4054 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:57.490496  4064 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.545362  4069 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:57.546131  4069 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:57.524042  4055 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:59:57.574239  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 230338us
I20260709 12:59:57.551374  3960 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.575376  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:57.576292  4008 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:57.576687  4008 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.576469  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:57.577068  4008 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.577751  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:57.551003  4064 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:57.515730  4047 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.579455  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:57.586247  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 100496us
I20260709 12:59:57.587935  1510 leader_election.cc:400] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6.
I20260709 12:59:57.588407  1510 leader_election.cc:403] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:57.525511  4054 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.589960  1612 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.593521  4072 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:57.595546  4070 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:57.597282  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 108894us
I20260709 12:59:57.600275  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:57.602269  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 12:59:57.602957  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 145312us
I20260709 12:59:57.606073  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:57.613164  1658 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:57.578521  4048 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:57.599041  4065 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:59:57.643723  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 64318.1us
I20260709 12:59:57.676437  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:57.691934  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:57.693722  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:59:57.693850  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 73533.8us
I20260709 12:59:57.604662  4072 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 12:59:57.643198  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 205842us
I20260709 12:59:57.694887  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:57.695315  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.701340  1685 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:57.697007  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:57.697253  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:57.697083  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 80896us
I20260709 12:59:57.614327  3556 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.698522  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.611533  4041 tablet_copy_client.cc:323] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 12:59:57.638129  4005 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.596155  4047 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.616415  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:57.665836  3907 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.728170  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.728902  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.681417  4066 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:57.699972  3910 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.727880  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:57.723420  4069 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:57.733752  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:57.781030  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 12:59:57.732343  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 126059us
I20260709 12:59:57.724107  3978 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:57.732635  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:57.785590  1538 raft_consensus.cc:2368] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 12:59:57.736245  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:57.733510  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.765949  1537 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.721922  4072 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.637079  3772 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:59:57.792420  3643 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.767885  4067 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:59:57.768200  3980 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:57.769106  3819 consensus_meta.cc:287] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.017s
I20260709 12:59:57.726565  3556 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.680368  4071 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:57.773597  3910 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:57.775044  3825 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:57.734505  3907 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:57.814847  3907 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.775383  4036 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.775729  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.776237  4045 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.725812  4034 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:57.778836  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.788935  1544 raft_consensus.cc:2393] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:57.791066  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 12:59:57.801172  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 73364.6us
I20260709 12:59:57.803331  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:57.773217  4012 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.808485  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:59:57.809195  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 76623us
I20260709 12:59:57.809187  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.805702  4069 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.811036  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:57.812150  3772 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:57.812512  4000 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:57.891222  1544 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:57.813640  4047 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:57.819346  1545 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:57.815546  3819 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:57.820598  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.815783  3556 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.821091  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:57.894683  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.827466  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:57.790489  4011 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.806659  4005 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:57.896237  1694 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:57.815864  3825 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:57.801885  4066 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:57.907789  4048 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:57.913592  4077 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.926754  4011 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:57.913846  3825 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.810264  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:57.830698  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 12:59:57.930821  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 100199us
I20260709 12:59:57.802779  4070 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:57.834276  1660 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:57.834975  4012 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:57.831974  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:57.837160  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:57.816942  4071 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.886502  3772 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:57.888150  4074 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:57.933624  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 111361us
I20260709 12:59:57.941818  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 12:59:57.937995  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 106133us
I20260709 12:59:57.817242  4061 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:57.934935  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 97812.8us
I20260709 12:59:57.943877  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:57.945305  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:57.946499  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:57.917732  3978 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:57.947659  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:57.948796  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:57.935055  4011 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:57.936820  4067 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:57.933075  4069 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:57.979705  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:57.897904  3933 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.934185  4005 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:57.990759  4067 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:57.991240  4082 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:57.994707  4060 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:57.998032  2272 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:57.999044  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:57.999074  4070 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.001008  4069 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:57.939796  4045 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.002847  4047 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:58.002627  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:58.004297  3980 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:58.005057  3784 consensus_meta.cc:287] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.009s
I20260709 12:59:58.044214  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.044785  3784 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.045183  1545 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:58.045514  4083 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:58.046746  3784 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:58.047238  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.032158  4082 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:58.047413  3784 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.047791  4082 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:58.047926  3784 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.005788  4065 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6.
I20260709 12:59:57.914109  4077 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 12:59:58.008323  3941 consensus_meta.cc:287] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.598s	user 0.004s	sys 0.031s
I20260709 12:59:58.009959  4008 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:57.942891  4023 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:57.978891  4017 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:58.011087  3772 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.056098  4023 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:58.056201  4017 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.056663  4017 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:58.056770  3772 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:58.012470  4043 consensus_meta.cc:287] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.003s
I20260709 12:59:58.059212  4008 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 12:59:58.014426  4058 consensus_meta.cc:287] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.008s
I20260709 12:59:57.941365  4074 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:58.065007  4074 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:58.002185  3985 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:57.941466  4071 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:58.019745  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 406587us
I20260709 12:59:57.985028  4011 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:58.036682  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 12:59:58.037216  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 229787us
I20260709 12:59:57.984931  4048 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:57.983525  4091 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:58.040331  1541 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:58.034415  3824 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:58.037916  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 96211.4us
I20260709 12:59:58.033018  4067 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.978844  3819 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:58.042764  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 12:59:58.037408  4059 consensus_meta.cc:287] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.525s	user 0.000s	sys 0.011s
I20260709 12:59:58.046913  4054 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.004818  4063 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.051970  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 12:59:58.053619  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 104885us
I20260709 12:59:58.010558  3556 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.046422  4005 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.058931  4043 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.013665  4085 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:58.016640  4064 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.060467  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:58.056576  4023 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:58.064320  4058 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.041829  4047 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:58.046957  4066 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:58.042836  4060 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.065024  4069 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:58.448163  2275 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:58.148401  1538 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 12:59:58.452054  4059 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.166749  4072 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.453403  4074 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.453912  1616 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:58.176769  3980 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.277s
I20260709 12:59:58.455440  4074 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.455801  4054 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.456275  1614 raft_consensus.cc:2368] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5.
I20260709 12:59:58.185216  4082 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.457096  4063 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 12:59:58.137639  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:58.458230  1612 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:58.456348  1691 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:58.459422  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2179) took 1026 ms. Trace:
I20260709 12:59:58.459719  1691 rpcz_store.cc:276] 0709 12:59:57.433006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.433209 (+   203us) service_pool.cc:224] Handling call
0709 12:59:58.459278 (+1026069us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400304154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:58.459374 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303567616}
I20260709 12:59:58.414999  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 343) took 5607 ms. Trace:
I20260709 12:59:58.461872  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:58.461146  1511 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:58.464136  2273 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 12:59:58.054332  4039 consensus_meta.cc:287] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.005s
I20260709 12:59:58.464196  1660 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:58.469195  1658 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:58.465679  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 405206us
I20260709 12:59:58.493882  4080 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:58.494939  4085 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:58.495323  4085 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.495662  4085 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:58.497061  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 12:59:58.473825  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 431082us
I20260709 12:59:58.498131  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:58.494452   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:58.498601  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 12:59:58.500419  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:58.502671  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:58.495790  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.506925  2271 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 12:59:58.324759  1443 catalog_manager.cc:5697] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 4, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 4 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 12:59:58.400383  3907 consensus_meta.cc:287] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.005s
I20260709 12:59:58.510932  1539 raft_consensus.cc:2368] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5.
W20260709 12:59:58.410962  4044 consensus_meta.cc:287] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.056s	user 0.005s	sys 0.021s
I20260709 12:59:58.519718  1542 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:58.179255  3643 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.512477  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:58.523262  1693 raft_consensus.cc:2368] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 12:59:58.512706  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 12:59:58.228773  3694 consensus_meta.cc:287] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.005s
I20260709 12:59:58.524097  1690 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:58.528731  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.518419  1538 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:58.526949  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.530149  2273 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:58.527693  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:58.461171  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.447842  4011 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:58.535432  1540 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:58.538950  1703 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet dbe29c0d913c42cfb39d487a69abfd46 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 12:59:58.536886  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:58.539453  1703 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet dbe29c0d913c42cfb39d487a69abfd46 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-dbe29c0d913c42cfb39d487a69abfd46
I20260709 12:59:58.465229  3819 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.540273  3819 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:58.540740  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.541213  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.508225  4054 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:58.510530  4012 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:58.541761  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:58.542219  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.542567  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:58.465593  4047 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:58.497578  4048 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:58.554880  1537 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:58.415267  3825 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.225616  3784 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:58.526466  3907 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.537362  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:58.447022  3933 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.524484  1443 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.546131  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.546532  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.546756  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:58.461651  4091 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:58.466836  4059 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.543115  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.599123  1686 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 12:59:58.541818  4054 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:58.549715  1543 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:58.550794  1616 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:58.551517  1614 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:58.547039  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:58.553131  1544 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:58.471271  4061 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.604005  4061 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:58.604342  4061 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:58.604621  1536 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:58.605335  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.605567  4078 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:58.606069  1686 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:58.606910  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.511829  4066 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:58.178241  4036 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:58.510732  4008 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:58.557222  2275 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 12:59:58.059691  3941 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.447912  4086 consensus_queue.cc:1059] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:59:58.518713  4055 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.529884  4092 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:58.577436  1545 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:59:58.572435  4082 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.536196  3980 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:58.588893  1539 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:58.582165  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:58.597698  1692 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 12:59:58.581077  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 69236.7us
I20260709 12:59:58.543769  4083 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:58.604712  4061 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:58.139503  4077 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:58.510604  3978 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:58.680032  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 143720us
I20260709 12:59:58.680341  1540 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:58.680764  2243 leader_election.cc:400] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5.
I20260709 12:59:58.507889  4039 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.542711  3694 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.609807  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.557958  4048 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:58.611300  1585 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:58.612347  1694 raft_consensus.cc:2368] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
W20260709 12:59:58.613134  1509 leader_election.cc:336] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.638s (SENT)
W20260709 12:59:58.696779  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 83680us
W20260709 12:59:58.697405  1509 leader_election.cc:336] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.682s (SENT)
W20260709 12:59:58.698621  1509 leader_election.cc:336] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.774s (SENT)
I20260709 12:59:58.699005  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 12:59:58.142526  4017 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.615352  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:58.535647  4044 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.604570  1703 tablet_copy_source_session.cc:215] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:59:58.667080  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 199587us
W20260709 12:59:58.708536  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 97323.1us
I20260709 12:59:58.610526  4008 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 12:59:58.646116  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 184987us
I20260709 12:59:58.600044  4091 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:58.675311  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:58.676023  1538 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:58.553979  4081 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:59:58.681042  2243 leader_election.cc:403] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.608736  4054 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:58.607458  4066 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 12:59:58.685328  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 138628us
I20260709 12:59:58.756119  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:58.756415  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.756119  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.681697  4083 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.759203  4083 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.700207  1686 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 12:59:58.701870  1509 leader_election.cc:336] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.786s (SENT)
I20260709 12:59:58.713620  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:58.679308  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.711617  3643 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.766983  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 12:59:58.679078  3978 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:58.726629  4081 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:58.727185  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46537.7us
I20260709 12:59:58.728004  4036 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:58.728098  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.791110  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:58.729105  3556 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.731166  3941 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.735378  4058 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:58.740056  1658 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:58.714917  4104 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:58.740694  4063 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:58.742300  3907 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.747251  4072 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.747748  3825 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.785236  3978 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:58.748624  1511 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:58.749876  4060 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:58.750656  4043 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:58.762924  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 61067.8us
I20260709 12:59:58.784374  4083 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:58.765749  1692 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:58.461723  1442 rpcz_store.cc:276] 0709 12:59:52.807342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.807465 (+   123us) service_pool.cc:224] Handling call
0709 12:59:58.414917 (+5607452us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:56.398656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:56.399332 (+   676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:56.399381 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:59:56.399403 (+    22us) tablet.cc:662] Decoding operations
0709 12:59:56.399869 (+   466us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:56.399968 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:56.400001 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:56.400478 (+   477us) tablet.cc:701] Row locks acquired
0709 12:59:56.400521 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:59:56.400668 (+   147us) write_op.cc:270] Start()
0709 12:59:56.400794 (+   126us) write_op.cc:276] Timestamp: P: 1783601996400616 usec, L: 0
0709 12:59:56.400815 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:56.401472 (+   657us) log.cc:844] Serialized 924 byte log entry
0709 12:59:56.974675 (+573203us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b180029f0e0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 12:59:57.487969 (+513294us) op_driver.cc:464] REPLICATION: finished
0709 12:59:57.682629 (+194660us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda232a 00007f29ebd27f14 00007f29ebd27ec3 00007f29ebd27e38 00007f29ebd27df3 00007f29ebd270dc 00007f29ebd50e16 00007f29ebd38cbb 00007f29ebd2339d 00007f29ebd26d75
0709 12:59:57.699640 (+ 17011us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b180029f0e0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 12:59:57.699798 (+   158us) write_op.cc:301] APPLY: starting
0709 12:59:57.699891 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:57.700015 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:57.700053 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:57.804688 (+104635us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:57.888760 (+ 84072us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:57.888808 (+    48us) write_op.cc:312] APPLY: finished
0709 12:59:57.889069 (+   261us) log.cc:844] Serialized 29 byte log entry
0709 12:59:57.889255 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.889350 (+    95us) write_op.cc:454] Released schema lock
0709 12:59:57.889403 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:57.889824 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.889850 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3170948,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":180388,"apply.run_cpu_time_us":2719,"apply.run_wall_time_us":189990,"num_ops":2,"prepare.queue_time_us":32733,"prepare.run_cpu_time_us":64842,"prepare.run_wall_time_us":123250,"raft.queue_time_us":291652,"raft.run_cpu_time_us":23840,"raft.run_wall_time_us":272128,"replication_time_us":1049702,"spinlock_wait_cycles":45745152,"thread_start_us":396624,"threads_started":4,"wal-append.queue_time_us":125429}]]}
I20260709 12:59:58.710988  4008 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:58.716881  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.773327  1584 leader_election.cc:400] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 12:59:58.844528  1584 leader_election.cc:403] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.760517  2273 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 12:59:58.820196  1694 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:58.845672  2271 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:58.846019  2277 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:58.618450  4092 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.849786  4092 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:58.748522  4064 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 12:59:58.833178  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 93182.8us
I20260709 12:59:58.764946  4066 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:58.769026  4082 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:58.835548  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 86978.9us
I20260709 12:59:58.764307  1660 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 12:59:58.839991  1509 leader_election.cc:336] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 2.053s (SENT)
I20260709 12:59:58.816579  4081 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 12:59:58.819365  4080 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:58.839604  3772 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:58.844749  4099 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:58.835489  4104 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:58.843554  4083 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 12:59:58.846953  1585 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 12:59:58.851258  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 78102.5us
I20260709 12:59:58.890581  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.858975  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 12:59:58.831858  3694 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.833473  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:58.724164  4067 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.885614  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.835183  3910 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:58.842605  3556 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:58.886482  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 46512.6us
W20260709 12:59:58.910221  1509 leader_election.cc:336] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 2.109s (SENT)
W20260709 12:59:58.911010  1509 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 2.144s (SENT)
I20260709 12:59:58.911276  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:59:58.895992  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 49108.4us
I20260709 12:59:58.899783  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:58.913815  1619 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:58.888813  1511 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:58.903461  2241 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:58.915496  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.909897  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.916168  2277 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:58.908669  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.911468  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:58.917618  1614 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:58.897491  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:59:58.903708  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 44807.2us
I20260709 12:59:58.919255  1612 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 2: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:58.920162  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:58.920568  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:58.920790  1612 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:58.921265  1618 raft_consensus.cc:2393] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:58.886765  4082 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:58.894305  4083 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:58.923623  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.905927  4059 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:58.927317  1688 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:58.927587  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:58.925284  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.931561  4085 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:58.936517  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:58.942180  1539 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 2: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:58.904636  3907 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:58.923421  3825 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:58.937080  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:58.940205  2275 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:58.854578  4043 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:58.884702  4012 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:59:58.890810  3772 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:58.893427  4060 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:59:58.909879  3556 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 12:59:58.960719  3556 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:58.962829  4100 consensus_queue.cc:1059] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:59:58.922538  3694 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.911165  2269 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 12:59:58.950810  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:58.929358  4082 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:58.955197  3960 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:58.956610  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:58.939980  4064 consensus_queue.cc:1059] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:59:58.890942  4080 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:59.156767  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 70489.8us
I20260709 12:59:58.966046  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:59.339145  2277 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 12:59:59.307235  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:58.963328  1542 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:59.240301  1612 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 12:59:59.465226  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:59.503827  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:58.963830  1614 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 12:59:59.504808  1612 raft_consensus.cc:2393] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:59.505529  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:59.505824  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:59.506479  1614 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:59.506845  1612 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 12:59:59.477294  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 12:59:59.199174  2275 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 12:59:59.480834  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 12:59:59.514940  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.003s	sys 0.009s
I20260709 12:59:59.516582  1539 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 12:59:59.515357  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.003s	sys 0.009s
I20260709 12:59:59.518306  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.519555  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.520476  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:58.944542  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:58.946722  4059 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 12:59:58.944929  4099 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.594s
I20260709 12:59:59.522989  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 12:59:59.456342  4005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.017s
W20260709 12:59:59.539180  4005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.001s	sys 0.018s
I20260709 12:59:59.539373  4059 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:59.224738  3933 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:59.540560  3933 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:59.541185  4067 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:59.453190  4008 consensus_meta.cc:287] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.596s	user 0.005s	sys 0.000s
I20260709 12:59:59.542160  4117 raft_consensus.cc:3055] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:59.542515  4008 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:59.203778  4023 consensus_meta.cc:287] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.002s
I20260709 12:59:59.543530  1620 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:59.543625  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 12:59:59.544093  4036 consensus_meta.cc:287] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.724s	user 0.007s	sys 0.000s
I20260709 12:59:59.544305  1537 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 12:59:59.544507  4008 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:58.951678  3910 consensus_queue.cc:1059] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.594s
I20260709 12:59:59.545827  3910 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:59.546018  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:59.544503  4036 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5.
I20260709 12:59:59.546823  1537 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:59.164683  4104 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:59.542538  4117 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:59.547566  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 12:59:59.548243  1537 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:59.548038  4117 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:59.548959  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:59:59.451778  4091 consensus_meta.cc:287] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.742s	user 0.006s	sys 0.002s
W20260709 12:59:59.318521  4109 log.cc:927] Time spent T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:59:59.525363  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.297384  3556 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 12:59:59.522835  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.527383  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:59.527815  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:59.528825  4085 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:59.513450  4119 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.530958  2268 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:59.532032  4061 consensus_meta.cc:287] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.831s	user 0.003s	sys 0.006s
I20260709 12:59:59.242094  3643 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 12:59:58.992599  4044 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:59.527426  4047 consensus_meta.cc:287] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.964s	user 0.006s	sys 0.003s
I20260709 12:59:58.967496  4017 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:59.008982  3907 consensus_queue.cc:1059] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.526s
I20260709 12:59:59.476747  4081 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 12:59:59.537595  4071 consensus_meta.cc:287] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 1.028s	user 0.007s	sys 0.003s
I20260709 12:59:59.538570  4100 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:58.966924  3825 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 12:59:59.542830  3933 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 12:59:59.247270  4048 consensus_meta.cc:287] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.003s
I20260709 12:59:59.549202  4117 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.549533  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:59.550014  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 473) took 1034 ms. Trace:
I20260709 12:59:59.550065  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 12:59:59.317807  4110 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.303s	user 0.000s	sys 0.000s
W20260709 12:59:59.437662  4054 consensus_meta.cc:287] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.667s	user 0.004s	sys 0.004s
W20260709 12:59:59.433178  3978 consensus_meta.cc:287] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.002s
W20260709 12:59:59.298388  4011 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.740s	user 0.000s	sys 0.009s
W20260709 12:59:59.522045  2241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.003s	sys 0.009s
W20260709 12:59:59.517591  3784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.001s	sys 0.011s
W20260709 12:59:59.524689  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 760327us
I20260709 12:59:59.546164  3910 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:59.873157  1543 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:59.580054  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:59.897147  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:59.897244  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 537) took 1184 ms. Trace:
I20260709 12:59:59.552733  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.872047  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 768) took 1031 ms. Trace:
W20260709 12:59:59.896325  2241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.007s	sys 0.012s
I20260709 12:59:59.611739  2270 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 12:59:59.898860  1538 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:59.898404  1688 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
W20260709 12:59:59.899228  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 995654us
I20260709 12:59:59.554811  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1715) took 1027 ms. Trace:
I20260709 12:59:59.875824  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 12:59:59.874497  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.898842  2271 rpcz_store.cc:276] 0709 12:59:58.841028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.841155 (+   127us) service_pool.cc:224] Handling call
0709 12:59:58.845496 (+  4341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.846001 (+   505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.871749 (+1025748us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b5400881dd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:59.871969 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9266560}
I20260709 12:59:59.909714  3819 raft_consensus.cc:3055] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:59.910111  3819 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:59.910187  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.910631  3772 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:59.910772  1693 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.910933  3819 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:59.912233  3819 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:59.882416  3985 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:59.897795  1543 rpcz_store.cc:276] 0709 12:59:58.712616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.713375 (+   759us) service_pool.cc:224] Handling call
0709 12:59:59.872474 (+1159099us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b5800004e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:59.872702 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.896913 (+ 24211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.897177 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171831680}
I20260709 12:59:59.916235  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:59.916757  1543 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.917081  1611 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 12:59:59.917557  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2221) took 1003 ms. Trace:
I20260709 12:59:59.917840  1611 rpcz_store.cc:276] 0709 12:59:58.914324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.928118 (+ 13794us) service_pool.cc:224] Handling call
0709 12:59:59.875652 (+947534us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 12:59:59.917502 (+ 41850us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7831808}
W20260709 12:59:59.923326  4122 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:59:59.927057  1536 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:59.928756  3556 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:59.929275  3643 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:59.930452  1693 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 12:59:59.931316  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:59.931483  3643 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 12:59:59.932282  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 12:59:59.932368  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.316248  4066 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:59.933452  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.934357  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 12:59:59.935979  4066 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:59.946779  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 12:59:59.936753  3910 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:59.383306  4043 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 12:59:59.878307  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 12:59:59.906834  1686 rpcz_store.cc:276] 0709 12:59:58.515336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.606654 (+ 91318us) service_pool.cc:224] Handling call
0709 12:59:59.549847 (+943193us) spinlock_profiling.cc:243] Waited 92.5 ms on lock 0x7b5400125054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 12:59:59.549966 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212698880}
W20260709 12:59:59.969889  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 91637.2us
I20260709 12:59:59.967720  2241 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:59.960961  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:58.969547  4039 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 12:59:59.978873  1692 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 12:59:59.979452  2241 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 12:59:59.906168  1540 rpcz_store.cc:276] 0709 12:59:58.527862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.539311 (+ 11449us) service_pool.cc:224] Handling call
0709 12:59:58.539541 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.680822 (+141281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.554519 (+873697us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400355054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 12:59:59.554736 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323299200}
I20260709 12:59:59.965436  1510 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:59.977300  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2229) took 1042 ms. Trace:
I20260709 12:59:59.984577  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:59.983700  1619 rpcz_store.cc:276] 0709 12:59:58.934655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.966429 (+1031774us) service_pool.cc:224] Handling call
0709 12:59:59.966765 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.966920 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.966944 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:59.966980 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:59.967011 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.967063 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.977249 (+ 10186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:59.977270  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 80196.3us
I20260709 12:59:59.982208  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 12:59:59.584969  4083 consensus_meta.cc:287] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.000s
W20260709 12:59:59.896654  3784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.001s	sys 0.021s
I20260709 12:59:59.986116  1538 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 12:59:59.985883  1510 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 12:59:59.641808  4008 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 12:59:59.317058  4092 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:59.997628  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 12:59:59.877588  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 12:59:59.834360  4036 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.938015  4100 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:00.013475  1543 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:00.014349  4100 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:00.015405  4118 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:00:00.015760  4100 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.978375  4055 raft_consensus.cc:3055] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:59.969839  4099 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:59.654336  4063 raft_consensus.cc:3055] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:59.984879  4081 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:59.979102  4074 raft_consensus.cc:3055] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.937564  4071 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:59.900794  4061 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:59.985351  3772 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:59.978449  4017 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.011009  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.012749  4036 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.020061  1538 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:00.040693  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:00.042454  1538 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:59.988632  4085 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:59.965867  4048 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 12:59:59.938030  4047 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.002184  3933 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:00.029439  1693 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:00.020713  4055 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:59.544109  4023 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.026501  4074 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:59.978716  4034 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:00:00.040077  1537 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.039206  1543 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:59.946983  4011 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 12:59:59.999773  4059 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:00.060130  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 718) took 1304 ms. Trace:
I20260709 12:59:59.906220  3978 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 13:00:00.049330  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.978489  4119 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.026060  4063 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 12:59:59.946841  4091 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.052232  1690 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:00.039987  3910 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:59.938154  4054 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.114511  4119 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:00.005312  4008 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.153245  4008 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.153833  1689 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:00.154057  1509 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 2.522s (SENT)
I20260709 13:00:00.154969  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 470) took 1640 ms. Trace:
I20260709 13:00:00.155313  4047 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:00.155269  1689 rpcz_store.cc:276] 0709 12:59:58.514371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.514477 (+   106us) service_pool.cc:224] Handling call
0709 12:59:58.546726 (+ 32249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.154223 (+1607497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.154756 (+   533us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400324bd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:00.154885 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3695206272}
I20260709 13:00:00.016760  4066 consensus_queue.cc:1059] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:00:00.056978  1613 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:00.156999  4070 raft_consensus.cc:3055] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:00.157328  4070 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:00.158124  4070 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.057996  4086 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:00.159124  4086 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:00.159955  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.159919  4086 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.160763  1544 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:00.160998  4086 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:00.161158  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1722) took 1458 ms (client timeout 1788 ms). Trace:
W20260709 13:00:00.161582  1544 rpcz_store.cc:269] 0709 12:59:58.703100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.703238 (+   138us) service_pool.cc:224] Handling call
0709 13:00:00.159830 (+1456592us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5800004e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:00.161110 (+  1280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53692288}
I20260709 13:00:00.163484  4036 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:00.164746  4080 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:00.067788  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.068500  1614 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:00.030090  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.073290  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 461) took 1521 ms. Trace:
I20260709 13:00:00.060484  2270 rpcz_store.cc:276] 0709 12:59:58.755754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.756188 (+   434us) service_pool.cc:224] Handling call
0709 13:00:00.059989 (+1303801us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54006504d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:00.060078 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817049472}
I20260709 13:00:00.047425  4017 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:00.114698  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.080626  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.168191  1620 rpcz_store.cc:276] 0709 12:59:58.543123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.543592 (+   469us) service_pool.cc:224] Handling call
0709 12:59:58.543889 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.543966 (+1000077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.064149 (+520183us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b540024ac54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:00.064289 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298280192}
I20260709 13:00:00.050885  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:48306
I20260709 13:00:00.056088  3933 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:00.051245  4085 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:00.070930  4059 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:00.117138  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.182763  1542 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:00.108482  1545 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:00.112380  1685 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:00.111765  3960 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:00.113307  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 1541) took 1176 ms. Trace:
I20260709 13:00:00.046264  4000 consensus_queue.cc:1059] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:00.111485  1543 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:00.003125  4083 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.116266  1615 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:00.111423  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 770) took 1269 ms. Trace:
I20260709 13:00:00.109184  4074 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.110811  4092 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:00.114053  4071 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.146116  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.146349  1616 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:00.230199  1541 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:00.230787  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 119918us
I20260709 13:00:00.147174  4048 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:00.148126  4061 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.056593  3825 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.149189  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 776) took 1254 ms. Trace:
W20260709 13:00:00.167605  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 225120us
I20260709 13:00:00.242836  2268 rpcz_store.cc:276] 0709 12:59:58.895120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.902277 (+  7157us) service_pool.cc:224] Handling call
0709 12:59:59.516033 (+613756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.966115 (+450082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.148991 (+182876us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54006f6dd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:00.149132 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293589888}
I20260709 13:00:00.169988  1658 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:00.244108  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 74223.7us
I20260709 13:00:00.243817  4063 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.244904  3694 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:00.221071  3960 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:00.245465  3694 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:00.220970  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:00.245994  3907 consensus_queue.cc:1059] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:00.175351  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 145339us
I20260709 13:00:00.246320  3694 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.177680  3910 consensus_queue.cc:1059] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:00.247112  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.245994  3960 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.247992  3910 raft_consensus.cc:3055] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:00.248359  3910 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:00.248553  1660 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.249469  3819 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:00.249177  3910 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:00.177893  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 137262us
I20260709 13:00:00.182571  1585 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:00.184396  1536 rpcz_store.cc:276] 0709 12:59:58.936505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.936617 (+   112us) service_pool.cc:224] Handling call
0709 13:00:00.113137 (+1176520us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b540025c1d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:00.113256 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978878720}
I20260709 13:00:00.215689  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:00.204191  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.250569  3910 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.176726  4099 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:00.262214  1538 raft_consensus.cc:2393] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:00.250465  3819 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:00.263123  4074 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.219724  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:00.182974  3772 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:00.184003  4059 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.244895  4063 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.251199  4023 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.217913  4055 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.272624  3907 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:00.181313  4116 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:00.238215  4011 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.239645  4017 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.241494  3933 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.274741  4059 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.277943  4091 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:00.279318  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2225) took 1346 ms. Trace:
I20260709 13:00:00.279049  4085 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.279726  1614 rpcz_store.cc:276] 0709 12:59:58.933352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.580976 (+647624us) service_pool.cc:224] Handling call
0709 12:59:59.864450 (+283474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.167814 (+303364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.279131 (+111317us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54001400d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:00.279270 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468771072}
W20260709 13:00:00.282291  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 479) took 1753 ms (client timeout 1741 ms). Trace:
I20260709 13:00:00.243381  1584 leader_election.cc:400] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
W20260709 13:00:00.301867  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 58621.5us
W20260709 13:00:00.302958  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.303313  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:00.145233  4082 consensus_meta.cc:287] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.003s
I20260709 13:00:00.220938  2272 rpcz_store.cc:276] 0709 12:59:58.841677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.841783 (+   106us) service_pool.cc:224] Handling call
0709 13:00:00.072162 (+1230379us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80eee 0000000000375939 00007f29f0cf41e0 00007f29f0dbd0c4 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:00:00.110884 (+ 38722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.111065 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.111099 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.111151 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:00.111196 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.111257 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.111368 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5723264}
I20260709 13:00:00.283771  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2211) took 1387 ms. Trace:
I20260709 13:00:00.285349  4080 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:00.291604  4054 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.294394  1617 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:00.313303  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:00.295640  4083 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:00.296502  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2218) took 1396 ms. Trace:
I20260709 13:00:00.299568  2241 leader_election.cc:400] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5.
W20260709 13:00:00.260779  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 480) took 1731 ms (client timeout 1659 ms). Trace:
W20260709 13:00:00.310228  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 245301us
I20260709 13:00:00.314759  1613 rpcz_store.cc:276] 0709 12:59:58.899834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.911076 (+ 11242us) service_pool.cc:224] Handling call
0709 12:59:58.937204 (+ 26128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.157142 (+1219938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.296311 (+139169us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001405d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:00.296453 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2574582144}
I20260709 13:00:00.236783  1611 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:00.261439  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 536) took 1549 ms. Trace:
W20260709 13:00:00.315393  1685 rpcz_store.cc:269] 0709 12:59:58.529015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.541029 (+ 12014us) service_pool.cc:224] Handling call
0709 13:00:00.260594 (+1719565us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540012ff54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:00.260704 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3562787072}
I20260709 13:00:00.317487  1545 rpcz_store.cc:276] 0709 12:59:58.712347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.713084 (+   737us) service_pool.cc:224] Handling call
0709 12:59:59.185189 (+472105us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b5800004e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:59.185385 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.215816 (+1030431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.261255 (+ 45439us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54002c0e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:00.261390 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230623360}
I20260709 13:00:00.242051  1537 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
W20260709 13:00:00.301443  1690 rpcz_store.cc:269] 0709 12:59:58.528745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.541569 (+ 12824us) service_pool.cc:224] Handling call
0709 13:00:00.282114 (+1740545us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54002e40d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:00.282229 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3466914176}
I20260709 13:00:00.309552  1541 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
W20260709 13:00:00.310035  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 127514us
I20260709 13:00:00.308547  1615 rpcz_store.cc:276] 0709 12:59:58.896794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.900605 (+  3811us) service_pool.cc:224] Handling call
0709 13:00:00.283610 (+1383005us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54001126d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:00.283698 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022131072}
I20260709 13:00:00.324059  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:00.324661  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.325263  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 720) took 1496 ms. Trace:
I20260709 13:00:00.327992  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:00.330242  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:00.333077  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.334671  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.336138  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.337141  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.255722  3978 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:00.339210  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.307781  4071 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:00.378970  1620 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:00.378886  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.353832  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.325621  2276 rpcz_store.cc:276] 0709 12:59:58.828447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.828616 (+   169us) service_pool.cc:224] Handling call
0709 12:59:59.922016 (+1093400us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 12:59:59.922173 (+   157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.922345 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:00.025609 (+103264us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.324972 (+299363us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.325019 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:00.325060 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.325119 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.325216 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":348,"prepare.queue_time_us":122026,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"spinlock_wait_cycles":4951296,"thread_start_us":386649,"threads_started":2}
I20260709 13:00:00.341768  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.378844  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:00.365507  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.352936  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.316425  4066 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:00.312871  4059 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.383435  1584 leader_election.cc:400] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
W20260709 13:00:00.385582  2241 connection.cc:256] RPC call timeout handler was delayed by -1.8848411179999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:00:00.431221  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 47928.3us
W20260709 13:00:00.431694  2241 connection.cc:256] RPC call timeout handler was delayed by -1.7624411180000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 13:00:00.309494  4047 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:00.432029  2241 connection.cc:256] RPC call timeout handler was delayed by -1.7516411180000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
I20260709 13:00:00.310854  4080 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:00.429558  1614 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:00.436645  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.329500  4121 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:00.429804  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.386807  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.328775  4048 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:00:00.442014  1688 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:00.341912  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.340715  4092 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:00.449157  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.309734  4082 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.411302  4116 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:00:00.328639  4104 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:00:00.435385  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.437693  1691 raft_consensus.cc:2393] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:00.437889  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.436841  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:00.439076  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.516660  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.517270  1616 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:00.517998  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.439195  1613 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:00.439908  1619 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:00.440362  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.519243  1689 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:00.519996  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.351727  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.414291  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:00.333724  4043 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:00.462325  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.493523  1620 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.521013  1685 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 13:00:00.447670  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:00.504300  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.379217  4063 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:00.410080  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.524473  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 186229us
W20260709 13:00:00.525084  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.525281  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.524809  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.526563  1509 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.450578  4119 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:00.387187  4081 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.513422  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 174306us
I20260709 13:00:00.382318  4083 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:00.442072  4107 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:00:00.529737  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.532863  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:00.520408  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 87958.3us
I20260709 13:00:00.521864  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:00.523396  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 86624.1us
I20260709 13:00:00.534261  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.436264  3819 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:00.523934  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.508745  1618 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:00.379160  3772 consensus_queue.cc:1059] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:00:00.509578  4092 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:00.527485  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 89659.9us
I20260709 13:00:00.528762  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.538584  1614 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:00.529372  1612 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:00.530833  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:00.538846  1509 leader_election.cc:336] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.518s (SENT)
I20260709 13:00:00.506753  4059 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:00.442065  3910 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:00:00.430488  4071 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.451107  2272 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:00.443830  4047 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:00.513907  4121 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:00.570019  4121 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.573371  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2213) took 1676 ms. Trace:
I20260709 13:00:00.439664  3960 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:00:00.534374  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:00.536820  1688 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:00.580160  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 45890.9us
I20260709 13:00:00.538461  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.526661  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.539542  1691 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:00.523804  4011 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.524083  4043 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.532692  4063 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:00.539671  1509 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.574s (SENT)
I20260709 13:00:00.540082  4023 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:00.540084  4039 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:00.545535  3824 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:00.552515  1620 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:00.606966  4039 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.607930  1620 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:00:00.555055  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.609000  4039 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:00.535542  3985 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.528493  3978 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:00.555109  3772 raft_consensus.cc:3055] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:00.610329  3772 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:00.611228  3772 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.612620  3772 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:00.612989  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.613711  1618 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:00.563100  4117 consensus_meta.cc:287] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.003s
I20260709 13:00:00.614611  1618 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:00.615724  1618 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:00.544165  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.540200  3819 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.616734  1618 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:00.616760  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 72704.9us
I20260709 13:00:00.618059  1618 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:00.618255  4117 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.618465  3819 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.618650  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:00.617628  1660 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.568739  4047 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:00.573937  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 158336us
W20260709 13:00:00.534518  2241 connection.cc:256] RPC call timeout handler was delayed by -1.6805411180000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:00:00.620256  2241 connection.cc:256] RPC call timeout handler was delayed by -1.63135072700004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:00:00.620597  2241 connection.cc:256] RPC call timeout handler was delayed by -1.6058411180000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 13:00:00.620699  3819 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:00.620909  2241 connection.cc:256] RPC call timeout handler was delayed by -1.533841117999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 13:00:00.621294  2241 connection.cc:256] RPC call timeout handler was delayed by -1.4600411179999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22850000000000004s for a response
W20260709 13:00:00.621605  4130 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.370s	user 0.000s	sys 0.002s
W20260709 13:00:00.621685  2241 connection.cc:256] RPC call timeout handler was delayed by -1.3990013789999693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2866s for a response
I20260709 13:00:00.623044  4000 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:00.623216  3819 consensus_queue.cc:1059] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:00.623540  4000 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.624402  4117 raft_consensus.cc:3055] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:00.624788  4117 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:00.625821  4000 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:00.625602  4117 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:00.627924  4117 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:00.629050  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.629752  1613 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:00.577859  2270 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:00.584134  1619 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:00.573807  1617 rpcz_store.cc:276] 0709 12:59:58.897454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.897863 (+   409us) service_pool.cc:224] Handling call
0709 12:59:58.910149 (+ 12286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.316147 (+1405998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.573130 (+256983us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400056ed4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:00.573306 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3182608256}
W20260709 13:00:00.597536  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 59136.3us
W20260709 13:00:00.598361  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 58740.5us
W20260709 13:00:00.631784  1509 leader_election.cc:336] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.612s (SENT)
I20260709 13:00:00.632148  1509 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.598356  1694 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 13:00:00.601958  4043 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:00.579460  4017 consensus_queue.cc:1059] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:00:00.647943  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.648062  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:00.648589  1509 leader_election.cc:336] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.762s (SENT)
I20260709 13:00:00.648953  1694 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 13:00:00.602073  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.602555  3907 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:00.602842  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.603639  4091 consensus_queue.cc:1059] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:00.619342  1685 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:00.568234  4055 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.619298  1536 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:00.632529  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.663601  4047 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:00.654661  4017 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:00.655254  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53120c1adf947fd992e5950edf26301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:00.664374  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:00.664706  4017 raft_consensus.cc:3055] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:00.659438  1617 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:00.665737  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.667228  1693 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:00.668066  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.633386  2243 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:00.634209  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.658280  4091 raft_consensus.cc:3055] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:00.671219  4091 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:00.672039  4091 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.673194  4091 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:00.674870  4047 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:00.675079  4133 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:00.675482  4047 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:00.675927  3819 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.676493  4047 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:00.678738  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.679834  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.680416  1691 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:00.680548  1611 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:00.661670  4070 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.683157  3819 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.683772  3819 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.686833  4141 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.687311  4141 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.635690  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 464) took 1722 ms. Trace:
I20260709 13:00:00.689417  1612 rpcz_store.cc:276] 0709 12:59:58.913144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.551931 (+638787us) service_pool.cc:224] Handling call
0709 12:59:59.625008 (+ 73077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.539060 (+914052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.635426 (+ 96366us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400140ad4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:00.635621 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079289216}
W20260709 13:00:00.649557  1509 leader_election.cc:336] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.880s (SENT)
I20260709 13:00:00.653234  2241 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.668817  1694 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:00.690999  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 56877.4us
W20260709 13:00:00.691368  1509 leader_election.cc:336] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.925s (SENT)
I20260709 13:00:00.691931  1509 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.630653  1613 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:00.692876  1688 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:00.535996  4081 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:00.693516  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.693846  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.675591  4133 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.694262  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.637339  4083 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:00.660631  4129 raft_consensus.cc:3055] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:00.701267  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 48117.1us
I20260709 13:00:00.565706  4059 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.708093  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.704001  3643 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.716766  1611 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:00.717267  4128 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:00.717690  4142 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:00.718118  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:00.718837  4142 raft_consensus.cc:3055] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:00.719208  4142 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:00.720078  4142 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:00.703857  4086 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.005s
I20260709 13:00:00.665139  4017 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:00.762640  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 54620.6us
I20260709 13:00:00.710353  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.712323  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:00.703682  1509 leader_election.cc:336] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.937s (SENT)
I20260709 13:00:00.713573  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:00.713802  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:00.713984  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.766489  1545 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 13:00:00.766769  1688 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.767088  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.732895  1541 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 13:00:00.697405  1690 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
W20260709 13:00:00.767268  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 63607.1us
I20260709 13:00:00.768563  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.689461  4116 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:00.769611  1538 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:00.766649  1544 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:00.637151  3933 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:00:00.781143  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.774216  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.783032  1538 raft_consensus.cc:2368] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:00.783746  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.707540  4133 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.728421  1536 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:00.777537  3910 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.779830  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.785730  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 73458.9us
I20260709 13:00:00.787303  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.784699  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:00.707070  3960 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:00.711802  4066 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:00.726356  4059 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.711993  4129 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:00.721544  3819 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.726013  4082 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.790903  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.769563  4141 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.776109  4142 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.785374  4128 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:00.803457  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:00.836580  1691 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:00.826463  1538 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:00:00.786334  4074 consensus_meta.cc:287] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.005s
I20260709 13:00:00.797521  4060 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:00:00.827203  3910 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.843825  4081 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:00.838176  3819 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:00.844887  3910 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.844954  3819 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.845762  3819 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.835028  4017 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.857504  4043 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.858343  4128 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.858820  4128 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.860610  4128 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:00.863013  1692 raft_consensus.cc:606] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:00.863209  1616 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:00.863425  1692 raft_consensus.cc:614] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:00.863936  1686 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:00.864715  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.865172  1691 raft_consensus.cc:2376] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2. Re-sending same reply.
I20260709 13:00:00.866012  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.866884  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.775555  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.721932  4061 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:00.793574  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.872540  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.831696  1688 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:00.825475  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.873261  1691 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:00.873690  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 48284.6us
I20260709 13:00:00.874146  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.875061  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:00.875434  4081 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.876605  4041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe29c0d913c42cfb39d487a69abfd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:00.797086  3978 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:00.835377  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.835517  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:00.797243  4036 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:00.804059  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:00.877347  1612 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
W20260709 13:00:00.837678  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 46974.8us
I20260709 13:00:00.880180  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:00.724817  4063 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.889668  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.878808  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:00.881575  1537 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:00.892515  1545 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:00.893421  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:00.894272  2276 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:00.895175  3987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45402 (request call id 732) took 7851 ms. Trace:
I20260709 13:00:00.896142  4055 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:00.896541  4055 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:00.896893  4055 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.898788  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.899236  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.899876  1693 raft_consensus.cc:2368] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:00.900553  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.900580  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.901299  1693 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:00.902036  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.902170  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.903000  4061 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:00.903530  4061 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:00.903923  4061 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:00.906813  3978 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:00.908617  4043 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:00.908944  3978 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.886152  4036 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:00.909621  4036 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.909847  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:00.914489  3643 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:00.914901  3643 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:00.914949  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:00.915294  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:00.915612  2271 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 13:00:00.886466  2272 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:00.889673  4129 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.917050  4129 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.877321  2241 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.918226  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:00.918522  1509 leader_election.cc:336] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.728s (SENT)
W20260709 13:00:00.919286  1509 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.740s (SENT)
I20260709 13:00:00.916013  3772 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:00.915798  3643 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.919251  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:00.920735  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.903060  4034 raft_consensus.cc:3055] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:00.922885  1685 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
W20260709 13:00:00.923002  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 45754.1us
I20260709 13:00:00.923615  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.923925  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:00.866755  4066 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:00.925596  1612 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:00.926208  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.925499  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.926878  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.927211  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.927275  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.927731  1693 raft_consensus.cc:2368] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6.
I20260709 13:00:00.928709  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.924480  3772 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.928985  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:00.804194  4092 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:00.940490  1691 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.929626  4104 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:00:00.941970  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:00.942569  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.942709  1685 raft_consensus.cc:2410] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:00.946148  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.947609  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:00.946426  1585 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:00.949383  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.950026  1620 raft_consensus.cc:2368] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:00.949950  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.950958  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.951599  1614 raft_consensus.cc:2393] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:00.955140  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.955940  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.956269  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.956645  1620 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 2: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:00.957585  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.961010  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.961668  1619 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:00.962632  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.963171  1685 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:00.925457  4034 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:00.925918  3910 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.964627  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.961246  1613 raft_consensus.cc:2376] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4. Re-sending same reply.
I20260709 13:00:00.930032  4000 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:00.939340  4100 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.930608  4099 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:00.966629  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.930122  4128 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:00.885437  1690 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 13:00:00.966632  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.947063  3985 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:00.941049  3772 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.968454  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.968616  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.963856  4043 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:00.940855  4143 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.970947  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.939203  4116 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:00.944728  4008 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:00.929977  3960 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.973891  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.993533  1619 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:00.967681  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.969949  1614 raft_consensus.cc:2376] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7. Re-sending same reply.
I20260709 13:00:00.975252  1685 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:00.976220  1611 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:00.969213  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:00.978003  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:00.966192  3907 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.979735  4000 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:01.005357  1511 leader_election.cc:400] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:01.005683  1511 leader_election.cc:403] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:01.006295  1511 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:00.895592  3987 rpcz_store.cc:276] 0709 12:59:53.039053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.042733 (+  3680us) service_pool.cc:224] Handling call
0709 12:59:53.155313 (+112580us) ts_tablet_manager.cc:934] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
0709 13:00:00.653824 (+7498511us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:00.778839 (+125015us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:00.778978 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:00.889832 (+110854us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:00.890104 (+   272us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:00.890386 (+   282us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:00.890479 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":58314,"tablet-copy.queue_time_us":62510,"thread_start_us":198108,"threads_started":2}
I20260709 13:00:00.965972  4059 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:00.968770  4071 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:00.964130  3978 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:00.996639  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:00.997063  1690 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:00.998800  4080 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:00.996191  1617 raft_consensus.cc:2376] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8. Re-sending same reply.
I20260709 13:00:01.013794  4154 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:01.014485  4154 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:01.007634  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.969938  4074 consensus_queue.cc:1059] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:00:01.013866  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 73759.5us
I20260709 13:00:01.014122  1617 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:01.015687  2241 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.015527  4154 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.017036  4154 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.015906  1690 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:01.018164  1690 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.010399  1691 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:01.020130  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:01.021318  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:01.024631  1691 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.971225  3694 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:00:01.026422  3941 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:00:01.031644  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:01.032197  1685 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 13:00:01.032991  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:00.990144  4008 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:00.974958  4133 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.030655  4034 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.010201  3907 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:01.039427  1612 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:01.007025  4043 raft_consensus.cc:697] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:01.010399  4059 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:01.046883  4059 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:01.032042  3933 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:01.035439  4116 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:01.046227  1691 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:01.036444  3978 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:01.066998  1685 raft_consensus.cc:2410] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:01.067404  3978 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:01.010552  4036 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.075930  1691 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:01.031297  3910 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:01.078840  3910 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:01.079159  3910 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:01.057104  4017 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.058712  4081 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:01.034246  4086 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:00:01.061322  4133 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:01.061908  2272 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:01.064466  3985 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.026994  3824 consensus_queue.cc:1059] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:00:01.086450  3824 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:01.086885  3824 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:01.087733  3824 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.055946  4008 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.039361  4152 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:01.027370  3819 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.081477  1694 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:01.053825  3694 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:01.090868  4121 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:01.091235  3694 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:01.092128  3819 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:01.091980  3694 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.093264  3694 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:01.093318  4143 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:01.083958  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 68335.3us
I20260709 13:00:01.094295  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.095408  4155 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:01.095788  4155 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:01.096053  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:01.096225  4155 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:01.096401  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:01.095826  4008 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:01.089135  3824 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.041147  4055 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.102644  4086 consensus_queue.cc:1243] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:01.109539  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:01.111492  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:01.112512  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 106284us
I20260709 13:00:01.113924  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.115643  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.079710  3987 tablet_copy_client.cc:806] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:01.117745  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:01.118644  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 109493us
W20260709 13:00:01.121769  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 201050us
I20260709 13:00:01.121958  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.124727  1509 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:01.125010  1511 leader_election.cc:336] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.594s (SENT)
I20260709 13:00:01.125732  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.121850  1584 leader_election.cc:400] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:01.126377  1584 leader_election.cc:403] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:00:01.126161  4099 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:01.107264  4034 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:01.132647  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.132689  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.133445  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.133581  1509 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.118643  2268 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:01.118928  3985 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:01.149412  2273 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:01.130178  3933 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.160446  1511 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.131666  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:01.145701  3987 tablet_copy_client.cc:670] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:01.159909  1509 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.126967  4152 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:01.139062  4085 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:01.131409  4047 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:01.167474  1618 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:01.135779  3941 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:01.138144  3772 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.147505  4100 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:01.178263  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48306 (request call id 18) took 1144 ms. Trace:
I20260709 13:00:01.135838  4074 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:00:01.175124  4099 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.130184  4121 consensus_queue.cc:1059] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:00:01.249425  1692 rpcz_store.cc:276] 0709 13:00:00.026608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.026841 (+   233us) service_pool.cc:224] Handling call
0709 13:00:01.171047 (+1144206us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400125554. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd9f853 00007f29f0d6d60a 00007f29ea2f37d4 00007f29ea2f3762 00007f29ea2f3691 00007f29ea2f360c 00007f29ea2f28c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:01.171148 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574931200}
I20260709 13:00:01.131543  4043 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.262458  1612 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:01.160321  4143 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
W20260709 13:00:01.276530  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 116635us
I20260709 13:00:01.277431  1509 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.251622  4152 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:01.261840  4091 consensus_meta.cc:287] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260709 13:00:01.154165  4081 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:01.282910  4153 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:01.281807  4081 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:01.285355  4081 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:01.291116  4055 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:01.263228  3985 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:01.303517  1509 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:01.308743  1509 leader_election.cc:400] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6.
I20260709 13:00:01.307271  3941 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:01.310192  4153 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:01.158383  3910 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.317413  1509 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.312834  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:01.315129  1685 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:01.322733  1509 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.324095  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:01.328416  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 167983us
I20260709 13:00:01.319293  4085 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:01.326984  4153 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:01.327162  3933 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:01.330314  4036 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:01.330821  4152 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:01.321620  3985 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:01.353593  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.360850  1616 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:01.354211  4157 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:01.352435  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:01.362908  1687 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:01.369267  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:01.370244  1694 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:01.378130  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:01.379132  1694 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:01.382457  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 53599.5us
I20260709 13:00:01.383949  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:01.384977  1691 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:01.385890  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:01.311086  3941 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.388185  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:01.383625  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:01.392366  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:01.393203  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:01.394716  1584 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:01.396507  4155 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.392477  1509 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.400122  1545 raft_consensus.cc:2393] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:01.406363  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:01.406989  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:01.407188  1543 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:01.363397  4152 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.410785  1544 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:01.358491  3824 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:00:01.416460  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.417135  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.418685  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:01.388538  4143 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.419859  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:01.420075  3985 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.420733  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:01.421836  2274 raft_consensus.cc:3055] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:01.422125  2274 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:01.390048  4153 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:00:01.423444  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:01.405711  4121 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:01.407732  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 76165.7us
I20260709 13:00:01.425941  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:01.405433  3978 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:01.406451  3694 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:00:01.398289  4092 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:01.434830  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:01.437930  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:01.426935  2274 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.439889  4155 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:01.440548  4168 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:01.441095  1690 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:01.442159  4161 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:00:01.446662  1685 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:01.413374  4152 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.455468  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:01.458153  2275 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:01.432883  3772 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:01.459782  1659 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.464293  1659 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:01.427158  4143 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.466260  1690 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:01.466741  4143 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:01.466874  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1540) took 1098 ms. Trace:
I20260709 13:00:01.467669  1690 rpcz_store.cc:276] 0709 13:00:00.368665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.986824 (+618159us) service_pool.cc:224] Handling call
0709 13:00:00.987132 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.440916 (+453784us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b58002402d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd010aa 00007f29ebd83447 00007f29ebd9bfe7 00007f29ebd9d7de 00007f29ebda7b49 00007f29ebda8416 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4
0709 13:00:01.466632 (+ 25716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.466825 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228547328}
I20260709 13:00:01.468971  1690 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 4. Ops: []
I20260709 13:00:01.456542  3933 raft_consensus.cc:697] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:01.469894  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:01.470059  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2192) took 1105 ms. Trace:
I20260709 13:00:01.470168  3933 consensus_queue.cc:237] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.470384  1686 rpcz_store.cc:276] 0709 13:00:00.364808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.364930 (+   122us) service_pool.cc:224] Handling call
0709 13:00:01.469915 (+1104985us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400125554. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:01.470010 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981072256}
I20260709 13:00:01.471117  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:01.471750  1619 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:01.475260  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:01.476370  1685 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:01.476572  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:01.476755  2274 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.477108  1614 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.433583  4081 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.484476  2275 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:01.486238  2275 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:01.490404  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.493811  2275 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:01.456386  4085 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:01.495085  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:01.477527  4091 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:01.463418  4099 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:01.480799  4054 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:00:01.499807  2271 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:01.501730  2275 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:01.480799  4168 raft_consensus.cc:697] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:01.456183  4092 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.513231  1614 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:01.505304  1685 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:01.521536  2243 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:01.514961  4055 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.531551  2268 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:01.529760  4055 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.532498  4085 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.533730  4055 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:01.531906  4061 consensus_meta.cc:287] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
I20260709 13:00:01.541899  1619 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:01.550601  1685 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:01.551556  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:01.510836  4159 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:01.504222  4082 consensus_queue.cc:1059] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:00:01.530278  4074 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:01.530509  3772 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:01.561710  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:01.563839  1619 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:01.538826  4170 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:00:01.526350  3907 consensus_queue.cc:1059] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:01.526196  4008 consensus_queue.cc:1059] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:01.528460  4083 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:01.527760  4104 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:01.580947  2272 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:01.581564  1685 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:01.583909  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.551175  4061 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:01.585418  1688 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:01.557956  4155 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:01.586221  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:01.590222  2274 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:01.590165  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.591022  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:01.592073  1544 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:01.592144  1545 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:01.592327  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:01.592903  1543 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.600332  4061 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:01.600615  4155 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:01.601501  4155 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.604218  2241 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.609007  1542 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:01.597643  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:01.627439  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.628826  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.616724  1545 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
W20260709 13:00:01.622427  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 2.056s (SENT) [suppressed 52 similar messages]
I20260709 13:00:01.624461  1543 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:01.631464  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:01.634773  1688 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:01.635459  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:01.635731  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:01.636458  1543 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 13:00:01.588160  3772 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:01.638422  1537 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:01.639969  1545 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:01.652834  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 13:00:01.653514  1688 raft_consensus.cc:606] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.653918  1688 raft_consensus.cc:614] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:01.658340  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:01.658905  1537 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.665638  1545 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:01.616223  4143 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:01.638447  4133 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.634846  4034 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.654515  4055 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:01.629879  3694 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:00:01.596418  3933 consensus_queue.cc:1059] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:00:01.635172  3824 consensus_queue.cc:1059] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:00:01.674407  1537 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:01.652717  4159 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:01.686818  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 100657us
I20260709 13:00:01.687150  4187 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.688450  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:01.687666  4187 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.671295  4180 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:01.677213  4055 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.670121  4099 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:00:01.683439  4143 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:01.715405  4092 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:01.715582  2269 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:01.711680  3772 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.707896  1584 leader_election.cc:400] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:01.682799  4081 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:01.690115  4159 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:01.706290  4059 consensus_meta.cc:287] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.000s
I20260709 13:00:01.727883  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:00:01.728668  1540 raft_consensus.cc:606] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:01.729138  1540 raft_consensus.cc:614] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:01.731386  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 102613us
I20260709 13:00:01.594026  4168 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:01.710096  4055 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:01.725289  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.745730  4066 raft_consensus.cc:3055] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:01.744915  4172 raft_consensus.cc:3055] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:01.747951  1511 leader_election.cc:336] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.630s (SENT)
I20260709 13:00:01.692718  4175 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:00:01.761112  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2207) took 1233 ms. Trace:
I20260709 13:00:01.761759  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.761497  1693 rpcz_store.cc:276] 0709 13:00:00.527715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.928426 (+400711us) service_pool.cc:224] Handling call
0709 13:00:01.757288 (+828862us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b5400304154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:01.761055 (+  3767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055592192}
I20260709 13:00:01.764040  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:01.765260  1538 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:00:01.769660  2276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45390 (request call id 772) took 1355 ms (client timeout 1754 ms). Trace:
I20260709 13:00:01.749734  4066 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:01.754421  4172 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:01.770073  2276 rpcz_store.cc:269] 0709 13:00:00.414006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.414107 (+   101us) service_pool.cc:224] Handling call
0709 13:00:01.769510 (+1355403us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54004790d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:01.769609 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559853824}
I20260709 13:00:01.771554   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:01.753723  4143 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:00:01.736269  4059 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.795068  1543 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:01.798213  1543 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:01.761456  4081 consensus_queue.cc:1059] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:00:01.799014  1543 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:01.802762  4181 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:01.807660  3643 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:01.822003  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 199569us
I20260709 13:00:01.831482  1543 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:01.848722  1543 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:01.768301  4162 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 13:00:01.851688  4163 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.372s	user 0.001s	sys 0.001s
I20260709 13:00:01.834312  4180 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:01.878913  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 117217us
I20260709 13:00:01.792105  4066 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.879855  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:01.882323  1511 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.766s (SENT)
W20260709 13:00:01.882813  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.841310  4189 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:01.887512  1511 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.796060  4172 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.888782  3643 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.889446  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.894835  2275 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:01.904232  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:01.833386  4159 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.916706  1544 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:01.917898  1536 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 4. Ops: []
I20260709 13:00:01.885463  4117 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:01.924278  1509 leader_election.cc:336] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.627s (SENT)
W20260709 13:00:01.919462  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 153366us
I20260709 13:00:01.894255  4194 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:01.903319  4066 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:01.926779  2275 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:01.923856  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:01.930073  4117 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:01.930716  4197 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:01.919951  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:01.933485  2274 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:01.935793  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:01.905382  4187 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:01.931792  3978 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:01.946213  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 195454us
I20260709 13:00:01.948468  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:01.961560  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.976225  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.995586  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:01.996923  4184 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:01.997440  4184 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:02.006448  1544 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:01.936209  4194 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:01.946614  4086 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:02.030926  4086 raft_consensus.cc:697] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:02.031957  4086 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.923033  4185 consensus_queue.cc:1059] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.251s
I20260709 13:00:02.034027  4185 raft_consensus.cc:3055] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:02.034394  4185 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:02.034839  4059 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:01.948925  3978 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:02.032507  4188 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:00:01.995137  4187 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:02.048012  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 738) took 1140 ms. Trace:
W20260709 13:00:02.049054  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 113268us
I20260709 13:00:02.049713  2273 rpcz_store.cc:276] 0709 13:00:00.907846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.909586 (+  1740us) service_pool.cc:224] Handling call
0709 13:00:02.047797 (+1138211us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400427a54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:02.047947 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448088832}
I20260709 13:00:02.014750  4197 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:02.055984  4176 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:00:02.068078  4204 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:00:02.069254  4204 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:02.069602  4204 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:02.071947  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 130228us
I20260709 13:00:02.045189  3978 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:02.073732  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 67053.1us
I20260709 13:00:02.070402  4204 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.035233  4185 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:01.944774  4180 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.083267  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:02.070809  4048 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:00:02.007862  4189 consensus_queue.cc:1059] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:00:02.042575  4117 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.059082  4187 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:02.094089  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.998282  4184 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.105726  2275 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:02.103048  4195 consensus_queue.cc:1059] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 13:00:02.106101  4183 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:00:02.109768  4193 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:00:02.082862  4200 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:00:02.112797  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.085747  4204 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:02.091477  4121 consensus_meta.cc:287] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 13:00:02.123867  2273 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 13:00:02.143024  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:02.145356  1539 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.094624  4187 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:02.137184  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:02.138181  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:02.090651  3772 raft_consensus.cc:3055] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:02.150403  1693 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:02.093057  4117 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:02.153744  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:02.154323  1543 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.155331  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:02.160089  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:02.146173  1585 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:02.148944  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:02.161386  1690 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:02.143887  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:02.163558  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:02.163429  1540 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:02.165122  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:02.165387  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:02.167569  1540 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:02.097955  4194 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.172304  1543 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:02.173635  4048 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.174575  4048 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:02.164211  4189 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:02.162075  4119 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:02.176299  4189 raft_consensus.cc:697] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:02.176666  4176 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:02.177192  4176 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:02.176431  4119 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.147194  4121 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:02.174295  4210 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:02.178390  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:02.151386  3772 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:02.162521  4011 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:02.164049  4063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.000s	sys 0.014s
I20260709 13:00:02.178015  4048 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:02.194739  4119 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:02.168015  4187 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:02.199700  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:02.167188  3694 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:00:02.201442  4063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.000s	sys 0.015s
I20260709 13:00:02.177424  4189 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.191612  4176 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.197089  4210 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:02.206107  4054 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:02.263397  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:02.258936  3643 consensus_queue.cc:1059] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:00:02.260021  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:02.269745  1618 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:02.218945  4158 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.221076  4187 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:02.220570  4121 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:02.281780  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:02.251529  4160 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.122s	user 0.000s	sys 0.008s
W20260709 13:00:02.267220  4100 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:00:02.243366  4154 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:02.258200  4080 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:02.291312  4134 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:00:02.260797  4071 raft_consensus.cc:3055] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:02.296818  4055 consensus_meta.cc:287] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.002s
I20260709 13:00:02.245882  4210 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.291975  3772 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:02.299887  4133 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 13:00:02.258814  4119 consensus_queue.cc:1059] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:00:02.304554  1539 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:02.304724  4071 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:02.310654  4133 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:02.287251  4121 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.303381  4154 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.328670  1688 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:02.329027  1619 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:02.329229  1690 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:02.329373  1619 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:02.330284  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:02.272305  4158 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.313836  3772 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.333060  1690 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:02.330161  1619 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:02.430194  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.430347  1619 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.417218  2277 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:02.307184  4055 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.430924  2274 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:02.340400  4043 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:02.456517  1690 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:02.402366  2268 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:02.454128  1619 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:00:02.457700  1619 pending_rounds.cc:85] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 4
W20260709 13:00:02.458186  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.459503  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 741) took 1423 ms. Trace:
I20260709 13:00:02.460179  1690 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:02.463654  4206 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.464212  4206 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.459987  2270 rpcz_store.cc:276] 0709 13:00:01.036382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.036518 (+   136us) service_pool.cc:224] Handling call
0709 13:00:01.045571 (+  9053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.045892 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.045919 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.046348 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.103840 (+ 57492us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:01.103879 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.103939 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.250900 (+1146961us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:02.416770 (+165870us) raft_consensus.cc:1685] finished
0709 13:00:02.416798 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.459421 (+ 42623us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2538,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":25904,"spinlock_wait_cycles":4898048,"thread_start_us":56777,"threads_started":1,"wal-append.queue_time_us":81854}
I20260709 13:00:02.305950  4181 consensus_queue.cc:1059] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:02.430357  4195 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:02.458006  1619 pending_rounds.cc:107] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:02.482892  1619 raft_consensus.cc:2889] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:02.481570  4146 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.485816  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 434192us
I20260709 13:00:02.492816  4220 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:02.484704  4146 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:02.497395  4041 consensus_meta.cc:287] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.814s	user 0.009s	sys 0.001s
I20260709 13:00:02.338549  4071 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.496613  4189 raft_consensus.cc:3055] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:02.589123  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1538) took 2218 ms. Trace:
I20260709 13:00:02.591116  1687 rpcz_store.cc:276] 0709 13:00:00.368122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.368372 (+   250us) service_pool.cc:224] Handling call
0709 13:00:00.429523 (+ 61151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.372532 (+943009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.586090 (+1213558us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b5400372b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:02.586301 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2145855872}
I20260709 13:00:02.484067  4194 consensus_queue.cc:1059] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:00:02.467088  4043 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.487185  4195 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:02.599437  4152 consensus_meta.cc:287] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.140s	user 0.012s	sys 0.000s
I20260709 13:00:02.613914  1545 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:02.591004  4189 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:02.592723  4220 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.595101  4181 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.617189  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:02.618566  1614 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:02.621852  1687 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:02.616237  4199 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.505s	user 0.002s	sys 0.000s
I20260709 13:00:02.604156  4071 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:02.626267  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.617873  4194 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.617688  4154 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:02.630976  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.621083  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45402 (request call id 738) took 5931 ms. Trace:
W20260709 13:00:02.634738  4212 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:00:02.617300  4152 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.643499  1544 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:02.641993  4146 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:02.648967  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:02.649766  1690 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
W20260709 13:00:02.636657  4219 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:00:02.626888  4220 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.630456  4206 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:02.658399  4218 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:00:02.662791  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:02.664757  1614 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:02.665925  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:02.665122  4226 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.671247  4154 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:02.671675  4154 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.652455  4121 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:02.652225  4055 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:02.634148  4194 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.627679  4181 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:02.678972  3978 consensus_meta.cc:287] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
W20260709 13:00:02.679139  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.679381  3978 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.682137  4220 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:02.683175  3978 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:02.691063   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:02.694121  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2231) took 1745 ms. Trace:
I20260709 13:00:02.694466  1616 rpcz_store.cc:276] 0709 13:00:00.948485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.948619 (+   134us) service_pool.cc:224] Handling call
0709 13:00:00.972592 (+ 23973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.361266 (+388674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.693921 (+1332655us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54001a36d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:02.694072 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892357888}
I20260709 13:00:02.695235  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 543) took 1079 ms. Trace:
I20260709 13:00:02.695590  1536 rpcz_store.cc:276] 0709 13:00:01.615444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.615543 (+    99us) service_pool.cc:224] Handling call
0709 13:00:01.917683 (+302140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.918389 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.695079 (+776690us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400354b50. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:02.695191 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606921600}
I20260709 13:00:02.672106  4154 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:02.637148  4189 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.700126  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:02.701968  1537 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:02.663103  4158 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:02.711887  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:02.712616  1541 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:02.710114  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:02.700838  4155 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.715586  1539 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:02.721200  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.717031  3987 tablet_copy_client.cc:538] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:02.731143  4194 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:02.704864  4055 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:00:02.720849  4189 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.741770  4099 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.743023  4085 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:02.743376  4085 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:02.720065  4043 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:02.671337  4226 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.743669  4181 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:02.723839  4155 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.636932  4041 rpcz_store.cc:276] 0709 12:59:56.695796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.695931 (+   135us) service_pool.cc:224] Handling call
0709 12:59:57.231514 (+535583us) ts_tablet_manager.cc:934] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
0709 13:00:00.875455 (+3643941us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:01.641868 (+766413us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:01.664356 (+ 22488us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:02.497802 (+833446us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:02.595931 (+ 98129us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:02.617448 (+ 21517us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:02.619810 (+  2362us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":9754,"tablet-copy.queue_time_us":423553,"thread_start_us":349389,"threads_started":2}
I20260709 13:00:02.798008  4041 tablet_copy_client.cc:806] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:02.745191  4085 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.799098  4085 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:02.742249  4099 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.804111  4074 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:02.804519  4099 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:02.805181  4099 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.804751  4074 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.805712  4099 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.807356  4061 raft_consensus.cc:3055] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:02.807865  4061 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:02.808851  4061 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.810319  4061 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.813207  4155 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:02.813794  4117 consensus_meta.cc:287] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.001s
I20260709 13:00:02.814265  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:02.814880  1614 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:02.815892  2243 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:02.750424  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:02.764505  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:02.818986  1616 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:02.819126  1543 raft_consensus.cc:2393] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:02.756098  1541 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:02.797070  4172 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:02.820649  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 1559) took 2036 ms (client timeout 2190 ms). Trace:
I20260709 13:00:02.821063  2243 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:02.823163  1542 rpcz_store.cc:269] 0709 13:00:00.786993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.787108 (+   115us) service_pool.cc:224] Handling call
0709 13:00:02.820504 (+2033396us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b5400210cd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:02.820596 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638239104}
I20260709 13:00:02.815824  4041 tablet_copy_client.cc:670] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:02.787478  4159 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.765554  4066 consensus_meta.cc:287] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.829s	user 0.005s	sys 0.005s
I20260709 13:00:02.764360  4055 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.767042  4175 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.762949  4152 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:02.763496  4195 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:02.832090  4155 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:02.876853  4195 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.878388  4066 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:02.834556  3772 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:02.879650  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:02.835495  4210 consensus_meta.cc:287] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
W20260709 13:00:02.883056  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 549610us
W20260709 13:00:02.884075  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.894402  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:02.899830  4223 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:02.886168  4155 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.833556  4159 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.840618  4055 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.894115  3772 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:02.910311  1614 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:02.902628  4074 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:02.909955  4180 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:02.919258  4226 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:02.920352  1614 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:02.921270  1617 raft_consensus.cc:1240] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:02.897625  3556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.011s	sys 0.007s
I20260709 13:00:02.926309  1616 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:02.927738  4099 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:02.931107  4185 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.932070  4055 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:02.932767  4077 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:00:02.934023  3987 tablet_bootstrap.cc:492] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 13:00:02.873594  4175 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:02.931212  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2237) took 1981 ms (client timeout 1766 ms). Trace:
W20260709 13:00:02.942266  1615 rpcz_store.cc:269] 0709 13:00:00.950192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.954944 (+  4752us) service_pool.cc:224] Handling call
0709 13:00:02.930973 (+1976029us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b540036d654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:02.931123 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928492800}
I20260709 13:00:02.894671  4195 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.946698  4175 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:02.944523  3556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.012s	sys 0.008s
I20260709 13:00:02.909472  4155 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:02.897951  4210 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:02.902442  4181 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.925019  4080 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:00:02.923882  3772 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:02.995085  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:02.978173  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:03.013985  1544 raft_consensus.cc:2393] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:02.985890  1541 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:03.015753  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.975409  4175 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.018481  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:02.975064  4055 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.017947  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:03.018239  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:03.025668  1693 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
W20260709 13:00:03.026427  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.979322  4195 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:03.022377  1691 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:03.017024  4221 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:03.023888  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:03.023958  4175 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.976367  4226 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.921785  4231 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:00:03.021293  4060 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.028337  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:03.036567  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 750) took 1349 ms. Trace:
I20260709 13:00:02.977945  1542 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:03.029893  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:03.030459  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:03.037559  1544 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:03.033612  1537 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:03.015059  4099 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.040021  4099 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:02.983314  4085 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.036895  2272 rpcz_store.cc:276] 0709 13:00:01.687305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.687416 (+   111us) service_pool.cc:224] Handling call
0709 13:00:01.687727 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.727110 (+ 39383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.727142 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.735030 (+  7888us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.881611 (+146581us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:01.881645 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.033259 (+1151614us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b54004696d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:03.033303 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.033355 (+    52us) raft_consensus.cc:1685] finished
0709 13:00:03.033372 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.036513 (+  3141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6411,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":13263,"spinlock_wait_cycles":79778560,"thread_start_us":114764,"threads_started":1,"wal-append.queue_time_us":178684}
I20260709 13:00:03.044126  4085 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:03.042913  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:03.039294  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:03.047521  4085 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:03.035343  4159 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:03.027812  4181 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:03.038987  4204 consensus_meta.cc:287] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.889s	user 0.012s	sys 0.000s
I20260709 13:00:03.058337  4085 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:03.051527  1536 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:03.042140  4099 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:03.029069  4055 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:03.060276  4228 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:00:03.032555  4221 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:03.075709  1620 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:03.038378  3556 consensus_queue.cc:1059] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:00:03.078788  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 133264us
I20260709 13:00:03.038724  4226 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:03.045747  4060 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:03.092926  1688 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:03.069700  4162 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:00:03.096253  1615 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:03.098513  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:03.100273  4226 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:03.101003  4066 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:03.102407  4066 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:03.102818  4066 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.103155  4066 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.103609  4055 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:03.104656  4232 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:03.072922  4168 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:00:03.098575  4221 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:03.075237  4085 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:00:03.114954  4077 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.079157  4146 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:00:03.117174  4077 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:03.113709  4055 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.152845  4153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.713s	user 0.004s	sys 0.011s
W20260709 13:00:03.234853  4153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.795s	user 0.010s	sys 0.023s
I20260709 13:00:03.227573  4061 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.184192  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.147918  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:03.155341  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.242832  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.146241  4210 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:03.245137  4061 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:03.256929  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.257059  4061 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:03.245208  3772 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:03.257579  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.248373  4157 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:00:03.252341  4162 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:03.234918  4055 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:03.263567  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:03.265708  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:03.144418  4070 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.279970  1617 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:03.266644  3772 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:03.268132  1658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.022s
W20260709 13:00:03.284890  1658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.004s	sys 0.022s
I20260709 13:00:03.270658  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:03.271582  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:03.286551  1615 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:03.286901  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 783) took 2179 ms. Trace:
I20260709 13:00:03.272189  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:03.272782  2275 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:03.281128  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:03.287856  1614 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:03.275795  2272 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:03.287386  2277 rpcz_store.cc:276] 0709 13:00:01.107921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.110169 (+  2248us) service_pool.cc:224] Handling call
0709 13:00:02.417046 (+1306877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.431130 (+ 14084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.286664 (+855534us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54006185d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:03.286838 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3004625280}
I20260709 13:00:03.290977  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:03.291915  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:03.292107  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:03.120222  4195 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 13:00:03.292484  2277 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 13:00:03.262820  4080 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.294939  1611 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:03.117419  4155 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:03.298835  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:03.306285  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:03.268139  4162 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:03.284359  4175 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:03.340818  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:03.292902  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 257511us
I20260709 13:00:03.266664  4241 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.280191  4176 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:00:03.269652  4000 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:03.349610  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 288859us
W20260709 13:00:03.299547  4154 consensus_meta.cc:287] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 13:00:03.298583  3907 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.253822  4066 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:03.289409  4070 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:03.352314  1615 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:03.475162  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:04.061617  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:04.061739  1614 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:04.060755  1619 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:04.062665  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:04.063074  3910 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.428475  4036 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.409353  2241 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:03.494434  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:04.064437  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:04.064572  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 655197us
I20260709 13:00:04.065013  2268 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:04.065246  2241 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:04.066066  4158 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.066423  4158 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:04.066751  4070 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.066829  4158 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.067337  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:03.555176  4117 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:04.068202  2272 raft_consensus.cc:2410] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:04.068675  4000 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.069540  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:04.070083  2272 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:03.926904  4055 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:03.505806  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:04.040786  4244 log.cc:927] Time spent T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.546s	user 0.000s	sys 0.001s
W20260709 13:00:04.072093  2269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.000s	sys 0.010s
W20260709 13:00:04.072433  2269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.000s	sys 0.010s
I20260709 13:00:04.072942  4195 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:04.073216  4066 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.068148  4117 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:03.460041  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.067407  4070 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.533485  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1555) took 2182 ms. Trace:
I20260709 13:00:04.112687  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:03.865931  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.075230  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:03.416258  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.298431  4071 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:03.608953  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.060374  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:04.074132  4158 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:04.079241  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.113305  1686 rpcz_store.cc:276] 0709 13:00:01.351113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.472536 (+121423us) service_pool.cc:224] Handling call
0709 13:00:01.472851 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.552308 (+ 79457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.552337 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:01.552377 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:01.552414 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.533217 (+1980803us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54003c00d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:03.533276 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.533417 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182278528}
W20260709 13:00:04.193914  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 118680us
W20260709 13:00:03.534528  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 778) took 2439 ms (client timeout 2056 ms). Trace:
I20260709 13:00:04.196389  1543 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
W20260709 13:00:03.887401  4246 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.356s	user 0.000s	sys 0.000s
W20260709 13:00:03.656711  4086 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.564s	user 0.011s	sys 0.019s
W20260709 13:00:03.763991  4247 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
W20260709 13:00:03.674968  3819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.044s	sys 0.064s
I20260709 13:00:04.200940  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:04.074465  4066 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.887615  4204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.014s	sys 0.016s
I20260709 13:00:03.991312  4155 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:04.034320  4023 raft_consensus.cc:3055] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:04.077128  4036 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:03.397425  4210 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.112730  4034 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.274067  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:04.199888  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.003s	sys 0.043s
I20260709 13:00:04.201228  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:03.397524  4226 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:03.319504  4080 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:04.333657  1658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.033s	sys 0.031s
I20260709 13:00:04.112341  4117 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:04.339715  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 278109us
W20260709 13:00:04.352541  1584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.021s	sys 0.035s
W20260709 13:00:04.421160  1584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.021s	sys 0.035s
W20260709 13:00:04.201471  2271 rpcz_store.cc:269] 0709 13:00:01.095455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.096191 (+   736us) service_pool.cc:224] Handling call
0709 13:00:03.534323 (+2438132us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54005875d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:03.534442 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830853376}
I20260709 13:00:03.676405  4143 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:03.397307  4222 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.356586  3772 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.319187  4223 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.899s
I20260709 13:00:03.438199  4242 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.424053  4063 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.434505  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:04.434619  4063 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:04.435314  1619 raft_consensus.cc:2393] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:04.436219  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:04.436704  4063 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:04.363091  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.437201  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:04.438138  1583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.000s	sys 0.010s
W20260709 13:00:04.438473  1583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.000s	sys 0.010s
I20260709 13:00:04.438359  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:04.439327  1619 raft_consensus.cc:2410] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:04.440101  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:04.440439  4008 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.440918  4008 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:04.207768  4189 consensus_meta.cc:287] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.463s	user 0.011s	sys 0.000s
I20260709 13:00:04.441409  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:04.441979  4189 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.433440  3772 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.444741  3772 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.445174  3772 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:04.445566  3772 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.114099  4000 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.447067  4000 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:04.447448  4083 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.447650  2268 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:04.447938  4083 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:04.449801  4083 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.447489  4000 raft_consensus.cc:697] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:04.113351  4195 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:04.364296  1510 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:04.450954  4000 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.407425  1542 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:04.451900  4157 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:04.407768  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.013s	sys 0.046s
I20260709 13:00:04.205077  4224 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.112159  3907 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:04.453490  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2210) took 3924 ms (client timeout 1627 ms). Trace:
I20260709 13:00:04.453626  4224 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:04.453903  1689 rpcz_store.cc:269] 0709 13:00:00.528729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.529451 (+   722us) service_pool.cc:224] Handling call
0709 13:00:04.453338 (+3923887us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b5400305054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:04.453434 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5491350912}
I20260709 13:00:04.454325  4265 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.454778  4265 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:04.455261  3907 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:04.455545  4224 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:04.410689  4034 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.456868  4265 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.422945  4143 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.457865  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1560) took 1841 ms. Trace:
I20260709 13:00:04.459558  4143 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:03.510385  4252 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:04.458302  1687 rpcz_store.cc:276] 0709 13:00:02.628766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.628905 (+   139us) service_pool.cc:224] Handling call
0709 13:00:02.644913 (+ 16008us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.082556 (+437643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.082586 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:03.085849 (+  3263us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.525879 (+440030us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:03.724309 (+198430us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.724679 (+   370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.724821 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.457696 (+732875us) raft_consensus.cc:1685] finished
0709 13:00:04.457714 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.457818 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200666,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":203669,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":175,"thread_start_us":726517,"threads_started":2,"wal-append.queue_time_us":1254844}
I20260709 13:00:04.460330  4252 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:04.462205  4252 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:04.413304  1658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.033s	sys 0.031s
I20260709 13:00:03.727384  4156 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:04.463006  4156 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.465126  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:04.414359  1511 leader_election.cc:336] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.201s (SENT)
I20260709 13:00:04.466974  1511 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:04.467768  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:04.468349  1688 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 13:00:04.469472  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:04.339651  4204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.015s	sys 0.017s
I20260709 13:00:04.198832  3941 raft_consensus.cc:3055] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:04.357026  4086 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.281s	user 0.013s	sys 0.038s
I20260709 13:00:04.423427  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1819) took 2097 ms. Trace:
I20260709 13:00:04.420537  1509 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:04.211234  4011 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:04.412084  4036 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:04.337559  3819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.072s	sys 0.111s
I20260709 13:00:04.430402  1615 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:04.358789  4119 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:04.337193  4066 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:03.469070  4241 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.435011  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 783) took 2357 ms. Trace:
I20260709 13:00:04.199098  4070 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.441045  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:04.442533  4189 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.451067  4195 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.422770  4210 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:04.199813  4185 consensus_meta.cc:287] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.268s	user 0.008s	sys 0.004s
I20260709 13:00:03.400360  4181 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:04.339038  4082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.026s	sys 0.029s
W20260709 13:00:04.595959  4082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.029s	sys 0.035s
W20260709 13:00:04.451413  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 87203.7us
W20260709 13:00:04.596598  4264 log.cc:927] Time spent T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:00:03.695883  4162 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.457777  4034 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.194362  4055 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:04.611719  4237 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.625s	user 0.003s	sys 0.000s
I20260709 13:00:04.509859  4262 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.618508  1685 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 2. Current term is 4. Ops: []
I20260709 13:00:04.474496  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:04.619583  2273 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.002s	sys 0.027s
W20260709 13:00:04.619933  2273 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.002s	sys 0.027s
I20260709 13:00:04.619771  1543 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:04.475467  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:04.621121  1542 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:04.319015  4071 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:04.477698  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 63377.3us
W20260709 13:00:04.626417  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.477700  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:04.474179  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:04.469336  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:04.489903  3772 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.503063  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:04.506501  1658 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:04.420153  4175 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.114156  4154 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.504304  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:04.458024  4077 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:04.530401  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 109969us
I20260709 13:00:04.534373  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:04.552524  3825 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:04.541373  4008 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:04.512272  2271 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:04.645418  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 138963us
I20260709 13:00:04.646571  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:04.551453  4204 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.503153  4157 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.604056  1510 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:04.421835  4226 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.537994  4119 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.494267  4242 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.508718  3907 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:04.431744  4222 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.508608  4176 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:04.609262  4189 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:04.609943  4172 consensus_meta.cc:287] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.783s	user 0.002s	sys 0.008s
I20260709 13:00:04.610028  4080 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.610494  4155 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.610780  4195 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.611284  4055 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.442546  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:04.711064  1614 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.357767  4023 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:04.511085  3941 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:04.539089  4091 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.628219  1688 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 13:00:04.579164  2274 rpcz_store.cc:276] 0709 13:00:02.077362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.077570 (+   208us) service_pool.cc:224] Handling call
0709 13:00:02.077863 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.443434 (+365571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.434795 (+1991361us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400586bd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:04.434959 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811463424}
I20260709 13:00:04.632251  2268 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:04.542111  2275 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:04.646951  3819 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.510764  1613 rpcz_store.cc:276] 0709 13:00:02.326231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.326329 (+    98us) service_pool.cc:224] Handling call
0709 13:00:02.326607 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.326893 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.326915 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.941668 (+614753us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b2c00010828. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 13:00:02.946358 (+  4690us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.303708 (+357350us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:03.303755 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.303842 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.412274 (+1108432us) raft_consensus.cc:1685] finished
0709 13:00:04.412291 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.423359 (+ 11068us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235469184,"thread_start_us":356976,"threads_started":1,"wal-append.queue_time_us":1464049}
I20260709 13:00:04.648157  1658 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:04.552691  4036 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.648238  4175 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:04.657986  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.734930  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:04.680004  4119 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.685848  1619 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:04.540639  4011 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:04.690882  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:04.699894  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:04.703292  1545 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:04.650537  3825 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:04.709471  2272 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:04.711683  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 798) took 2018 ms. Trace:
I20260709 13:00:04.739096  1615 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:04.739372  2270 rpcz_store.cc:276] 0709 13:00:02.693341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.694165 (+   824us) service_pool.cc:224] Handling call
0709 13:00:02.694547 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.694964 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.694998 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.695516 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.882332 (+186816us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:03.079618 (+197286us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.082455 (+  2837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.082554 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.611146 (+1528592us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:04.708519 (+ 97373us) raft_consensus.cc:1685] finished
0709 13:00:04.711483 (+  2964us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.711619 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2468,"prepare.queue_time_us":264603,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":6812,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":8326,"spinlock_wait_cycles":20949248,"thread_start_us":382318,"threads_started":2,"wal-append.queue_time_us":205972}
I20260709 13:00:04.709673  4172 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.691133  4254 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.691531  3907 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:04.716566  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.358s	user 0.037s	sys 0.046s
W20260709 13:00:04.799295  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.037s	sys 0.046s
I20260709 13:00:04.803094  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:04.708828  4159 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.357s	user 0.001s	sys 0.014s
I20260709 13:00:04.700560  4157 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.632797  4262 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.647694  4204 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.811728  1614 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
W20260709 13:00:04.710131  4184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.019s	sys 0.036s
I20260709 13:00:04.736474  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:04.737078  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 88993.3us
I20260709 13:00:04.653826  4063 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:04.746605  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 488) took 2414 ms. Trace:
I20260709 13:00:04.689376  4250 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
W20260709 13:00:04.712419  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 511459us
I20260709 13:00:04.701047  4176 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:04.787371  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.409s	user 0.002s	sys 0.013s
W20260709 13:00:05.000144  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.622s	user 0.003s	sys 0.014s
W20260709 13:00:05.000818  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 1.65979e+06us
I20260709 13:00:04.936877  2274 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:04.788162  2242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.019s	sys 0.030s
I20260709 13:00:04.712304  4158 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:04.905108  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 54449us
I20260709 13:00:04.738404  4265 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:04.743067  4086 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:04.912102  1693 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:04.736931  4085 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.848495  1686 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:00:04.815192  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.712685  4155 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:04.912844  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 331975us
I20260709 13:00:05.050122  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:04.999500  1694 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:04.936295  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:04.935266  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:04.717089  1618 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.417s	user 0.000s	sys 0.016s
W20260709 13:00:05.003696  2242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.019s	sys 0.030s
I20260709 13:00:04.905566  4222 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:05.049870  2243 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:04.716687  4071 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:04.911689  4237 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:00:04.844506  4159 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.503s	user 0.001s	sys 0.015s
W20260709 13:00:05.074204  1618 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.778s	user 0.001s	sys 0.022s
I20260709 13:00:05.026443  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:05.009078  1542 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:05.074602  2275 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:05.103751  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:05.104305  2275 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 2.
I20260709 13:00:05.038014  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:05.050726  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 453125us
I20260709 13:00:05.073743  2268 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:04.913416  4008 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:05.115118  2274 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:05.115386  1510 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:05.115723  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 65930.5us
I20260709 13:00:05.115321  4008 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:05.116387  2243 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:05.116708  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:04.739166  3819 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:05.117831  4222 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:05.118309  4222 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.064870  4086 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.118712  4222 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.118944  4086 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.764161  4091 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:05.084839  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:05.123068  4158 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:05.123795  1692 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:05.124150  4158 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:05.123585  2276 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:05.087363  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:04.992952  4180 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.010s	sys 0.037s
I20260709 13:00:05.090291  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:04.799708  4172 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:04.763919  3825 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.091296  1612 rpcz_store.cc:276] 0709 13:00:02.323596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.401074 (+ 77478us) service_pool.cc:224] Handling call
0709 13:00:02.443217 (+ 42143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.443427 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:02.466470 (+ 23043us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.280190 (+1813720us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180036de40. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a 00007f29ebdafa2a
0709 13:00:04.737258 (+457068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.737313 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:04.737350 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.737408 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.737509 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96052,"prepare.queue_time_us":22894,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":2015,"raft.run_cpu_time_us":10240,"raft.run_wall_time_us":37326,"spinlock_wait_cycles":25318272,"thread_start_us":456014,"threads_started":1}
I20260709 13:00:05.100337  1694 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:05.102202  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:04.994129  4189 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.904314  4036 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.911794  4023 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:05.126102  4180 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.011s	sys 0.043s
I20260709 13:00:05.126368  1536 raft_consensus.cc:2410] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:00:05.286329  4241 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:05.988406  2274 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:05.065258  4066 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:05.990226  4066 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:05.436738  4000 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:05.990746  4066 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:05.991250  4000 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:05.146423  3772 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:05.993934  4000 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:05.694363  1618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.000s	sys 0.020s
I20260709 13:00:05.994006  3772 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:05.994834  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 773) took 1059 ms. Trace:
I20260709 13:00:06.036381  2268 rpcz_store.cc:276] 0709 13:00:04.935382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.936076 (+   694us) service_pool.cc:224] Handling call
0709 13:00:05.994779 (+1058703us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:06.038728  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 807) took 1011 ms. Trace:
I20260709 13:00:06.039260  2268 rpcz_store.cc:276] 0709 13:00:05.027584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.037783 (+1010199us) service_pool.cc:224] Handling call
0709 13:00:06.038124 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.038340 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.038374 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:06.038425 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:06.038474 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.038538 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.038653 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:05.146629  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.995426  1540 raft_consensus.cc:2376] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5. Re-sending same reply.
I20260709 13:00:05.117831  4008 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:05.101534  4253 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.549s	user 0.000s	sys 0.001s
I20260709 13:00:05.996359  4172 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:05.125959  4158 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:05.186180  4086 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:05.263621  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:05.127698  3819 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:05.084251  4181 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.914s
W20260709 13:00:06.148249  4243 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 3.165s	user 0.003s	sys 0.009s
I20260709 13:00:06.148586  4181 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:06.149011  4181 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.149374  4181 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.149801  3819 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:06.150230  4155 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:05.667601  4222 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.150343  3819 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.151599  4155 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:05.277182  1658 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:06.152331  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 1.06091e+06us
W20260709 13:00:05.297706  3643 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.016s	sys 0.041s
W20260709 13:00:06.153972  3643 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.505s	user 0.021s	sys 0.045s
I20260709 13:00:05.298959  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2255) took 2393 ms. Trace:
W20260709 13:00:05.686823  1659 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.008s	sys 0.031s
I20260709 13:00:06.006829  4268 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:05.286597  4070 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:05.041064  4252 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.005326  4258 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:05.004637  4236 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.436555  4085 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:05.985575  3907 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:05.065979  4080 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.949s
I20260709 13:00:06.017800  4036 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:05.050658  4250 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:05.297564  4197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.412s	user 0.008s	sys 0.050s
I20260709 13:00:05.083513  4265 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:04.912611  3941 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:05.090925  4184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.021s	sys 0.044s
W20260709 13:00:05.093403  3985 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.052s	user 0.024s	sys 0.057s
I20260709 13:00:04.813482  4254 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:05.522315  4224 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.022819  4189 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.032528  3825 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:05.079037  4061 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.916s
I20260709 13:00:05.040741  3910 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:06.117220  3772 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:05.106082  4063 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.993309  4066 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:05.985338  4175 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.080050  4000 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:06.113451  4008 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.535530  4156 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:05.532640  4226 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:05.855708  4117 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 1.428s	user 0.003s	sys 0.007s
I20260709 13:00:05.537732  4154 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:05.846927  4011 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:05.840538  4055 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:05.531944  4204 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:05.668279  4210 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:04.908638  4157 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:05.285506  4269 consensus_queue.cc:1059] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.993s
W20260709 13:00:05.667783  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.002s	sys 0.019s
W20260709 13:00:06.074599  1509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.014s	sys 0.013s
W20260709 13:00:06.054319  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.009s	sys 0.004s
W20260709 13:00:06.079226  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.005s	sys 0.005s
W20260709 13:00:06.008104  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 917703us
I20260709 13:00:05.262032  1613 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:06.079744  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.003s	sys 0.007s
W20260709 13:00:06.155098  1659 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.008s	sys 0.038s
W20260709 13:00:06.715857  1618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.005s
W20260709 13:00:06.716113  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.386s	user 0.003s	sys 0.007s
W20260709 13:00:06.716353  1618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.001s	sys 0.005s
W20260709 13:00:06.716578  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 1.75304e+06us
I20260709 13:00:06.718014  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 496) took 3456 ms. Trace:
W20260709 13:00:06.054818  1657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.006s	sys 0.004s
W20260709 13:00:06.712138  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.003s	sys 0.007s
I20260709 13:00:06.154881  1620 rpcz_store.cc:276] 0709 13:00:02.905233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.905347 (+   114us) service_pool.cc:224] Handling call
0709 13:00:02.905684 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.076131 (+170447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.298699 (+2222568us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400067554. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:05.298903 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387784064}
W20260709 13:00:06.723093  1657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.497s	user 0.006s	sys 0.004s
W20260709 13:00:06.723976  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 501) took 2021 ms (client timeout 1909 ms). Trace:
I20260709 13:00:06.692255  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1770) took 2222 ms. Trace:
I20260709 13:00:06.705801  1585 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:06.724742  1613 rpcz_store.cc:269] 0709 13:00:04.701938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.736126 (+ 34188us) service_pool.cc:224] Handling call
0709 13:00:06.723702 (+1987576us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:06.726166  1509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.673s	user 0.014s	sys 0.015s
W20260709 13:00:06.723160  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.003s	sys 0.009s
W20260709 13:00:06.722467  1659 connection.cc:256] RPC call timeout handler was delayed by -1.7507559229999856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
I20260709 13:00:06.727559  1585 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:06.728117  1659 connection.cc:256] RPC call timeout handler was delayed by -1.70389684700001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 13:00:03.774091   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:06.728976  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.729879  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 2.032s (SENT) [suppressed 7 similar messages]
W20260709 13:00:06.724033  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.606s	user 0.010s	sys 0.005s
W20260709 13:00:06.730934  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.006s	sys 0.006s
I20260709 13:00:06.085708  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 503) took 3855 ms. Trace:
I20260709 13:00:06.734176  1685 rpcz_store.cc:276] 0709 13:00:02.230368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.230501 (+   133us) service_pool.cc:224] Handling call
0709 13:00:02.267922 (+ 37421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.619384 (+2351462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.085400 (+1466016us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b5400109fd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:06.085637 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5320288000}
I20260709 13:00:06.735466  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1584) took 1729 ms. Trace:
I20260709 13:00:06.735792  1686 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:00:06.683068  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.004s	sys 0.004s
I20260709 13:00:06.736455  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:06.736992  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:06.737355  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.005s	sys 0.005s
I20260709 13:00:06.737598  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:06.738593  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:06.739073  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:06.740891  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:06.741081  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 487) took 5630 ms (client timeout 1501 ms). Trace:
W20260709 13:00:06.741552  1692 rpcz_store.cc:269] 0709 13:00:01.111051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.275325 (+164274us) service_pool.cc:224] Handling call
0709 13:00:06.740688 (+5465363us) spinlock_profiling.cc:243] Waited 3.8 s on lock 0x7b5400360e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:06.740883 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8750253824}
W20260709 13:00:06.704245  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 555) took 4006 ms (client timeout 2149 ms). Trace:
I20260709 13:00:06.742806  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:06.713721  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 1590) took 1687 ms (client timeout 2190 ms). Trace:
W20260709 13:00:06.743067  1545 rpcz_store.cc:269] 0709 13:00:02.697427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.697842 (+   415us) service_pool.cc:224] Handling call
0709 13:00:06.703608 (+4005766us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b540025d0d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:06.703919 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4573736704}
I20260709 13:00:06.739187  1685 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:06.743700  1540 rpcz_store.cc:269] 0709 13:00:05.026136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.026238 (+   102us) service_pool.cc:224] Handling call
0709 13:00:06.713235 (+1686997us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400210cd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:06.713490 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047945984}
I20260709 13:00:06.743038  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:06.746025  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:06.718518  1618 rpcz_store.cc:276] 0709 13:00:03.261194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.264339 (+  3145us) service_pool.cc:224] Handling call
0709 13:00:03.264678 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.264882 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:05.105824 (+1840942us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.599700 (+1493876us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:06.717103 (+117403us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:06.717253 (+   150us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:06.717413 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.717573 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.717875 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2245146,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":137761,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":103,"spinlock_wait_cycles":4754688,"thread_start_us":3415048,"threads_started":3,"wal-append.queue_time_us":1163181}
I20260709 13:00:06.746855  1692 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
W20260709 13:00:06.732777  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 1.61581e+06us
I20260709 13:00:06.747907  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:06.723836  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:06.753140  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1568) took 2288 ms (client timeout 2227 ms). Trace:
W20260709 13:00:06.753477  1693 rpcz_store.cc:269] 0709 13:00:04.464810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.464921 (+   111us) service_pool.cc:224] Handling call
0709 13:00:06.752795 (+2287874us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54002e59d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:06.752967 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884929408}
I20260709 13:00:06.754537  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:06.755285  1693 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 13:00:06.756095  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:06.756961  1693 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:06.757699  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:06.728266  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.758565  1693 raft_consensus.cc:2410] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:06.759639  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:06.760617  1693 raft_consensus.cc:2410] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:06.761441  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:06.762035  1693 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:06.683176  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1760) took 3382 ms. Trace:
I20260709 13:00:06.763162  1541 rpcz_store.cc:276] 0709 13:00:03.300823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.300986 (+   163us) service_pool.cc:224] Handling call
0709 13:00:03.354260 (+ 53274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.060942 (+706682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.060970 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.204289 (+143319us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.786987 (+582698us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:04.787041 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.787127 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.682193 (+1895066us) raft_consensus.cc:1685] finished
0709 13:00:06.682275 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.682867 (+   592us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83283,"raft.queue_time_us":722870,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":95570,"thread_start_us":421283,"threads_started":1,"wal-append.queue_time_us":2273068}
W20260709 13:00:06.765895  2242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.010s	sys 0.007s
W20260709 13:00:06.766352  2242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.010s	sys 0.007s
W20260709 13:00:06.122399  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 135847us
W20260709 13:00:06.731062  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.682s	user 0.021s	sys 0.026s
I20260709 13:00:06.029310  2274 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:05.917354  2270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.002s	sys 0.007s
I20260709 13:00:06.087585  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 795) took 2016 ms. Trace:
W20260709 13:00:06.769798  3643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.010s	sys 0.018s
W20260709 13:00:06.770372  3643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.010s	sys 0.018s
W20260709 13:00:06.769088  2270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.676s	user 0.002s	sys 0.008s
I20260709 13:00:06.172447  2269 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:06.771898  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 802) took 1745 ms. Trace:
W20260709 13:00:06.122567  2273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.499s	user 0.008s	sys 0.029s
I20260709 13:00:06.136368  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:06.772675  3907 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:06.773103  2273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.150s	user 0.009s	sys 0.029s
W20260709 13:00:06.773694  2277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 800) took 1762 ms (client timeout 2032 ms). Trace:
I20260709 13:00:06.773517  3907 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:06.016033  2271 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
W20260709 13:00:06.774161  2277 rpcz_store.cc:269] 0709 13:00:05.011903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.136088 (+1124185us) service_pool.cc:224] Handling call
0709 13:00:06.773489 (+637401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:06.776643  3907 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:06.776862  3825 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:06.777204  3907 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:06.459818  3819 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.777983  3907 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.779233  3819 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:06.779964  3819 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:06.781895  3907 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.782178  3819 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:06.782372  3907 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:06.769655  2272 rpcz_store.cc:276] 0709 13:00:04.071550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.071649 (+    99us) service_pool.cc:224] Handling call
0709 13:00:04.071931 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.739278 (+667347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.087311 (+1348033us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400051754. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:06.087529 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465556736}
I20260709 13:00:06.135444  4023 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:06.471197  4060 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:06.293687  4071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.015s	sys 0.048s
I20260709 13:00:06.490391  4086 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:06.259704  4119 consensus_meta.cc:287] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.493s	user 0.010s	sys 0.000s
I20260709 13:00:06.111462  3933 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:06.789461  4059 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:06.785066  3985 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.743s	user 0.045s	sys 0.075s
I20260709 13:00:06.793373  4063 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.587319  4262 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:06.260958  4159 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:06.800988  4159 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.800827  4224 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.801491  4159 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.801146  4181 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:05.527642  4176 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.126716  4172 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.792927  4061 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:06.812935  1686 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:06.724949  1544 rpcz_store.cc:276] 0709 13:00:04.469642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.469826 (+   184us) service_pool.cc:224] Handling call
0709 13:00:04.531448 (+ 61622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.531717 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.531768 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.532257 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.915800 (+383543us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:04.915835 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.915895 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.691670 (+1775775us) raft_consensus.cc:1685] finished
0709 13:00:06.691716 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.692036 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":308893,"threads_started":1,"wal-append.queue_time_us":1505282}
I20260709 13:00:06.792280  4092 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:06.793219  4099 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:06.772403  2269 rpcz_store.cc:276] 0709 13:00:05.026099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.045593 (+ 19494us) service_pool.cc:224] Handling call
0709 13:00:06.771594 (+1726001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:06.793190  4104 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:06.832640  4197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.947s	user 0.032s	sys 0.070s
I20260709 13:00:06.782660  3819 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:06.251480  4235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.185s	user 0.047s	sys 0.073s
I20260709 13:00:06.871383  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:06.794571  4071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.020s	sys 0.070s
W20260709 13:00:06.382244  4301 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:00:06.787398  4017 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.794121  4077 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:06.600418  4300 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:00:06.832808  4061 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:06.788851  4054 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.789094  4047 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.903786  1685 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:06.784695  3941 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.835713  4306 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.871132  4092 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.788048  4011 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.599143  4162 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.374293  4222 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:06.735970  1537 rpcz_store.cc:276] 0709 13:00:05.006290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.007221 (+   931us) service_pool.cc:224] Handling call
0709 13:00:05.041130 (+ 33909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:05.045556 (+  4426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:05.045583 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:05.046008 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.733764 (+1687756us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:06.734480 (+   716us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.734859 (+   379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.735030 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.735069 (+    39us) raft_consensus.cc:1685] finished
0709 13:00:06.735085 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.735376 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4089,"prepare.queue_time_us":65493,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":60,"raft.queue_time_us":95279,"raft.run_cpu_time_us":417,"raft.run_wall_time_us":185446,"thread_start_us":1366469,"threads_started":1,"wal-append.queue_time_us":1354456}
W20260709 13:00:06.601675  4286 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:00:06.873664  4099 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:06.494611  4091 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.381609  4287 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:06.787415  4000 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.363765  4290 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:06.783151  3907 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.834492  4236 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:06.783921  3910 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.793962  4085 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:06.879599  4104 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:06.460374  4311 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.834102  4119 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:06.930886  4310 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.931407  4173 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:06.931978  4268 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.934036  4157 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:06.933825  4054 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.021333  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 806) took 1993 ms. Trace:
I20260709 13:00:07.021874  2274 rpcz_store.cc:276] 0709 13:00:05.027302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.989332 (+962030us) service_pool.cc:224] Handling call
0709 13:00:06.028980 (+ 39648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.768721 (+739741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.020934 (+252213us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b540071e8d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:07.021135 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90526976}
I20260709 13:00:07.023087  4054 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.934710  4307 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.934872  4017 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.024190  4119 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.023910  4307 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.024897  4258 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:07.025024  4310 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.025437  4258 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:07.026067  4307 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:06.935693  4172 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:06.936398  4175 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.035548  4175 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.936666  3825 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.936899  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:06.937080  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 96119.1us
I20260709 13:00:06.268200  4242 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.937589  4288 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:06.937950  4306 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:06.938447  4059 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.939854  4077 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.940949  4295 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.941650  4117 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:06.942044  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:06.942970  4298 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:06.942880  4250 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:06.921308  4092 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:06.950837  4235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.879s	user 0.065s	sys 0.111s
I20260709 13:00:06.934485  4011 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:06.916112  4224 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.952973  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 786) took 3686 ms. Trace:
I20260709 13:00:06.946285  4063 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:06.955672  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 775) took 2019 ms (client timeout 2224 ms). Trace:
I20260709 13:00:06.960738  4189 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.968515  3985 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.970639  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:06.971100  4169 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.971674  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:07.103468  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 379939us
W20260709 13:00:06.972401  4316 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 13:00:06.974517  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:06.786729  4008 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:06.985023  4315 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:00:06.913738  4061 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.993626  3933 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:06.935214  4170 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:06.917855  3819 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:06.928462  4099 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.005517  4290 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.006207  4287 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:07.006551  3907 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:07.007261  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 276475us
I20260709 13:00:07.009498  3910 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.010885  4254 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.011880  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1567) took 2547 ms. Trace:
I20260709 13:00:07.013192  4236 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:07.016269  4085 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.018162  4000 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.019590  3772 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:07.025385  4017 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:06.935209  4047 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.034636  1543 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:07.034907  4310 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.046355  1685 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:07.046413  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 771) took 2245 ms. Trace:
W20260709 13:00:07.003120  4278 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.355s	user 0.000s	sys 0.004s
I20260709 13:00:06.239256  4155 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.047919  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.116734  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:07.003057  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 273468us
I20260709 13:00:07.102396  1541 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:07.071342  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.109442  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.071153  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:06.971815  3643 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.004273  4104 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:07.209632  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 101177us
W20260709 13:00:07.212150  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.111984  4265 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:07.106583  4297 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.403s	user 0.001s	sys 0.001s
W20260709 13:00:07.212530  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 94522.6us
I20260709 13:00:07.109722  3825 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.108340  4311 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.166975  2273 rpcz_store.cc:276] 0709 13:00:03.271705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.271876 (+   171us) service_pool.cc:224] Handling call
0709 13:00:03.272119 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.070751 (+798632us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:04.623158 (+552407us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.773775 (+2150617us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:06.773874 (+    99us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:06.773988 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.952621 (+178633us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54004a5e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:06.952673 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.952864 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48,"prepare.queue_time_us":384331,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":12006,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"spinlock_wait_cycles":1835964160,"thread_start_us":2699443,"threads_started":2,"wal-append.queue_time_us":1993730}
W20260709 13:00:07.175467  2271 rpcz_store.cc:269] 0709 13:00:04.935995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.936128 (+   133us) service_pool.cc:224] Handling call
0709 13:00:06.955318 (+2019190us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400660154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:06.955516 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215710464}
W20260709 13:00:07.407790  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.423825  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 341) took 14119 ms (client timeout 15000 ms). Trace:
I20260709 13:00:07.109912  4222 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:07.486124  2243 connection.cc:256] RPC call timeout handler was delayed by -1.3817761560000577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22540000000000002s for a response
W20260709 13:00:07.511590  2243 connection.cc:256] RPC call timeout handler was delayed by -1.0740989340000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:00:07.322669  1689 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:07.220114  2276 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:07.323210  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.388180  1618 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:07.213835  1539 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:07.106361  4173 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.505081  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.113585  4175 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.112128  4172 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.151149  4181 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.296996  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:07.519013  4296 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.065938  4307 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:07.520063  4277 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.522s	user 0.002s	sys 0.009s
I20260709 13:00:07.520539  1545 raft_consensus.cc:2410] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:07.513350  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:07.438585  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:07.437904  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1566) took 2973 ms (client timeout 2224 ms). Trace:
I20260709 13:00:07.220320  3987 tablet_bootstrap.cc:492] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:00:07.436601  4023 consensus_meta.cc:287] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.005s
W20260709 13:00:07.336642  4159 consensus_meta.cc:287] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:00:07.558789  4222 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.538936  1613 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.520794  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:07.539232  1694 rpcz_store.cc:269] 0709 13:00:04.464271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.469125 (+  4854us) service_pool.cc:224] Handling call
0709 13:00:07.415451 (+2946326us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54001603d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:07.437719 (+ 22268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854722816}
I20260709 13:00:07.547088  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.551447  1620 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:07.453909  4268 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:07.223099  4157 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.437728  4008 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.546301  3772 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.289467  3824 consensus_queue.cc:1059] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.266s
I20260709 13:00:07.410887  4059 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.290839  3985 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:07.510483  1443 rpcz_store.cc:269] 0709 12:59:53.295856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.298920 (+  3064us) service_pool.cc:224] Handling call
0709 12:59:56.306283 (+3007363us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5400230190. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c810b2 00007f29f1bfaa89 00007f29f1b92da6 00007f29f1b64088 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc
0709 13:00:07.415281 (+11108998us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:59.225720 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:59.441246 (+215526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:59.441288 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:59:59.451914 (+ 10626us) tablet.cc:662] Decoding operations
0709 12:59:59.452326 (+   412us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:59.452421 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:59.452449 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:59.452744 (+   295us) tablet.cc:701] Row locks acquired
0709 12:59:59.452761 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:59.452910 (+   149us) write_op.cc:270] Start()
0709 12:59:59.453024 (+   114us) write_op.cc:276] Timestamp: P: 1783601999452854 usec, L: 0
0709 12:59:59.453051 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:59:59.453751 (+   700us) log.cc:844] Serialized 982 byte log entry
0709 13:00:00.451225 (+997474us) op_driver.cc:464] REPLICATION: finished
0709 13:00:00.840235 (+389010us) write_op.cc:301] APPLY: starting
0709 13:00:00.840321 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:00.840434 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:00.840566 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:00.840906 (+   340us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:00.841136 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:00.841200 (+    64us) write_op.cc:312] APPLY: finished
0709 13:00:00.841410 (+   210us) log.cc:844] Serialized 29 byte log entry
0709 13:00:00.841564 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:00.841654 (+    90us) write_op.cc:454] Released schema lock
0709 13:00:00.841690 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:00.842042 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:00.842068 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":180341,"reported_tablets":6,"spinlock_wait_cycles":30939776,"child_traces":[["op",{"apply.queue_time_us":385620,"apply.run_cpu_time_us":1802,"apply.run_wall_time_us":1802,"num_ops":2,"prepare.queue_time_us":379117,"prepare.run_cpu_time_us":57270,"prepare.run_wall_time_us":499397,"raft.queue_time_us":418707,"raft.run_cpu_time_us":50725,"raft.run_wall_time_us":328371,"replication_time_us":997983,"spinlock_wait_cycles":64896,"thread_start_us":973634,"threads_started":4,"wal-append.queue_time_us":411537,"wal-append.run_cpu_time_us":14911,"wal-append.run_wall_time_us":1984124}]]}
I20260709 13:00:07.290839  4295 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.555814  3987 tablet_bootstrap.cc:492] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 13:00:07.555918  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.437952  4077 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.556860  1544 raft_consensus.cc:2410] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:07.559017  4159 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.583346  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:07.536139  2276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 805) took 2485 ms (client timeout 2067 ms). Trace:
I20260709 13:00:07.532963  1614 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:07.560447  1540 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:07.586450  3987 ts_tablet_manager.cc:1403] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 4.653s	user 0.058s	sys 0.055s
I20260709 13:00:07.586737  1541 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:07.516865  4290 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:07.415014  4169 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.425375  4306 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.456247  4011 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:07.557112  3643 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.567122  1542 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:07.558419  3819 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:07.503939  1691 rpcz_store.cc:276] 0709 13:00:04.464552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.469707 (+  5155us) service_pool.cc:224] Handling call
0709 13:00:04.469974 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.470280 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.470304 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.480844 (+ 10540us) log.cc:844] Serialized 26 byte log entry
0709 13:00:05.067300 (+586456us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:05.067346 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.067404 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.601007 (+1533603us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:07.000569 (+399562us) raft_consensus.cc:1685] finished
0709 13:00:07.003755 (+  3186us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.011677 (+  7922us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59415,"raft.queue_time_us":1805,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":21833,"spinlock_wait_cycles":4489600,"thread_start_us":433830,"threads_started":1,"wal-append.queue_time_us":1798564}
I20260709 13:00:07.600144  1692 raft_consensus.cc:2393] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:07.568276  1536 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:07.508463  2270 rpcz_store.cc:276] 0709 13:00:04.801055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.801201 (+   146us) service_pool.cc:224] Handling call
0709 13:00:04.916685 (+115484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.916919 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:05.092394 (+175475us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.908516 (+1816122us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:06.920804 (+ 12288us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:06.989740 (+ 68936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.018912 (+ 29172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.046351 (+ 27439us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175679,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":14155,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":198,"thread_start_us":1781953,"threads_started":2,"wal-append.queue_time_us":1175721}
I20260709 13:00:07.531668  4287 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.570022  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.223366  4152 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:00:07.604382  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 375923us
I20260709 13:00:07.572882  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 498) took 3128 ms. Trace:
I20260709 13:00:07.575932  2275 raft_consensus.cc:2410] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:00:07.587878  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 43550.4us
I20260709 13:00:07.582585  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.416023  4252 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.565377  4085 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:07.588310  2276 rpcz_store.cc:269] 0709 13:00:05.027024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.125473 (+ 98449us) service_pool.cc:224] Handling call
0709 13:00:06.941619 (+1816146us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:07.512317 (+570698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335670656}
I20260709 13:00:07.611018  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.612138  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.586395  1617 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 13:00:07.565162  4296 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.576941  3910 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:07.603150  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.603494  1685 raft_consensus.cc:2368] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5.
I20260709 13:00:07.607430  3643 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.605437  1694 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:07.607446  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.587852  4063 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.613196  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.615118  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:07.616590  4117 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:07.616865  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.618041  4173 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.582129  4307 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.568831  4170 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.618800  4250 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.619829  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.602422  4023 consensus_queue.cc:1059] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:00:07.614069  4157 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.622972  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.631458  1536 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:07.632030  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.632237  1612 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.656464  1693 raft_consensus.cc:2410] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:07.632284  4159 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:07.632047  4063 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:07.636065  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:07.630004  2275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 803) took 2603 ms (client timeout 1877 ms). Trace:
I20260709 13:00:07.635982  1585 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:07.635280  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.661213  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.634598  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:07.605069  1611 rpcz_store.cc:276] 0709 13:00:04.440198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.451408 (+ 11210us) service_pool.cc:224] Handling call
0709 13:00:04.451731 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.452020 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.452046 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.452493 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.904801 (+452308us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:04.904841 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.904912 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.519284 (+2614372us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:07.559932 (+ 40648us) raft_consensus.cc:1685] finished
0709 13:00:07.559955 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.568578 (+  8623us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2126,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":7753472,"thread_start_us":395392,"threads_started":1,"wal-append.queue_time_us":2475317}
I20260709 13:00:07.616608  3985 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.585171  4059 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:00:07.668934  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1587) took 2651 ms. Trace:
I20260709 13:00:07.669034  4059 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:07.669412  4157 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.669576  4059 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.669975  4059 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.670964  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:07.659494  2275 rpcz_store.cc:269] 0709 13:00:05.026421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.105284 (+ 78863us) service_pool.cc:224] Handling call
0709 13:00:07.438319 (+2333035us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:07.629934 (+191615us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374288640}
I20260709 13:00:07.667407  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.635445  4061 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.667759  1585 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:07.637465  4099 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.667263  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.669420  1543 rpcz_store.cc:276] 0709 13:00:05.018015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.024899 (+  6884us) service_pool.cc:224] Handling call
0709 13:00:05.025213 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.550381 (+2525168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.668688 (+118307us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54000b0ed4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:07.668884 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4603173120}
I20260709 13:00:07.672791  1685 raft_consensus.cc:2410] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:07.677163  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.678108  1612 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:07.683461  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.684365  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.684917  1536 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.685165  1614 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:07.689767  1688 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:07.690622  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.636987  4306 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:07.691118  1688 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:07.693262  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.694777  4099 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.693356  4061 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.699728  4262 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:07.699717  1536 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:07.701936  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.705395  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.743752  1540 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:07.706907  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.708390  3772 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:07.710304  4283 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.065s	user 0.000s	sys 0.003s
I20260709 13:00:07.677950  4181 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:07.693288  3933 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.665359  4085 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.713260  4222 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.714699  4295 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.715226  4170 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.689328  3910 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:00:07.716986  1584 connection.cc:256] RPC call timeout handler was delayed by -2.4793174189999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 13:00:07.722513  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2241) took 1002 ms. Trace:
W20260709 13:00:07.723976  4285 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.077s	user 0.003s	sys 0.000s
I20260709 13:00:07.724516  4252 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:07.725140  4311 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:07.743155  4262 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:07.754004  4268 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:00:07.726323  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 54068.6us
I20260709 13:00:07.727102  4296 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:07.727996  4258 consensus_meta.cc:287] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.702s	user 0.003s	sys 0.009s
I20260709 13:00:07.691634  4047 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.729702  4173 raft_consensus.cc:3055] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:07.732318  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.733556  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.634416  3987 raft_consensus.cc:359] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:07.739992  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.735536  1542 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:07.744199  1538 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.746749  1613 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:07.660080  4077 consensus_queue.cc:1059] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:00:07.711830  4321 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:07.752316  1585 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:07.749349  4023 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:07.750949  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.754735  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.755143  1694 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:07.758018  3772 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:07.759603  1692 rpcz_store.cc:276] 0709 13:00:06.720719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.747574 (+ 26855us) service_pool.cc:224] Handling call
0709 13:00:07.722348 (+974774us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54002e4ad4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:07.722463 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1957834496}
I20260709 13:00:07.782656  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 511) took 1019 ms. Trace:
I20260709 13:00:07.747586  4181 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:07.783812  1686 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:07.784212  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.784731  1542 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.784662  4181 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.785765  4262 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.787241  4262 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:07.787706  4314 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.141s	user 0.002s	sys 0.010s
I20260709 13:00:07.787990  1692 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:07.788749  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2244) took 1066 ms. Trace:
I20260709 13:00:07.789108  1692 rpcz_store.cc:276] 0709 13:00:06.721958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.787000 (+1065042us) service_pool.cc:224] Handling call
0709 13:00:07.787457 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.788442 (+   985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.788662 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:07.789631  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 350) took 11140 ms. Trace:
I20260709 13:00:07.791134  1660 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:07.792924  1440 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38400 (request call id 235) took 11362 ms (client timeout 15000 ms). Trace:
I20260709 13:00:07.793143  4117 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:07.682080  4152 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.725587  4155 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.771513  1541 raft_consensus.cc:2410] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:07.776028  1543 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:07.790047  1439 rpcz_store.cc:276] 0709 12:59:56.648956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.663529 (+ 14573us) service_pool.cc:224] Handling call
0709 12:59:56.713810 (+ 50281us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5400230190. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c810b2 00007f29f1bfaa89 00007f29f1b92da6 00007f29f1b64088 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc
0709 12:59:57.042167 (+328357us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b5400230190. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80e9c 00007f29e8c810f6 00007f29f1bfaa89 00007f29f1b92da6 00007f29f1b64088 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc
0709 13:00:07.789454 (+10747287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2799570,"reported_tablets":4,"spinlock_wait_cycles":19196160}
I20260709 13:00:07.775471  4173 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:07.783094  1694 rpcz_store.cc:276] 0709 13:00:06.763196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.678531 (+915335us) service_pool.cc:224] Handling call
0709 13:00:07.782603 (+104072us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:07.794220  1692 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:07.798729  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 164139us
I20260709 13:00:07.793537  4117 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.801353  4117 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.802196  1540 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:07.803272  4152 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.805450  1545 raft_consensus.cc:2393] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:00:07.806095  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 62533.6us
W20260709 13:00:07.793339  1440 rpcz_store.cc:269] 0709 12:59:56.430576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.431615 (+  1039us) service_pool.cc:224] Handling call
0709 12:59:56.542293 (+110678us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0f090 00007f29ebdadf3a 00007f29f1b641cc 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc 00007f29f0122392 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:07.792753 (+11250460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1840982,"reported_tablets":3,"spinlock_wait_cycles":193878400}
I20260709 13:00:07.807556  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2245) took 1076 ms. Trace:
I20260709 13:00:07.807845  1692 rpcz_store.cc:276] 0709 13:00:06.722368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.790210 (+1067842us) service_pool.cc:224] Handling call
0709 13:00:07.790590 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.798372 (+  7782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.798524 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:07.786523  4181 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.809689  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1581) took 1080 ms. Trace:
I20260709 13:00:07.813843  1693 rpcz_store.cc:276] 0709 13:00:06.729821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.762582 (+ 32761us) service_pool.cc:224] Handling call
0709 13:00:07.804858 (+1042276us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b540010a9d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:07.809636 (+  4778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720886144}
I20260709 13:00:07.780746  4321 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.780575  3987 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 13:00:07.812770  3772 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.816674  1694 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:07.818023  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1569) took 3352 ms. Trace:
I20260709 13:00:07.818357  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.818894  1537 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:07.819828  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.818362  1690 rpcz_store.cc:276] 0709 13:00:04.465057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.470661 (+  5604us) service_pool.cc:224] Handling call
0709 13:00:04.470943 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.471247 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.471271 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.510534 (+ 39263us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.994264 (+483730us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:04.995101 (+   837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.995175 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.723218 (+2728043us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:07.815172 (+ 91954us) raft_consensus.cc:1685] finished
0709 13:00:07.815190 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.817872 (+  2682us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81242,"raft.queue_time_us":897,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":23949,"spinlock_wait_cycles":628466432,"thread_start_us":389418,"threads_started":1,"wal-append.queue_time_us":2094871}
I20260709 13:00:07.820348  1537 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:07.821028  1690 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:07.821148  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.821532  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1574) took 1094 ms. Trace:
I20260709 13:00:07.821632  1537 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 13:00:07.821823  1690 rpcz_store.cc:276] 0709 13:00:06.727459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.820510 (+1093051us) service_pool.cc:224] Handling call
0709 13:00:07.820752 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.821330 (+   578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.821474 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:07.822367  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.822801  1536 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.822979  1537 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:07.823297  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1562) took 3360 ms. Trace:
I20260709 13:00:07.823457  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1578) took 1094 ms. Trace:
I20260709 13:00:07.823686  1687 rpcz_store.cc:276] 0709 13:00:04.463097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.472091 (+  8994us) service_pool.cc:224] Handling call
0709 13:00:04.511993 (+ 39902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.530767 (+ 18774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.530800 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.551593 (+ 20793us) log.cc:844] Serialized 26 byte log entry
0709 13:00:05.002593 (+451000us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:05.002635 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.020671 (+ 18036us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.709241 (+2688570us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:07.800409 (+ 91168us) raft_consensus.cc:1685] finished
0709 13:00:07.800429 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.823127 (+ 22698us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36010,"raft.queue_time_us":69087,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5117,"spinlock_wait_cycles":539745536,"thread_start_us":391491,"threads_started":1,"wal-append.queue_time_us":2049419}
I20260709 13:00:07.825695  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.826893  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.827365  1687 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:07.828056  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.828513  1687 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:07.829224  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.823957  1690 rpcz_store.cc:276] 0709 13:00:06.728714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.822424 (+1093710us) service_pool.cc:224] Handling call
0709 13:00:07.822667 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.823053 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.823075 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:07.823162 (+    87us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.823214 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.823264 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.823367 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:07.832046  1536 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:07.833904  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.823917  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.835139  1536 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:07.797293  4307 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:07.815366  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1563) took 3351 ms (client timeout 2801 ms). Trace:
I20260709 13:00:07.841174  1538 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:07.800020  4268 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.843771  1686 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:07.776010  4258 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.844355  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2246) took 1115 ms. Trace:
I20260709 13:00:07.844813  1694 rpcz_store.cc:276] 0709 13:00:06.722757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.797676 (+1074919us) service_pool.cc:224] Handling call
0709 13:00:07.813582 (+ 15906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.837954 (+ 24372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.838195 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:07.849386  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:07.841452  1689 rpcz_store.cc:269] 0709 13:00:04.463436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.469274 (+  5838us) service_pool.cc:224] Handling call
0709 13:00:07.805267 (+3335993us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b5400021f54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:07.815294 (+ 10027us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6341193984}
I20260709 13:00:07.829828  4321 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.858886  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.858826  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.865996  1687 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:07.866787  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1579) took 1137 ms. Trace:
I20260709 13:00:07.867484  4180 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:07.868129  4180 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.868499  4180 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:07.869056  4326 raft_consensus.cc:3055] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:07.869611  4326 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:07.864492  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:07.867254  1687 rpcz_store.cc:276] 0709 13:00:06.729044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.851128 (+1122084us) service_pool.cc:224] Handling call
0709 13:00:07.858404 (+  7276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.866488 (+  8084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.866723 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:07.872381  1694 raft_consensus.cc:2410] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:07.875025  1538 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
W20260709 13:00:07.874264  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 73237us
I20260709 13:00:07.810129  3910 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:00:07.877175  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.877767  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.878273  3772 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:07.848440  4047 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:07.880246  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1776) took 1140 ms. Trace:
I20260709 13:00:07.893913  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2243) took 1167 ms. Trace:
I20260709 13:00:07.884213  1539 rpcz_store.cc:276] 0709 13:00:06.739571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.740179 (+   608us) service_pool.cc:224] Handling call
0709 13:00:07.880113 (+1139934us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5400311d54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:07.880196 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085774592}
I20260709 13:00:07.899802  1536 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:07.865370  4169 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.894419  1686 rpcz_store.cc:276] 0709 13:00:06.721527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.784496 (+1062969us) service_pool.cc:224] Handling call
0709 13:00:07.813280 (+ 28784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.852067 (+ 38787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.888843 (+ 36776us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b5400021f50. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:07.889005 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65534208}
I20260709 13:00:07.902747  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.908241  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.908598  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.908932  1538 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.910730  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.911511  1537 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:07.884122  4047 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:07.911571  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.913306  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.909441  1543 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:00:07.922503  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.923035  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.925117  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.927774  4173 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.928700  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.929165  4173 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:07.929347  1613 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:07.931748  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.932231  1540 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:07.878523  3987 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:07.883087  4059 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:07.934682  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 93569.6us
I20260709 13:00:07.936040  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.935016  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.935472  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.938159  1537 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:07.939013  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:07.939467  1540 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.937649  1543 raft_consensus.cc:2376] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5. Re-sending same reply.
I20260709 13:00:07.935534  2273 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:07.941043  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.941268  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.942181  2276 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:07.880532  4326 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:07.939530  2270 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:07.949213  1536 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:07.944708  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.948112  2275 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:07.951249  1537 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
W20260709 13:00:07.951439  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.955164  1658 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:07.956002  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 110033us
I20260709 13:00:07.958437  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:07.958642  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 193784us
W20260709 13:00:07.959067  1584 connection.cc:256] RPC call timeout handler was delayed by -2.2877508249999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
I20260709 13:00:07.959838  2274 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:07.960613  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:07.954185  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.960973  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:07.949993  4085 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.968531  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:07.971343  1536 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:07.964303  1613 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:07.967929  1543 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:07.969204  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.973171  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.971935  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:07.961730  3910 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:07.975669  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.953810  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.975617  1658 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:07.977555  1584 connection.cc:256] RPC call timeout handler was delayed by -2.2309823109999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2296s for a response
W20260709 13:00:07.978443  1584 connection.cc:256] RPC call timeout handler was delayed by -2.2309823109999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2296s for a response
I20260709 13:00:07.978892  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.979164  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:07.986821  4011 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:07.987248  4011 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:07.987349  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:07.987632  4011 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.988196  1611 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:07.987257  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:07.991040  4092 consensus_meta.cc:287] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.000s
I20260709 13:00:07.990866  4047 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:07.991183  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.991698  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.992132  2270 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:07.992187  4047 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.992477  2271 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:07.993505  1620 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:07.991252  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.994392  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:07.995509  2277 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:07.995708  4319 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:07.996099  4319 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.996418  4319 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.998163  4092 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.000963  1691 raft_consensus.cc:2368] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4.
I20260709 13:00:08.002413  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 513) took 1238 ms. Trace:
I20260709 13:00:08.002794  1691 rpcz_store.cc:276] 0709 13:00:06.763972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.612921 (+848949us) service_pool.cc:224] Handling call
0709 13:00:08.002254 (+389333us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400125f54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:08.002365 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853321600}
I20260709 13:00:08.003216  1538 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:08.003520  3825 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.003702  4092 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:07.990586  4321 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.005605  1538 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:08.005666  4011 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.007504  4321 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.011232  3987 ts_tablet_manager.cc:1434] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.424s	user 0.009s	sys 0.000s
I20260709 13:00:08.011569  2268 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
W20260709 13:00:08.015700  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.016973  1584 connection.cc:256] RPC call timeout handler was delayed by -2.1255476829999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2801s for a response
I20260709 13:00:08.016466  4011 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:08.017999  4066 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.018558  4066 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.021416  4066 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:08.022017  1584 connection.cc:256] RPC call timeout handler was delayed by -1.9410476829999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3006s for a response
I20260709 13:00:07.969026  4252 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:08.026710  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:08.030884  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.031512  1543 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:08.031637  4155 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:08.032018  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 181681us
I20260709 13:00:08.033702  1543 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:08.031540  1611 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:08.030921  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.035827  2268 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:08.036258  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 54162.1us
I20260709 13:00:08.039645  4104 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.041787  4104 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.043370  4059 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.043274  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:08.043985  4059 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.044440  4059 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.044807  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.046341  4059 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:08.031673  4326 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.047122  4290 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.027740  4117 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.035594  1658 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.032821  4258 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:08.051020  4306 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:08.051580  4066 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:08.122396  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 64583.3us
I20260709 13:00:08.028249  4252 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.054351  4077 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:08.028318  2269 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
W20260709 13:00:08.055202  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.056802  4319 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.059281  1539 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:07.977394  3910 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.063268  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.065827  2243 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.023618  4268 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:08.071496  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.073128  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.079689  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.082702  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.111706  1585 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:08.112298  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.113607  1660 connection.cc:256] RPC call timeout handler was delayed by -1.4907731430000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 13:00:08.115041  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 135100us
I20260709 13:00:08.115823  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.130076  1692 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:08.121381  2268 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
W20260709 13:00:08.132334  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.132396  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 99681.3us
I20260709 13:00:08.124379  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.124816  1542 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:08.036077  4265 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.130846  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 47407.4us
I20260709 13:00:08.130641  1544 raft_consensus.cc:2368] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 13:00:08.132202  2275 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:08.137044  2277 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
W20260709 13:00:08.136997  1660 connection.cc:256] RPC call timeout handler was delayed by -1.2432731430000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 13:00:08.137236  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.138032  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.138705  2277 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:08.143214  2276 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:08.146946  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.147977  1658 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.122300  4066 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:08.137650  1660 connection.cc:256] RPC call timeout handler was delayed by -1.0452731430000313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 13:00:08.127308  4252 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.151677  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:08.153081  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 72496.7us
I20260709 13:00:08.126849  4011 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:08.158212  1585 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:08.122787  4306 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.160228  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.135426  4288 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.145696  4262 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:08.151593  4265 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.165124  2272 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:08.162786  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.163465  1539 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:08.151036  3910 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:08.166947  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 101231us
I20260709 13:00:08.108778  4017 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:00:08.165262  2271 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 13:00:08.169893  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:08.168532  2268 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:08.175015  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.175721  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.156742  4066 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.160336  4059 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:08.161167  4011 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.160521  4258 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:08.162235  4173 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.196189  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.195063  1694 raft_consensus.cc:2368] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9.
I20260709 13:00:08.162318  4092 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:08.201710  1686 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:08.166190  4306 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:08.205060  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 46924.7us
I20260709 13:00:08.202644  1687 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:08.206301  1690 raft_consensus.cc:2410] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:08.207667  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.170912  4262 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:08.205559  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 74214.4us
I20260709 13:00:08.213354  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2247) took 1485 ms. Trace:
I20260709 13:00:08.193499  4268 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:08.196336  4011 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.201535  4258 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.233914  1538 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:08.227846  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:08.227613  1585 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.167716  4085 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:00:08.214555  1692 rpcz_store.cc:276] 0709 13:00:06.723142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.808426 (+1085284us) service_pool.cc:224] Handling call
0709 13:00:07.835201 (+ 26775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.135398 (+300197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.203861 (+ 68463us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54000b13d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:08.208542 (+  4681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677382400}
I20260709 13:00:08.212383  4321 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:08.209259  4092 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.212877  4262 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.215160  4104 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:08.215041  4181 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:08.192206  4059 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.253947  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.187995  4288 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.205484  3985 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:00:08.245613  4008 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:08.265637  4008 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:08.266498  4008 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.269336  1540 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:08.272099  4180 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.273474  1617 raft_consensus.cc:2368] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4.
I20260709 13:00:08.276284  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2240) took 1556 ms. Trace:
I20260709 13:00:08.276684  1688 rpcz_store.cc:276] 0709 13:00:06.720227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.742292 (+1022065us) service_pool.cc:224] Handling call
0709 13:00:07.749273 (+  6981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.796238 (+ 46965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.796259 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.814233 (+ 17974us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.968335 (+154102us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:08.161164 (+192829us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.161408 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.161466 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.276061 (+114595us) raft_consensus.cc:1685] finished
0709 13:00:08.276085 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.276222 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11585,"prepare.queue_time_us":144918,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2053,"raft.queue_time_us":5102,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":24202,"thread_start_us":255300,"threads_started":2,"wal-append.queue_time_us":343706}
I20260709 13:00:08.279472  4319 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:08.237278  4258 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.279481  4041 tablet_copy_client.cc:538] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:08.283178  3772 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:08.283303  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 55523.7us
W20260709 13:00:08.284240  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 56848.1us
I20260709 13:00:08.284885  2243 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.285342  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:08.285640  2243 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.286574  4329 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:08.287014  4329 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.287381  4329 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.287642  2241 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:08.288594  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 57717.8us
I20260709 13:00:08.289790  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:08.226822  4169 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:00:08.290848  4155 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:08.290920  4321 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:08.291587  4155 raft_consensus.cc:2764] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:00:08.291790  4331 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:00:08.292280  4155 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:08.283583  3772 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:08.292855  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2242) took 1571 ms. Trace:
I20260709 13:00:08.293258  3772 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.292716  4155 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:08.252076  4092 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.253084  4104 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.308929  4104 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.309105  4155 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.293382  1685 rpcz_store.cc:276] 0709 13:00:06.721124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.741271 (+1020147us) service_pool.cc:224] Handling call
0709 13:00:07.750184 (+  8913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.757293 (+  7109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.757318 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.771267 (+ 13949us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.962795 (+191528us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:07.962837 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.962899 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.292604 (+329705us) raft_consensus.cc:1685] finished
0709 13:00:08.292629 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.292793 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":135736,"threads_started":1,"wal-append.queue_time_us":345379}
I20260709 13:00:08.251782  4268 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:08.307571  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 56653us
I20260709 13:00:08.226890  4173 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.335402  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:08.261853  4059 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.332484  4321 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.337776  4265 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:08.337368  4268 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.340220  3772 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.307142  4181 raft_consensus.cc:697] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:08.380077  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.387140  3772 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:08.385226  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:08.393357  1692 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.394506  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.375053  4117 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:08.390709  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.388569  4061 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:08.396088  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.405824  1685 raft_consensus.cc:2393] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:08.397984  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 229113us
W20260709 13:00:08.407596  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 76806.5us
I20260709 13:00:08.408171  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.414923  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1784) took 1125 ms. Trace:
I20260709 13:00:08.415748  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.417577  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.422163  1685 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:08.416998  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 505) took 1685 ms. Trace:
W20260709 13:00:08.417794  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 171614us
I20260709 13:00:08.396092  4290 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.411839  4159 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:00:08.425601  1585 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.420130  1536 rpcz_store.cc:276] 0709 13:00:07.289384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.992711 (+703327us) service_pool.cc:224] Handling call
0709 13:00:07.992955 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.993190 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:08.195731 (+202541us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.414545 (+218814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:08.414597 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:08.414645 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.414725 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.414858 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":268036,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":439,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":3531,"thread_start_us":360805,"threads_started":2}
I20260709 13:00:08.415834  4061 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:08.436219  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 150609us
I20260709 13:00:08.439468  3772 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:08.436157  1658 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.437469  1585 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.441522  4265 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:08.443821  4061 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.447413  2243 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.448247  3772 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:08.448611  3772 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.448896  3772 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.453019  4011 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.424890  1689 rpcz_store.cc:276] 0709 13:00:06.731539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.851810 (+1120271us) service_pool.cc:224] Handling call
0709 13:00:07.883646 (+ 31836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.923297 (+ 39651us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:08.212179 (+288882us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.416548 (+204369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:08.416617 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:08.416677 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.416823 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.416944 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1840,"prepare.queue_time_us":107234,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":17634,"thread_start_us":433758,"threads_started":2}
I20260709 13:00:08.454560  2243 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.455560  1585 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.458487  3772 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.460839  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.437181  4319 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:08.472369  4321 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:08.472993  4321 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.460469  4066 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.473425  4321 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:08.475273  4341 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:00:08.458619  4262 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.477782  4262 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:08.470559  1693 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
W20260709 13:00:08.481372  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48627.6us
I20260709 13:00:08.483402  2243 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.485143  4159 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:08.485769  4159 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:08.486799  4159 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.488399  4181 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:08.491456  4288 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:08.502190  4104 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.478497  4262 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:08.475170  4066 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:08.458549  4047 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:08.512022  3772 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:08.525319  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:08.520709  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 57169.1us
I20260709 13:00:08.526226  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:08.526916  1540 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:08.547122  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 259488us
I20260709 13:00:08.506563  4319 raft_consensus.cc:697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:08.576099  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:08.520159  4047 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.481604  4169 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:00:08.575176  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.589442  1538 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
W20260709 13:00:08.587791  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 115641us
I20260709 13:00:08.524895  4180 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.605585  1692 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:08.615088  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:08.615257  1540 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
W20260709 13:00:08.616858  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 90147.2us
I20260709 13:00:08.614953  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1596) took 1508 ms. Trace:
W20260709 13:00:08.599901  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 170095us
I20260709 13:00:08.618790  1537 rpcz_store.cc:276] 0709 13:00:07.106747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.975207 (+868460us) service_pool.cc:224] Handling call
0709 13:00:07.981241 (+  6034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.037094 (+ 55853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.037123 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.112752 (+ 75629us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.493193 (+380441us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:08.493232 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.493299 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.614735 (+121436us) raft_consensus.cc:1685] finished
0709 13:00:08.614757 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.614901 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13636,"raft.queue_time_us":97804,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":34168,"thread_start_us":340490,"threads_started":1,"wal-append.queue_time_us":478358}
I20260709 13:00:08.615837  4173 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.629680  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.595722  4047 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.634899  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.639137  1693 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:08.639958  1659 leader_election.cc:336] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.524s (SENT)
I20260709 13:00:08.546916  4252 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:08.643688  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.643798  1617 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:08.655396  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.607213  4155 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:08.588244  4329 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:08.650460  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 52200.4us
I20260709 13:00:08.671942  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:08.660221  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.674049  1613 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:08.660384  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.661841  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:08.649610  4326 consensus_meta.cc:287] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.003s
I20260709 13:00:08.675509  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:08.661723  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 205410us
I20260709 13:00:08.683037  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.667449  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.667320  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:08.685081  1612 raft_consensus.cc:2368] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7.
I20260709 13:00:08.643136  4265 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:08.687042  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 47115.4us
I20260709 13:00:08.708369  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:08.668936  4155 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:08.692576  4347 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:08.693535  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:08.718981  1543 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.694203  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:08.719272  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:08.706599  4319 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:08.697885  4287 consensus_meta.cc:287] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.040s	user 0.004s	sys 0.009s
I20260709 13:00:08.741140  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.699283  1692 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:00:08.701310  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.701967  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.703783  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:08.704694  4349 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:08.708434  1659 leader_election.cc:336] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.877s (SENT)
I20260709 13:00:08.688391  4329 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:08.709715  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:08.625043  4061 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:00:08.713292  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.715394  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:08.716280  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.750566  1694 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 13:00:08.716454  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:08.719753  1540 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.695391  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:08.734511  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 104771us
I20260709 13:00:08.752149  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:08.735632  1618 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:08.706318  4258 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:08.752617  1544 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.753538  2273 raft_consensus.cc:2410] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:00:08.743026  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:08.658277  4350 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:08.707406  4104 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.718590  4155 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:08.741731  3910 consensus_meta.cc:287] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 13:00:08.760079  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:08.762132  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48884.3us
I20260709 13:00:08.797258  1658 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:08.734187  4262 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:08.735366  4011 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.792140  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:08.740765  4077 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.744750  4349 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:08.796259  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 87837.9us
I20260709 13:00:08.773171  1540 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:08.795440  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.798517  1509 leader_election.cc:400] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9.
I20260709 13:00:08.828493  1509 leader_election.cc:403] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:00:08.823634  1510 consensus_peers.cc:597] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:08.829209  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 153798us
I20260709 13:00:08.824870  1690 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.829824  1510 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:08.830528  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 220883us
W20260709 13:00:08.831370  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 122985us
I20260709 13:00:08.826011  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.832515  1614 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:08.791381  4159 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.798938  1686 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:08.832533  2243 leader_election.cc:400] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7.
I20260709 13:00:08.836313  1619 raft_consensus.cc:2393] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:08.836848  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 45391.7us
I20260709 13:00:08.836054  2243 leader_election.cc:403] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:00:08.844527  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 47339.8us
I20260709 13:00:08.795104  4350 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:08.753245  4287 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:08.850003  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 174532us
I20260709 13:00:08.792829  3819 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:08.856726  2241 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:08.790876  4359 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:08.859901  1510 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:08.829478  4349 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.869158  1510 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:08.848922  4099 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:08.873966  1541 raft_consensus.cc:2393] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:08.873031  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.887049  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.887856  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:08.800210  3910 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.859145  3819 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.851465  4169 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:00:08.907480  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.909025  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.873167  3985 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:08.910380  3985 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.910835  3985 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.912056  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 581) took 1142 ms. Trace:
I20260709 13:00:08.912159  1545 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:08.912425  1541 rpcz_store.cc:276] 0709 13:00:07.773841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.905525 (+131684us) service_pool.cc:224] Handling call
0709 13:00:08.911868 (+1006343us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b540027fbd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:08.912003 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180379392}
I20260709 13:00:08.913496  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1600) took 1338 ms. Trace:
I20260709 13:00:08.913661  4350 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.914050  4321 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.873303  4173 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:08.915696  3819 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:08.918020  4059 consensus_meta.cc:287] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 13:00:08.918880  4041 tablet_bootstrap.cc:492] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
W20260709 13:00:08.919392  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 59524.4us
I20260709 13:00:08.862835  4265 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.920310  4258 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:08.926630  4371 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:08.923156  4092 consensus_meta.cc:287] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.582s	user 0.003s	sys 0.010s
I20260709 13:00:08.891804  4359 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.902773  4329 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:08.970831  4329 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:08.971038  4365 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:08.971241  4329 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:08.973341  4348 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:00:08.913861  1545 rpcz_store.cc:276] 0709 13:00:07.577209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.019426 (+442217us) service_pool.cc:224] Handling call
0709 13:00:08.911990 (+892564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.912592 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.913313 (+   721us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540027fbd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:08.913437 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051757440}
I20260709 13:00:08.907693  4288 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:08.975026  4262 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.975533  4288 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:08.976497  4288 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.977617  4288 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.929371  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.929978  1691 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:08.932365  3772 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:08.979218  3772 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:08.979569  3772 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.887662  4085 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:08.979698  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:08.980001  4085 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.980334  1618 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.980425  4085 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.982173  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:08.925330  4306 consensus_meta.cc:287] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.000s
I20260709 13:00:08.982915  4306 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.941084  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:08.941969  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 96839.8us
I20260709 13:00:08.984463  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:08.942411  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 73308.2us
I20260709 13:00:08.955041  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:08.875017  4362 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:00:08.955631  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:08.959580  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 102876us
I20260709 13:00:08.896502  4099 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:08.908951  3910 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.965659  4092 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:08.967669  4359 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:08.925313  4169 raft_consensus.cc:3055] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:08.931972  4173 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.988445  3772 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:08.996254  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 140701us
W20260709 13:00:08.994199  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 161747us
I20260709 13:00:08.954907  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:09.000720  3772 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:08.992561  1510 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:08.995644  4063 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:09.011178  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:09.011477  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:09.012162  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:09.009225  4252 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:09.014528  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:09.010236  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 69459.6us
I20260709 13:00:09.007814  1611 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:09.007968  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:09.027632  1545 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:09.031005  1659 leader_election.cc:336] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 2.032s (SENT)
I20260709 13:00:09.031531  1659 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:09.015661  1541 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.005421  1615 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:08.983989  4181 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:09.026083  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:09.038800  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 78829.7us
I20260709 13:00:09.036983  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:09.041159  1660 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:08.956975  4059 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:08.998643  4173 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.998283  4104 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.998456  4169 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:09.060300  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 46445.3us
I20260709 13:00:09.060873  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:09.063496  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:09.065774  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:09.038969  4181 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.083811  4181 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:09.087383  4092 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:09.088006  4287 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:09.044255  4117 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:09.076069  4252 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:09.076277  4258 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.076398  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:09.076766  1617 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:09.077580  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 46602.3us
I20260709 13:00:09.079567  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:09.119254  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:09.078168  4358 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:09.080075  4169 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:09.067492  4362 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:09.121097  4362 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.121510  4362 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:09.122983  4388 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.123689  4359 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:09.123493  4388 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:09.124068  4359 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:09.124543  4359 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.095242  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:09.013885  4329 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.063870  4063 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:09.131269  1616 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:09.120612  4169 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:09.139498  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 113475us
I20260709 13:00:09.140511  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:09.131383  1618 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
W20260709 13:00:09.117259  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 76202.9us
W20260709 13:00:09.117579  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 53799.1us
I20260709 13:00:09.008387  4099 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:09.118636  4367 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:09.177749  1690 raft_consensus.cc:2410] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:00:09.179479  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 60275.2us
I20260709 13:00:09.733799  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:09.217893  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.132692  4379 raft_consensus.cc:2764] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:09.134737  4287 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:09.180307  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:09.333458  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.730052  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:09.726846  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:09.839800  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.840144  2275 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:09.714380  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:09.183826  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:09.694665  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 512298us
I20260709 13:00:09.819463  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:09.843032  1659 leader_election.cc:336] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 2.067s (SENT)
I20260709 13:00:09.735138  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:09.694675  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 554137us
I20260709 13:00:09.454475  1545 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:09.747682  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:09.267673  1541 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
W20260709 13:00:09.317889  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 90484.4us
I20260709 13:00:09.847513  2273 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:09.682883  1544 consensus_meta.cc:287] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.930s	user 0.010s	sys 0.005s
W20260709 13:00:09.702402  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 638837us
I20260709 13:00:09.818809  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:09.201444  1543 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:09.434923  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:09.694962  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:09.841553  1611 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:09.841391  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:09.849686  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1802) took 1158 ms. Trace:
I20260709 13:00:09.848443  1544 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:09.328583  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:09.851758  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1805) took 1142 ms. Trace:
I20260709 13:00:09.852062  2268 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 4: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:09.851085  1543 rpcz_store.cc:276] 0709 13:00:08.691382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.693322 (+  1940us) service_pool.cc:224] Handling call
0709 13:00:09.849628 (+1156306us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:09.196732  4372 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:09.853183  1510 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:09.180661  1618 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:09.860415  2276 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:09.860716  1510 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:09.773514  4349 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.888s	user 0.006s	sys 0.001s
I20260709 13:00:09.843901  1536 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.434902  1440 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.216094  4104 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.852089  1544 rpcz_store.cc:276] 0709 13:00:08.709681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.709824 (+   143us) service_pool.cc:224] Handling call
0709 13:00:09.851708 (+1141884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:09.189761  4357 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:09.684527  4346 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.027s
I20260709 13:00:09.755015  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:09.852849  3825 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9.
W20260709 13:00:09.765712  4389 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.327s	user 0.003s	sys 0.000s
W20260709 13:00:09.507548  4371 consensus_meta.cc:287] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
W20260709 13:00:09.771629  4359 consensus_meta.cc:287] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
W20260709 13:00:09.777161  3819 consensus_meta.cc:287] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.817s	user 0.009s	sys 0.000s
W20260709 13:00:09.816181  4362 consensus_meta.cc:287] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.000s
W20260709 13:00:09.771435  4288 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.000s
I20260709 13:00:09.750377  4388 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:09.193447  4383 log.cc:927] Time spent T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:00:09.770326  4169 consensus_meta.cc:287] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.000s
I20260709 13:00:09.851117  1613 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.746219  4376 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:09.925482  1536 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:09.189940  4180 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:09.685456  4047 consensus_meta.cc:287] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.002s	user 0.008s	sys 0.003s
I20260709 13:00:09.715263  4326 raft_consensus.cc:2764] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:09.916420  4362 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.200282  4066 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:09.841598  4377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.010s
I20260709 13:00:09.867342  1440 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 6, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:09.856034  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:09.727756  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:09.293793  4306 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:09.845446  4391 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.191679  4059 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:09.216786  4117 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:09.717211  4329 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:09.852982  4290 raft_consensus.cc:2764] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:09.885394  1612 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:09.768115  4155 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.944s	user 0.005s	sys 0.003s
I20260709 13:00:09.888732  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:09.961647  2274 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:09.884680  4346 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.006s	sys 0.027s
I20260709 13:00:09.881242  4381 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.963137  4381 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.965399  4381 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:09.896353  1618 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:09.966655  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:09.196184  4181 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:09.967880  1619 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:09.968876  4181 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:09.885074  4357 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:09.969563  4357 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.437644  4173 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.976289  4173 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:09.880827  4379 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:09.976933  4379 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:09.977340  4379 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.400758  4085 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.981312  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:09.982326  4085 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:09.323951  3985 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.951346  4169 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:09.984695  3985 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:09.984757  4169 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:09.899521  2276 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 LEARNER]: Advancing to term 3
I20260709 13:00:09.889919  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:09.985780  4169 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:09.986253  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 105735us
I20260709 13:00:09.986364  1537 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:09.863867  4392 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:09.883571  4104 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.987082  4392 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:09.987499  4392 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:09.987534  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:09.988514  4104 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:09.203128  4063 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:09.928514  4180 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.191644  4321 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:09.878582  4349 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.203809  4369 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:09.915742  4371 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7.
I20260709 13:00:09.937656  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1847) took 1136 ms. Trace:
I20260709 13:00:09.937804  1613 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
W20260709 13:00:09.942874  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 86885us
I20260709 13:00:09.940384  1440 catalog_manager.cc:5697] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:09.950371  1542 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:09.913689  3819 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:09.913497  4359 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:09.935377  4377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.010s	sys 0.011s
I20260709 13:00:09.927527  4376 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:09.956355  4362 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:09.950842   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:09.960006  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.931499  4066 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:09.912423  1616 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:09.927088  4047 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:09.992753  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:09.993047  2275 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:09.993052  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:09.993330  1618 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:09.994920  2273 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:09.958914  4117 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.003660  1440 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 5, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.031852  1617 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:09.999404  1614 rpcz_store.cc:276] 0709 13:00:08.801089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.845397 (+ 44308us) service_pool.cc:224] Handling call
0709 13:00:08.862867 (+ 17470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.938843 (+ 75976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.938871 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.960384 (+ 21513us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.068256 (+107872us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:09.121332 (+ 53076us) log.cc:844] Serialized 14 byte log entry
0709 13:00:09.154408 (+ 33076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.154475 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.208986 (+ 54511us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b18003f4f00. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:09.544533 (+335547us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:09.937417 (+392884us) raft_consensus.cc:1685] finished
0709 13:00:09.937442 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.937589 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105422,"prepare.queue_time_us":57483,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":14287,"raft.queue_time_us":135082,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":16489,"spinlock_wait_cycles":169704576,"thread_start_us":29196,"threads_started":1,"wal-append.queue_time_us":217656}
I20260709 13:00:10.035910  2268 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:09.998310  4381 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:09.998509  4306 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:10.044554  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:10.044773  4306 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:10.044373  4381 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.045267  2275 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:09.997203  4369 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:09.991091  4155 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.050539  1620 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:10.029784  3985 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.056413  1613 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:10.045898  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 55615.7us
I20260709 13:00:10.050285  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.060290  2268 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:10.058301  1612 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:10.037055  4380 raft_consensus.cc:2764] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:09.959275  4391 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.013885  4329 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:00:10.073532  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 81091.4us
I20260709 13:00:10.078027  1616 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:10.041456  1440 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 7, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.078913  2271 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:10.045279  4306 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.084877  1614 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:10.057948  4381 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.089074  4349 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:10.093909  4392 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.075191  4403 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:10.099795  2272 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:10.105695  2274 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:10.110284  1612 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:10.101043  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.110208  2275 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:10.111092  2273 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.098637  2270 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:10.099977  4391 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:10.112561  3819 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:10.116305  4066 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:10.117019  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 516) took 1472 ms. Trace:
I20260709 13:00:10.117470  4066 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.117416  1620 rpcz_store.cc:276] 0709 13:00:08.644539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.645489 (+   950us) service_pool.cc:224] Handling call
0709 13:00:10.116858 (+1471369us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540036e554. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:10.116967 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3162908032}
I20260709 13:00:10.087469  4371 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:00:10.065363  4362 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:00:10.122488  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1809) took 1120 ms. Trace:
I20260709 13:00:10.122879  1537 rpcz_store.cc:276] 0709 13:00:09.002398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.002581 (+   183us) service_pool.cc:224] Handling call
0709 13:00:10.122332 (+1119751us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54001851d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:10.122438 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232018304}
W20260709 13:00:10.116340  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1861) took 1193 ms (client timeout 1560 ms). Trace:
W20260709 13:00:10.127336  1619 rpcz_store.cc:269] 0709 13:00:08.922582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.014205 (+ 91623us) service_pool.cc:224] Handling call
0709 13:00:10.116165 (+1101960us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b5400250654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:10.116285 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2163360000}
I20260709 13:00:10.111611  1440 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 6 to 8, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.101356  4047 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:10.066817  3985 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:10.102962  4376 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:10.112123  4359 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:10.133460  1440 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:00:10.148109  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 86379.9us
I20260709 13:00:10.121587  4403 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:10.134315  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 81682.5us
W20260709 13:00:10.152824  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 309291us
I20260709 13:00:10.153991  1611 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:00:10.135737  4400 log.cc:927] Time spent T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
I20260709 13:00:10.172327  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:10.168220  1440 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.186328  1658 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:10.127727  4117 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:10.160949  2241 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:10.171439  2243 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:10.191493  1658 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:10.188005  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 493068us
I20260709 13:00:10.198770  1660 leader_election.cc:400] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4.
W20260709 13:00:10.198684  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 1.01827e+06us
I20260709 13:00:10.199290  1660 leader_election.cc:403] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:10.200101  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:10.177875  4392 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:10.203253  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:10.160421  4403 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.193100  1440 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 6, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:10.216773  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.218286  1440 catalog_manager.cc:5697] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:10.189229  4180 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:10.160508  4362 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:00:10.171557  4349 consensus_queue.cc:1059] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:10.194262  4407 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:10.191756  4376 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:10.168493  4377 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:00:10.168382  4413 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:00:10.170831  4408 consensus_queue.cc:1059] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:00:10.219614  4329 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:10.225087  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:10.172431  4357 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:10.227427  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.247785  2270 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.203982  4359 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:10.170938  4410 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:00:10.256386  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:10.235426  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 64016.4us
I20260709 13:00:10.228128  4047 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:10.239529  1440 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 6 to 7, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.242308  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.195168  4381 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:10.262254  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 65673.6us
I20260709 13:00:10.246606  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.202924  4404 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:10.237061  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.258880  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:10.224747  4416 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:10.261379  2273 raft_consensus.cc:2368] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4.
I20260709 13:00:10.262928  1658 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:10.262408  1440 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 3, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:10.264810  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:10.266117  1615 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:10.247200  4417 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:10.269840  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.270186  2277 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:10.270486  1440 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 4, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.288820  1440 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 6, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:10.271485  4117 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:10.273476  4357 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:10.257018  4155 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:10.255457  4379 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.267956  4416 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.256026  4359 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.290232  1440 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 6 to 7, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.291357  2274 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.279146  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.332787  4359 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:10.332943  4419 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:10.333454  4419 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:10.336381  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.260969  4377 raft_consensus.cc:3055] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:10.340483  4377 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:10.341495  1616 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:10.341297  4377 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.342283  4377 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.292778  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:10.343377  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 50663.1us
I20260709 13:00:10.344022  1585 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:10.296662  4407 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:10.260855  4047 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:10.305517  1584 leader_election.cc:400] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4.
I20260709 13:00:10.371172  4047 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.371809  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:10.268806  4392 consensus_queue.cc:1059] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:00:10.372573  2269 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.372692  4329 raft_consensus.cc:3055] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:10.372963  4392 raft_consensus.cc:3055] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:10.373127  4329 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:10.373380  4392 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:10.269498  4180 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:10.373970  4329 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.376499  4329 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.318249  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.379194  2277 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
W20260709 13:00:10.324153  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 130327us
I20260709 13:00:10.381682  4407 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.382377  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:10.380987  4346 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:10.324239  4381 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:10.266588  4405 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:10.326992  3985 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:10.322175  4416 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.392740  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:10.393455  2270 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 3: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.305835  4169 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:10.330890  4421 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:10.344696  1440 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:00:10.404361  1440 catalog_manager.cc:5697] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 5, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:10.347738  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1862) took 1392 ms. Trace:
I20260709 13:00:10.366873  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.367698  4357 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:10.368619  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1863) took 1364 ms. Trace:
I20260709 13:00:10.370321  1585 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:10.367774  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.425487  1440 catalog_manager.cc:5697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 1 to 2, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
W20260709 13:00:10.389438  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.383826  4346 raft_consensus.cc:697] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:10.391129  4180 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:10.391582  4117 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:10.319667  4417 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.405617  1611 rpcz_store.cc:276] 0709 13:00:08.955337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.863773 (+908436us) service_pool.cc:224] Handling call
0709 13:00:09.884763 (+ 20990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.185037 (+300274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.347449 (+162412us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54001117d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:10.347672 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618525952}
I20260709 13:00:10.424989  2272 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.425356  1615 rpcz_store.cc:276] 0709 13:00:09.004193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.868258 (+864065us) service_pool.cc:224] Handling call
0709 13:00:09.890747 (+ 22489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.269193 (+378446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.368370 (+ 99177us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54003a1e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:10.368561 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845714688}
I20260709 13:00:10.334268  4419 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:10.506475  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.669538  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:10.431339  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 61088.3us
I20260709 13:00:10.688508  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:10.503554  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 240653us
W20260709 13:00:10.698184  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 314381us
W20260709 13:00:10.488988  1659 leader_election.cc:336] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 3.272s (SENT)
I20260709 13:00:10.701217  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:10.697962  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 405109us
I20260709 13:00:10.702203  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.703197  2273 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:10.697476  1658 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:10.687678  4306 consensus_meta.cc:287] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.011s
I20260709 13:00:10.394865  4376 raft_consensus.cc:697] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:10.695453  1585 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:10.446278  4401 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:10.691329  4379 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:10.711504  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:10.445977  4357 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:10.713303  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.719775  2274 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.490375  4169 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:10.609865  4359 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:10.691282  4047 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.707792  4265 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:10.712024  4059 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:10.506304  4403 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:10.734738  2274 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:10.712347  4401 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.709189  4321 consensus_queue.cc:1059] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:00:10.512421  4369 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.736598  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.740190  1613 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:10.738776  4265 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:10.748399  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 259422us
W20260709 13:00:10.757124  1659 leader_election.cc:336] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.710s (SENT)
I20260709 13:00:10.757623  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:10.748442  2272 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:10.664799  4346 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:10.760823  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 49368.5us
I20260709 13:00:10.762449  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:10.763124  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.751520  1585 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:10.770066  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 59862.5us
I20260709 13:00:10.738998  4401 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.712438  4306 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:10.752883  4403 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:10.762614  4376 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.774309  4066 raft_consensus.cc:3055] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:10.774642  4066 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:10.775435  4066 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.775951  4359 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:10.776575  4359 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:10.776695  4066 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:10.777057  4359 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:10.777872  4359 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:10.778872  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.751834  4369 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.780660  4429 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.781908  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:10.791244  1659 leader_election.cc:336] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.719s (SENT)
I20260709 13:00:10.782091  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:10.791903  2276 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:10.792119  1659 leader_election.cc:336] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.797s (SENT)
I20260709 13:00:10.792488  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:10.793960  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.794225  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:10.782550  2272 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:10.796303  4392 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.797287  4290 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.797762  4290 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:10.803133  2276 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
W20260709 13:00:10.781105  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 83679.3us
W20260709 13:00:10.806066  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 43682us
I20260709 13:00:10.752696  4417 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:10.807711  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:10.787182  4431 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:10.780663  4423 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:10.811674  4117 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:10.786563  4169 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:10.816340  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 45262.7us
W20260709 13:00:10.816799  1659 leader_election.cc:336] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.700s (SENT)
W20260709 13:00:10.817770  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.818840  1660 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:10.747905  4422 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:10.762794  4265 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:10.823774  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.756901  4405 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:00:10.826548  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:10.831167  1537 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:10.837257  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.840102  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:10.840842  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.840010  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:10.841670  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.786257  4421 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4.
I20260709 13:00:10.855535  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:10.820588  2269 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.859193  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:10.822383  4428 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:10.735011  4180 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.845959  2270 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.851742  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:10.866282  1543 raft_consensus.cc:2368] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 13:00:10.852037  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:10.866780  2277 raft_consensus.cc:2368] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:10.852317  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:10.867657  1541 raft_consensus.cc:2410] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:10.853348  1538 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:10.853955  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:10.868566  1542 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.844497  2276 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.845595  2275 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.843312  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.869853  2271 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:10.853327  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:10.863811  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:10.865046  1585 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:10.825682  4403 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:10.858597  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 13:00:10.871814  1690 raft_consensus.cc:606] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:10.872135  1690 raft_consensus.cc:614] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:10.870875  1545 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:10.871471  4403 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:10.834018  4063 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:10.876997  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:10.879276  2272 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:10.884179  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:10.880496  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:10.882153  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:10.814602  4321 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:00:10.889428  2276 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:10.882450  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:10.920383  1686 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:10.920847  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.891602  1539 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:10.844573  3819 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:10.884913  1538 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
W20260709 13:00:10.876792  4404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.004s
I20260709 13:00:10.806262  4357 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.895862  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:10.898304  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:10.909950  4435 consensus_queue.cc:1059] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:10.839141  4427 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:00:10.911010  1693 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:10.831996  4099 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:00:10.833228  4420 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:00:10.882406  4379 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.913646  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:10.919324  1542 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:10.946930  2272 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:10.843979  4424 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:00:10.948001  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:10.948535  1539 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.927274  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:10.925294  1545 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:10.929733  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:10.930913  4438 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:10.954921  1538 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:10.931149  4425 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:00:10.975950  4432 log.cc:927] Time spent T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:00:10.978003  4377 consensus_meta.cc:287] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.000s
I20260709 13:00:10.927109  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.981042  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:10.981207  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:10.981629  1694 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 2.
I20260709 13:00:10.925606  2271 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:00:10.922266  4414 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.675s	user 0.004s	sys 0.000s
I20260709 13:00:10.940133  1541 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:10.940524  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.985707  2268 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:10.890097  4421 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:00:10.942281  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:10.926883  4404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.007s	sys 0.005s
I20260709 13:00:10.942955  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:10.988329  2270 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.936780  4047 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:10.951961  1584 connection.cc:256] RPC call timeout handler was delayed by -2.4829501489999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.36800000000000005s for a response
I20260709 13:00:10.951455  1689 raft_consensus.cc:2376] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4. Re-sending same reply.
W20260709 13:00:10.989130  1584 connection.cc:256] RPC call timeout handler was delayed by -1.8615912210000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 13:00:10.924465  4439 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:10.960124  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:10.971277  4416 consensus_meta.cc:287] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.000s
I20260709 13:00:10.974931  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:11.007344  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 170661us
I20260709 13:00:11.007743  1538 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.975715  1545 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:10.983057  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.986007  1544 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:10.936852  4423 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:10.986783  1693 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:10.987169  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:11.023671  1540 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:10.936729  3819 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:10.980715  2275 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:10.893276  4063 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:10.986244  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.990998  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:10.981650  1536 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:10.991827  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:11.033591  1541 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:11.004936  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:11.006490  1539 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:11.023681  2274 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:11.034747  2272 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:10.992970  1542 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.074198  1686 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:11.075045  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:11.075420  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 47295.6us
I20260709 13:00:11.076431  2268 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:11.079514  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:11.080087  1686 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 2.
I20260709 13:00:11.080920  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:11.081568  2270 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.987197  4438 raft_consensus.cc:697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:11.084992  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:10.987782  4404 raft_consensus.cc:697] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:10.992699  4439 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:11.016453  4435 raft_consensus.cc:3055] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:11.005286  4427 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:11.087633  2268 raft_consensus.cc:2368] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4.
W20260709 13:00:11.094889  1584 connection.cc:256] RPC call timeout handler was delayed by -1.6464912210000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
I20260709 13:00:10.953910  4379 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:11.023113  3985 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.990530  4377 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:11.093887  1685 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:11.099747  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:11.093492  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:11.147136  2272 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:11.117801  1542 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
W20260709 13:00:11.146883  1584 connection.cc:256] RPC call timeout handler was delayed by -1.4835912209999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
I20260709 13:00:11.147945  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:11.148587  1542 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:11.090359  1538 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:11.150000  1538 raft_consensus.cc:3055] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:11.150354  1538 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:11.093518  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:11.093185  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:11.148205  1584 connection.cc:256] RPC call timeout handler was delayed by -1.4403912210000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 13:00:11.151572  1584 connection.cc:256] RPC call timeout handler was delayed by -1.4070912210000301s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:00:11.151963  1584 connection.cc:256] RPC call timeout handler was delayed by -1.3854912209999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
W20260709 13:00:11.152287  1584 connection.cc:256] RPC call timeout handler was delayed by -1.3332912210000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260709 13:00:11.155668  2270 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:11.156724  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:11.163172  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:11.163892  1686 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:11.169512  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.166338  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:11.171674  1541 raft_consensus.cc:2410] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:11.178169  1543 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:11.032081  4416 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:11.029650  4099 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:00:11.179983  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:10.991345  4403 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:11.086704  4441 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:11.085517  4059 raft_consensus.cc:697] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:11.085696  4117 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:11.077389  4423 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:11.183825  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:11.397447  1542 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:11.397682  2275 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:11.241739  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 376690us
W20260709 13:00:11.267979  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.288825  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.184343  1541 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:11.184096  1620 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:11.236016  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 293350us
I20260709 13:00:11.344432  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:11.401635  1689 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:11.344173  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:11.236244  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 207620us
W20260709 13:00:11.404343  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 394593us
I20260709 13:00:11.404943  1612 raft_consensus.cc:2368] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9.
I20260709 13:00:11.201155  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:11.406023  1685 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:11.401991  1613 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:11.408706  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 166378us
I20260709 13:00:11.404242  1510 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:11.411010  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.413103  2269 consensus_meta.cc:287] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.003s
I20260709 13:00:11.413419  2269 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:11.108413  4427 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:11.411100  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:11.414542  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 831) took 1023 ms. Trace:
I20260709 13:00:11.415160  2268 raft_consensus.cc:2368] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:11.417125  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:11.414558  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:11.415117  2269 rpcz_store.cc:276] 0709 13:00:10.390529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.793951 (+403422us) service_pool.cc:224] Handling call
0709 13:00:11.413809 (+619858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.201534  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:11.109689  4435 raft_consensus.cc:740] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:11.214111  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:11.422817  2272 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:11.409857  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:11.200634  1645 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:40935 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:40935 timed out after 15.000s (SENT)
I20260709 13:00:11.421463  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:11.083297  4306 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:11.146508  4377 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:11.423967  2270 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:11.428133  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:11.486558  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:11.486820  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:11.431589  1687 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:11.202863  1538 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:11.492878  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:11.495451  2268 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:11.492489  1685 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:11.490610  2269 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:11.201511  4416 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:11.496321  1615 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:11.517246  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.550426  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.488655  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:11.559351  1620 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:11.587456  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:11.589337  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:11.590245  2270 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:11.419203  4047 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:11.164614  3985 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:11.601933  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:11.604190  1685 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:11.605099  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:11.588088  2272 raft_consensus.cc:2376] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5. Re-sending same reply.
I20260709 13:00:11.608415  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:11.344941  3819 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:11.628633  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:11.629298  1659 leader_election.cc:336] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.970s (SENT)
I20260709 13:00:11.696453  1659 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:11.610327  2270 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:11.615536  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 211350us
W20260709 13:00:11.698297  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.587668  4429 consensus_meta.cc:287] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.800s	user 0.009s	sys 0.000s
I20260709 13:00:11.343964  4438 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:11.683331  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.701535  2269 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:11.695672  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:11.683581  1538 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:11.653723  4117 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:11.712150  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:11.711458  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.753197  2241 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.542s (SENT) [suppressed 57 similar messages]
I20260709 13:00:11.389405  4404 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:11.624557  4419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.017s	sys 0.004s
I20260709 13:00:11.773384  1687 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:11.420189  4441 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:11.313558  4439 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:11.789597  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:11.791033  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:11.792234  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:11.793987  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:11.652266  4456 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:11.772274  4329 consensus_meta.cc:287] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.395s	user 0.011s	sys 0.000s
I20260709 13:00:11.796816  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:11.797631  1611 raft_consensus.cc:2410] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:11.796816  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:11.798437  1690 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.707984  4099 consensus_queue.cc:1243] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:11.745621  4429 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:11.803972  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:11.622139  4047 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:11.824280  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.837744  1689 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
W20260709 13:00:11.804613  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 318110us
I20260709 13:00:11.839285  1687 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.788987  4454 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:11.837355  4453 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.566s	user 0.000s	sys 0.001s
I20260709 13:00:11.794651  4379 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:11.847203  1690 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:11.859644  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:11.861884  1690 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:11.855808  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:11.863197  1611 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:11.862655  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:11.866241  1690 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:11.857623  1509 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:11.867957  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 238654us
I20260709 13:00:11.839866  4439 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.873670  1690 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:11.873997  1659 leader_election.cc:336] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 2.057s (SENT)
I20260709 13:00:11.874177  1690 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:11.875211  1659 leader_election.cc:336] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 2.110s (SENT)
I20260709 13:00:11.773403  4377 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:11.773056  4059 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:11.878963  1690 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:11.623049  4427 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:11.882634  4462 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.876264  4379 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:11.884061  4466 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:11.884552  4473 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.878620  4376 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.885658  1690 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.888019  3985 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:11.889108  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 834) took 1023 ms. Trace:
I20260709 13:00:11.891980  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:11.900038  1511 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.519s (SENT)
W20260709 13:00:11.901964  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44417.5us
W20260709 13:00:11.881714  4445 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.499s	user 0.000s	sys 0.001s
W20260709 13:00:11.905221  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 152020us
W20260709 13:00:11.955621  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.956264  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:11.957098  1611 raft_consensus.cc:2393] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:11.914942  4451 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.511s	user 0.000s	sys 0.001s
I20260709 13:00:11.919256  1619 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:11.962481  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:11.958359  2271 rpcz_store.cc:276] 0709 13:00:10.866048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.879567 (+ 13519us) service_pool.cc:224] Handling call
0709 13:00:10.923395 (+ 43828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.987260 (+ 63865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.888922 (+901662us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b54006702d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:11.889051 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47613184}
I20260709 13:00:11.915201  4377 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:11.985396  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 45477.6us
I20260709 13:00:11.987114  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:11.995791  1659 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:11.998765  1509 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:11.999818  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:12.002831  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:12.007282  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:12.008523  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:11.871403  4423 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:12.020509  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:12.021696  1545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.004s	sys 0.024s
W20260709 13:00:12.023747  1545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.004s	sys 0.024s
I20260709 13:00:11.989097  4468 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:00:12.023098  1611 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:12.027374  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:12.032310  2277 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:11.958968  4376 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:00:12.033156  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.036942  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.037258  2241 connection.cc:256] RPC call timeout handler was delayed by -3.8006268179999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 13:00:12.037550  2241 connection.cc:256] RPC call timeout handler was delayed by -3.6926268179999511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:00:12.037823  2241 connection.cc:256] RPC call timeout handler was delayed by -2.96488654999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:00:12.038080  2241 connection.cc:256] RPC call timeout handler was delayed by -2.9333865499999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:00:12.038369  2241 connection.cc:256] RPC call timeout handler was delayed by -2.6369268179999494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33180000000000004s for a response
W20260709 13:00:12.038631  2241 connection.cc:256] RPC call timeout handler was delayed by -2.5346865499999467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
W20260709 13:00:12.038910  2241 connection.cc:256] RPC call timeout handler was delayed by -2.3879865499999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:00:12.039137  2241 connection.cc:256] RPC call timeout handler was delayed by -1.7062239959999488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:00:12.034590  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 813) took 1220 ms. Trace:
I20260709 13:00:12.040385  2273 rpcz_store.cc:276] 0709 13:00:10.809967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.814053 (+  4086us) service_pool.cc:224] Handling call
0709 13:00:10.814405 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.814610 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.814637 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:10.815319 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.080543 (+265224us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:11.080585 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.080644 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.030415 (+949771us) raft_consensus.cc:1685] finished
0709 13:00:12.030441 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.030604 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":264840,"threads_started":1,"wal-append.queue_time_us":363967}
W20260709 13:00:12.041929  4449 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.484s	user 0.000s	sys 0.001s
I20260709 13:00:12.001688  4466 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:00:12.059552  1542 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:11.920111  4473 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:11.905731  4462 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:12.061642  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:12.078233  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.125171  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:12.125946  1689 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 2.
I20260709 13:00:12.126725  4379 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:11.805302  4456 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:12.128113  1659 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:12.125409  4401 consensus_meta.cc:287] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.322s	user 0.003s	sys 0.005s
I20260709 13:00:12.148252  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1632) took 1170 ms. Trace:
I20260709 13:00:12.169631  1545 rpcz_store.cc:276] 0709 13:00:10.977366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.207262 (+229896us) service_pool.cc:224] Handling call
0709 13:00:11.207566 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.207814 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:12.024306 (+816492us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.147834 (+123528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.147907 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:12.147971 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.148052 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.148186 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":864809,"threads_started":2}
I20260709 13:00:12.060214  4468 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
W20260709 13:00:12.171574  4457 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.165s	user 0.002s	sys 0.004s
W20260709 13:00:12.163970  4066 consensus_meta.cc:287] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.387s	user 0.013s	sys 0.001s
W20260709 13:00:12.171964  4447 log.cc:927] Time spent T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.167s	user 0.001s	sys 0.006s
I20260709 13:00:12.172824  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:12.173574  4428 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:12.172355  4401 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:12.173933  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:12.178646  1687 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
W20260709 13:00:12.604043  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 604214us
I20260709 13:00:12.604486  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1612) took 1263 ms. Trace:
I20260709 13:00:12.604601  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:12.604923  1687 rpcz_store.cc:276] 0709 13:00:11.340900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.793048 (+452148us) service_pool.cc:224] Handling call
0709 13:00:12.604381 (+811333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.605435  1689 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:12.293208  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.235822  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1599) took 1286 ms. Trace:
I20260709 13:00:12.608467  1691 rpcz_store.cc:276] 0709 13:00:10.891939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.892071 (+   132us) service_pool.cc:224] Handling call
0709 13:00:10.899371 (+  7300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.899658 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.899692 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:10.909099 (+  9407us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.248634 (+339535us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:11.248679 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.248737 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.178435 (+929698us) raft_consensus.cc:1685] finished
0709 13:00:12.178453 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.178561 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":339217,"threads_started":1,"wal-append.queue_time_us":873140}
W20260709 13:00:12.602550  1693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.009s	sys 0.008s
I20260709 13:00:12.606189  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:12.610610  1693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.009s	sys 0.008s
I20260709 13:00:12.611052  1687 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:12.201310  1537 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:00:12.317747  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.606968  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.616484  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.607184  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 479092us
W20260709 13:00:12.289598  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.617691  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:12.308142  1657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.004s	sys 0.009s
W20260709 13:00:12.607563  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 707438us
W20260709 13:00:12.624441  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 421402us
W20260709 13:00:12.619163  1657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.008s	sys 0.011s
W20260709 13:00:12.659135  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.286561  4475 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
W20260709 13:00:12.728379  1511 leader_election.cc:336] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.549s (SENT)
W20260709 13:00:12.774262  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 45925.8us
W20260709 13:00:12.594053  4377 consensus_meta.cc:287] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.603s	user 0.002s	sys 0.007s
I20260709 13:00:12.179347  4464 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:12.771035  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:12.771994  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:12.776428  1687 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
W20260709 13:00:12.594141  4439 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.001s
W20260709 13:00:12.598158  4481 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
W20260709 13:00:12.602435  4403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.003s	sys 0.013s
W20260709 13:00:12.285995  4470 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
W20260709 13:00:12.325074  4474 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:00:12.165285  4379 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.174675  4468 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:12.128520  4469 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.787925  1691 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:12.171743  1703 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-d53120c1adf947fd992e5950edf26301 received from {username='slave'} at 127.0.0.1:52426
W20260709 13:00:12.602226  4169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.004s	sys 0.012s
I20260709 13:00:12.786796  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:12.835750  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1598) took 1909 ms (client timeout 2062 ms). Trace:
I20260709 13:00:12.836359  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 852) took 1740 ms. Trace:
I20260709 13:00:12.146656  3985 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:12.836292  1692 rpcz_store.cc:269] 0709 13:00:10.881020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.881244 (+   224us) service_pool.cc:224] Handling call
0709 13:00:12.789734 (+1908490us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000b13d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:12.789886 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3263388416}
I20260709 13:00:12.836793  2275 rpcz_store.cc:276] 0709 13:00:11.096072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.706118 (+1610046us) service_pool.cc:224] Handling call
0709 13:00:12.836305 (+130187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.164822  4047 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:12.174952  4482 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:12.837297  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:12.178886  4483 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:12.838119  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:12.176553  4428 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.624s
I20260709 13:00:12.174894  4476 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.776s
I20260709 13:00:12.799337  1618 raft_consensus.cc:2410] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:12.627187  4329 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.174739  4487 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:12.870378  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 252716us
I20260709 13:00:12.960585  2268 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
W20260709 13:00:12.902316  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 278928us
I20260709 13:00:13.022101  1659 leader_election.cc:400] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:13.022454  1659 leader_election.cc:403] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:00:12.913334  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 307433us
I20260709 13:00:12.706516  4066 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.878895  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:13.026630  1692 raft_consensus.cc:2368] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7.
W20260709 13:00:12.842623  1545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.028s
W20260709 13:00:13.028295  1545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.000s	sys 0.042s
W20260709 13:00:12.856204  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 66899.8us
I20260709 13:00:12.855258  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2273) took 1782 ms. Trace:
I20260709 13:00:12.819044  1689 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 13:00:13.031585  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:13.032756  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:13.023427  1659 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:12.611887  4441 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:12.627041  4473 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:12.836483  4117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.007s	sys 0.027s
W20260709 13:00:12.789499  4403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.004s	sys 0.014s
W20260709 13:00:12.841312  4169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.009s	sys 0.017s
I20260709 13:00:12.792840  4468 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:13.057989  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.105579  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.075078  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.103055  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:13.107323  1687 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:12.880519  1703 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-d53120c1adf947fd992e5950edf26301 on tablet d53120c1adf947fd992e5950edf26301 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:12.870061  4290 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:12.790441  4462 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:13.112489  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:12.841313  4377 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.113845  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:13.132566  1692 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.058178  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:13.073933  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.034454  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.021864  4482 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.808349  4379 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:13.123062  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.123649  1511 leader_election.cc:336] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.571s (SENT)
I20260709 13:00:12.886901  4456 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:13.133874  1537 raft_consensus.cc:2393] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:13.034453  4493 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:13.159750  1511 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:13.165315  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 541) took 1102 ms. Trace:
I20260709 13:00:13.065693  4500 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:13.025533  4487 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.037949  4376 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:13.162737  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 137430us
W20260709 13:00:13.163437  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 140061us
I20260709 13:00:13.174317  1659 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:13.177564  1509 connection.cc:256] RPC call timeout handler was delayed by -1.6310209710000549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:00:13.123102  4483 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:13.132294  4441 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
W20260709 13:00:13.166057  1511 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.712s (SENT)
W20260709 13:00:13.183133  1511 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.713s (SENT)
I20260709 13:00:13.068722  4066 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.034090  4329 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.163913  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:12.857733  4469 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.035071  4491 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.131806  4485 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:13.165647  1689 rpcz_store.cc:276] 0709 13:00:12.062381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.073639 (+1011258us) service_pool.cc:224] Handling call
0709 13:00:13.164464 (+ 90825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.183542  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:13.159411  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 47002.6us
I20260709 13:00:13.212718  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.183842  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:13.213897  1537 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 3: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:13.185052  1687 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
W20260709 13:00:13.214178  1660 leader_election.cc:336] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.888s (SENT)
I20260709 13:00:13.214735  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 542) took 1048 ms. Trace:
I20260709 13:00:13.215132  1687 rpcz_store.cc:276] 0709 13:00:12.166113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.021651 (+855538us) service_pool.cc:224] Handling call
0709 13:00:13.214654 (+193003us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.171058  4487 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.215994  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.186220  1703 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.EndTabletCopySession from 127.0.0.1:52426 (request call id 533) took 1139 ms. Trace:
I20260709 13:00:13.162060  4377 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.223228  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.191741  1692 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:13.164882  4482 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:13.203317  1691 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:13.169629  4462 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:13.224373  1511 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.779s (SENT)
W20260709 13:00:13.246050  1660 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.108s (SENT)
I20260709 13:00:13.246235  1511 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:13.246479  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:13.181429  4501 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:13.221840  2241 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:13.247797  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:13.229887  1658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.002s	sys 0.009s
I20260709 13:00:13.204118  4456 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:13.247395  1511 leader_election.cc:336] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.825s (SENT)
W20260709 13:00:13.253106  1511 leader_election.cc:336] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.889s (SENT)
I20260709 13:00:13.253264  1541 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:13.224648  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 545) took 1049 ms. Trace:
W20260709 13:00:13.254882  1511 leader_election.cc:336] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.936s (SENT)
I20260709 13:00:13.254952  1692 rpcz_store.cc:276] 0709 13:00:12.174989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.076394 (+901405us) service_pool.cc:224] Handling call
0709 13:00:13.224602 (+148208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:13.255927  1511 leader_election.cc:336] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.980s (SENT)
I20260709 13:00:13.256206  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.219539  1703 rpcz_store.cc:276] 0709 13:00:12.046455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.047933 (+  1478us) service_pool.cc:224] Handling call
0709 13:00:13.186125 (+1138192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.265009  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:13.265702  1540 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:13.267102  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:13.267710  1612 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.272042  4377 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:13.272297  4329 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:13.272984  4420 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:13.245078  4401 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:13.273631  4496 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:00:13.274718  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1831) took 1226 ms. Trace:
I20260709 13:00:13.275067  1539 rpcz_store.cc:276] 0709 13:00:12.048290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.048411 (+   121us) service_pool.cc:224] Handling call
0709 13:00:12.048670 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.255500 (+206830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.255538 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.255587 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:12.255631 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.274464 (+1018833us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54002116d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:13.274516 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.274649 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475138816}
I20260709 13:00:13.276262  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:13.277134  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:13.276898  4502 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:00:13.278275  1539 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:13.182515  4468 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.280278  4468 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.282301  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.282883  1615 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
W20260709 13:00:13.283246  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2299) took 1224 ms (client timeout 1519 ms). Trace:
W20260709 13:00:13.283525  1615 rpcz_store.cc:269] 0709 13:00:12.059163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.282077 (+1222914us) service_pool.cc:224] Handling call
0709 13:00:13.283201 (+  1124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:13.284413  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.284349  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:13.285058  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2300) took 1223 ms (client timeout 1549 ms). Trace:
W20260709 13:00:13.285355  1615 rpcz_store.cc:269] 0709 13:00:12.062149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.284155 (+1222006us) service_pool.cc:224] Handling call
0709 13:00:13.284990 (+   835us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:13.286119  1583 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43404 dropped due to backpressure: service queue is full with 50 items
I20260709 13:00:13.286092  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.287405  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 835) took 2409 ms. Trace:
I20260709 13:00:13.287699  2277 rpcz_store.cc:276] 0709 13:00:10.878156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.878320 (+   164us) service_pool.cc:224] Handling call
0709 13:00:12.030726 (+1152406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.035387 (+  4661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.287258 (+1251871us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540071e8d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:13.287358 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2649279744}
I20260709 13:00:13.289336  1536 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:13.290485  1536 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:13.292584  4047 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.293052  4047 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:13.266407  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:13.205829  4500 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:00:13.223161  4483 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:13.257253  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.245393  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:13.298907  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.299276  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.227035  4423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.010s	sys 0.027s
W20260709 13:00:13.259938  4495 log.cc:927] Time spent T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.577s	user 0.001s	sys 0.000s
I20260709 13:00:13.247848  4493 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:13.262879  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.319828  1616 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:13.315055  4423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.010s	sys 0.027s
I20260709 13:00:13.320189  4047 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:13.263962  1688 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 13:00:13.263389  4497 log.cc:927] Time spent T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:00:13.293275  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:13.264438  4504 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:13.248770  1658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.002s	sys 0.009s
I20260709 13:00:13.303406  1612 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
W20260709 13:00:13.326963  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1879) took 1902 ms (client timeout 2020 ms). Trace:
W20260709 13:00:13.327272  1612 rpcz_store.cc:269] 0709 13:00:11.424074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.610621 (+186547us) service_pool.cc:224] Handling call
0709 13:00:13.266937 (+1656316us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:13.326916 (+ 59979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99499392}
I20260709 13:00:13.304054  1615 raft_consensus.cc:2393] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:13.316057  1537 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:13.328329  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2301) took 1146 ms. Trace:
I20260709 13:00:13.329018  1537 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: [3.5-4.6]
I20260709 13:00:13.318099  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:13.320231  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1876) took 1897 ms (client timeout 1664 ms). Trace:
I20260709 13:00:13.324211  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1873) took 1902 ms. Trace:
I20260709 13:00:13.329770  1687 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:13.329820  1613 rpcz_store.cc:276] 0709 13:00:11.422231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.484707 (+ 62476us) service_pool.cc:224] Handling call
0709 13:00:13.293128 (+1808421us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:13.324155 (+ 31027us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3748736}
I20260709 13:00:13.216359  4376 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:13.321513  1688 pending_rounds.cc:85] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 5
W20260709 13:00:13.328368  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.328809  1615 rpcz_store.cc:276] 0709 13:00:12.181510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.285911 (+1104401us) service_pool.cc:224] Handling call
0709 13:00:13.328277 (+ 42366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.228623  4169 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:13.329605  1616 rpcz_store.cc:269] 0709 13:00:11.423151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.423268 (+   117us) service_pool.cc:224] Handling call
0709 13:00:13.262760 (+1839492us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:13.320168 (+ 57408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2988800}
I20260709 13:00:13.331239  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
W20260709 13:00:13.320429  4419 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:00:13.315214  4456 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.332330  1688 pending_rounds.cc:107] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:13.339448  1688 raft_consensus.cc:2889] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:13.334025  1692 raft_consensus.cc:606] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:13.335716  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 536) took 1288 ms. Trace:
I20260709 13:00:13.385893  4508 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:13.397012  1687 rpcz_store.cc:276] 0709 13:00:12.047215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.252037 (+1204822us) service_pool.cc:224] Handling call
0709 13:00:13.335659 (+ 83622us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:13.400249  1509 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.712s (SENT)
I20260709 13:00:13.404844  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48306 (request call id 21) took 1224 ms. Trace:
I20260709 13:00:13.405390  1692 rpcz_store.cc:276] 0709 13:00:12.175293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.257299 (+1082006us) service_pool.cc:224] Handling call
0709 13:00:13.400098 (+142799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.401332  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:13.332264  4376 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:13.417888  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 539) took 1369 ms. Trace:
I20260709 13:00:13.418836  1688 rpcz_store.cc:276] 0709 13:00:12.048815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.263434 (+1214619us) service_pool.cc:224] Handling call
0709 13:00:13.263679 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.417600 (+153921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.417824 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.420265  1688 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:13.219907  4491 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:13.350318  4437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.007s	sys 0.008s
I20260709 13:00:13.403201  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:13.431675  2274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 810) took 2651 ms (client timeout 1739 ms). Trace:
W20260709 13:00:13.432197  2274 rpcz_store.cc:269] 0709 13:00:10.780610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.780751 (+   141us) service_pool.cc:224] Handling call
0709 13:00:13.431501 (+2650750us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54004da654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:13.431610 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430658304}
I20260709 13:00:13.429638   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:13.436198   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:13.430001  4490 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:00:13.439031  4482 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:13.439093  4435 consensus_queue.cc:260] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.440644  4435 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:13.443428  4392 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:13.447566  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2269) took 2043 ms (client timeout 1549 ms). Trace:
W20260709 13:00:13.448050  1618 rpcz_store.cc:269] 0709 13:00:11.404622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.416894 (+ 12272us) service_pool.cc:224] Handling call
0709 13:00:13.447347 (+2030453us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540026edd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:13.447490 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3173495680}
I20260709 13:00:13.395762  4423 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.429515  4066 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:13.453047  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.461340  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:13.461679  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.462208  2276 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:13.454902  2277 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
W20260709 13:00:13.462456  1585 connection.cc:256] RPC call timeout handler was delayed by -1.110739623000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 13:00:13.456250  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:13.462759  2277 pending_rounds.cc:85] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 8
I20260709 13:00:13.464103  2277 pending_rounds.cc:107] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:13.464406  2277 raft_consensus.cc:2889] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:13.459601  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 84942us
I20260709 13:00:13.465888  4502 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.405421  4508 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:13.429776  4499 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:00:13.467617  1537 raft_consensus.cc:2410] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:13.424724  4376 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:13.431694  4437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.007s	sys 0.008s
I20260709 13:00:13.472638  1687 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:13.473877  2274 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:13.393690  4456 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:13.474952  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1835) took 1308 ms. Trace:
I20260709 13:00:13.493826  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:13.494597  2272 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 13:00:13.494959  4508 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:13.483736  1542 rpcz_store.cc:276] 0709 13:00:12.166989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.167733 (+   744us) service_pool.cc:224] Handling call
0709 13:00:12.168010 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.201542 (+ 33532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.201579 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.202072 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.631607 (+429535us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:12.631655 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.631737 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.474701 (+842964us) raft_consensus.cc:1685] finished
0709 13:00:13.474727 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.474885 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39293,"raft.queue_time_us":951930,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":42189,"thread_start_us":344539,"threads_started":1,"wal-append.queue_time_us":636922}
W20260709 13:00:13.496598  4492 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:00:13.497736  1542 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 13:00:13.467226  4421 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:13.466730  4047 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:13.507229  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2274) took 2433 ms (client timeout 1712 ms). Trace:
W20260709 13:00:13.507720  1694 rpcz_store.cc:269] 0709 13:00:11.073336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.074843 (+  1507us) service_pool.cc:224] Handling call
0709 13:00:13.504510 (+2429667us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54002e4fd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:13.507150 (+  2640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4705912704}
W20260709 13:00:13.504559  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 282778us
I20260709 13:00:13.286450  1583 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43404 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2303)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2279)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2310)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2317)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 546)
I20260709 13:00:13.509554  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:13.509649  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:13.510248  2276 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:13.511078  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:13.511658  2275 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:13.510491  2277 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:00:13.512364  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.517159  1510 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:13.517112  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:13.518256  1510 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:13.523005  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.527567  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:13.528157  2272 raft_consensus.cc:2410] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:13.528556  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:13.529004  2274 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:13.504153  4391 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.475042  4476 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:00:13.470324  4423 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:13.536339  2241 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:13.474298  4515 consensus_queue.cc:1059] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:00:13.507956  4504 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:00:13.567057  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.560060  2241 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:13.532485  4502 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:13.526466  4482 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:13.607240  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 432932us
I20260709 13:00:13.558624  1510 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:13.527292  4099 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:13.540124  4377 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:13.533192  4463 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:00:13.533790  4488 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:13.515793  4047 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.619300  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:13.619553  4047 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:13.621559  4423 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:13.623526  4456 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:13.609664  4517 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:13.627013  4517 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:13.627422  4517 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:13.614362  4476 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:13.627935  4476 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.628273  4476 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:13.629913  1614 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:13.607957  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:13.608669  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 65728.8us
I20260709 13:00:13.562461  4469 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:13.531816  4462 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:13.612710  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.632447  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:13.632442  4462 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:13.633031  2274 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:13.633302  4462 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:13.633775  4041 tablet_bootstrap.cc:492] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:13.634255  1510 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:13.558737  4391 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:13.635850  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.635905  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.636356  4391 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:13.636520  1616 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
W20260709 13:00:13.636773  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2281) took 1752 ms (client timeout 1889 ms). Trace:
I20260709 13:00:13.616422  4099 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:13.637055  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2298) took 1595 ms (client timeout 1895 ms). Trace:
W20260709 13:00:13.637166  1613 rpcz_store.cc:269] 0709 13:00:11.884021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.635621 (+1751600us) service_pool.cc:224] Handling call
0709 13:00:13.636721 (+  1100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9344}
W20260709 13:00:13.637481  1616 rpcz_store.cc:269] 0709 13:00:12.041782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.635586 (+1593804us) service_pool.cc:224] Handling call
0709 13:00:13.637006 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.638280  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:11.602995  4455 consensus_queue.cc:1175] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" responder_term: 4 status { last_received { term: 2 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 3. Current term is 4. Ops: [3.4-3.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:13.638474  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:13.644999  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1877) took 2221 ms (client timeout 1614 ms). Trace:
W20260709 13:00:13.649204  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.614374  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.617792  4512 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:13.652052  1611 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
W20260709 13:00:13.631323  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 71377.4us
W20260709 13:00:13.656659  1614 rpcz_store.cc:269] 0709 13:00:11.423454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.423806 (+   352us) service_pool.cc:224] Handling call
0709 13:00:13.619176 (+2195370us) spinlock_profiling.cc:243] Waited 949 us on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:13.644918 (+ 25742us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183552}
I20260709 13:00:13.656653  1616 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:13.654446  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:13.660249  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2279) took 1776 ms (client timeout 2159 ms). Trace:
I20260709 13:00:13.607043  4502 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:13.660495  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:13.662973  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 55080.5us
I20260709 13:00:13.660611  1612 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:13.663904  2241 leader_election.cc:400] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7.
W20260709 13:00:13.664430  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2284) took 1779 ms (client timeout 2099 ms). Trace:
I20260709 13:00:13.665297  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:13.664980  1612 rpcz_store.cc:269] 0709 13:00:11.884875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.654181 (+1769306us) service_pool.cc:224] Handling call
0709 13:00:13.664360 (+ 10179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:13.660612  1616 rpcz_store.cc:269] 0709 13:00:11.883478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.638251 (+1754773us) service_pool.cc:224] Handling call
0709 13:00:13.660199 (+ 21948us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.661427  1613 raft_consensus.cc:2410] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:13.662179  4391 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:13.662277  4407 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:13.662276  4452 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.668325  4377 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:13.674820  4452 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.675359  4169 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:13.672070  4391 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.676587  4391 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.677229  4422 raft_consensus.cc:3055] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:13.677600  4422 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:13.616760  4488 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:13.605228  4504 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.667068  4502 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:13.678416  4422 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.678892  4488 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:13.679361  4422 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:13.669466  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2289) took 1783 ms (client timeout 2155 ms). Trace:
I20260709 13:00:13.680728  4504 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:13.680845  1613 rpcz_store.cc:269] 0709 13:00:11.886239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.638041 (+1751802us) service_pool.cc:224] Handling call
0709 13:00:13.669421 (+ 31380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.669854  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:13.615070  4329 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:13.634593  4041 tablet_bootstrap.cc:492] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 13:00:13.638572  4099 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:13.672739  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.683347  1659 connection.cc:256] RPC call timeout handler was delayed by -1.3813164739999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.248s for a response
I20260709 13:00:13.641731  4491 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:13.695277  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:13.700755  4517 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.642967  4379 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:13.704665  4379 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:13.708214  1545 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
W20260709 13:00:13.712901  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.713071  4517 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:13.713629  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.708765  4524 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:13.714534  4524 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:13.715346  4524 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.715728  4487 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.716976  1540 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:13.717732  4487 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:13.713734  4517 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:13.725512  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:13.645114  1585 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53894 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2310)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2317)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 550)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1883)
I20260709 13:00:13.709663  4473 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.732995  4041 ts_tablet_manager.cc:1403] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 4.809s	user 0.045s	sys 0.060s
I20260709 13:00:13.727264  4329 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:13.750735  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.751058  4379 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.751571  1692 raft_consensus.cc:2410] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:13.751510  4379 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.753371  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.753587  4379 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:13.755386  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 537) took 3473 ms. Trace:
I20260709 13:00:13.735061  4504 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:00:13.755987  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:13.756294  1659 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:13.756608  1536 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:13.757004  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.757817  1694 raft_consensus.cc:2410] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:00:13.759435  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.757643  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:13.760597  2275 raft_consensus.cc:2410] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:13.755740  1619 rpcz_store.cc:276] 0709 13:00:10.281712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.282596 (+   884us) service_pool.cc:224] Handling call
0709 13:00:10.282986 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.989760 (+1706774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.755198 (+1765438us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b540026f2d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:13.755339 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3762000768}
I20260709 13:00:13.763676  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.763881  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.764225  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:13.764586  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2305) took 1222 ms. Trace:
I20260709 13:00:13.764889  1619 rpcz_store.cc:276] 0709 13:00:12.541997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.763683 (+1221686us) service_pool.cc:224] Handling call
0709 13:00:13.764506 (+   823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.762800  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.762910  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:13.755395  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.767035  1692 raft_consensus.cc:2368] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4.
I20260709 13:00:13.746052  4099 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.769385  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.746382  4377 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:13.771840  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2291) took 1885 ms. Trace:
I20260709 13:00:13.773998  1619 rpcz_store.cc:276] 0709 13:00:11.893822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.769116 (+1875294us) service_pool.cc:224] Handling call
0709 13:00:13.771791 (+  2675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.774834  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.741528  4473 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.774423  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:13.762305  4476 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.776678  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2307) took 1170 ms. Trace:
I20260709 13:00:13.776868  4329 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.777014  1619 rpcz_store.cc:276] 0709 13:00:12.606450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.774571 (+1168121us) service_pool.cc:224] Handling call
0709 13:00:13.776615 (+  2044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.777482  4329 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.777889  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.778475  1619 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:13.778796  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2273) took 1998 ms. Trace:
I20260709 13:00:13.758929  4423 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.779356  1619 rpcz_store.cc:276] 0709 13:00:11.780685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.777715 (+1997030us) service_pool.cc:224] Handling call
0709 13:00:13.778754 (+  1039us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.780804  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.781450  4462 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.779371  4391 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.772142  4483 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:00:13.781510  1619 raft_consensus.cc:2410] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:13.774392  4099 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:13.783993  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2287) took 1898 ms. Trace:
I20260709 13:00:13.767103  4487 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.651824  1583 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43404 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2310)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2317)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 550)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1883)
I20260709 13:00:13.784967  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.847746  4423 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.308444  1686 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:14.308658  4423 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.309648  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:14.310456  1686 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:13.828233  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.311488  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.821897  4376 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:14.313829  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 539375us
W20260709 13:00:14.145566  4472 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 2.135s	user 0.006s	sys 0.007s
I20260709 13:00:14.241815  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2290) took 1042 ms. Trace:
I20260709 13:00:14.314936  2241 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:14.315578  1687 rpcz_store.cc:276] 0709 13:00:13.199319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.400608 (+201289us) service_pool.cc:224] Handling call
0709 13:00:13.408827 (+  8219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.478332 (+ 69505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.241445 (+763113us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b5400304654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:14.241732 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146243328}
I20260709 13:00:14.316124  4426 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:14.316979  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:14.317896  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:13.784634  4502 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:13.820133  1539 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:13.799229  4169 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:14.318681  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:14.320935  2243 consensus_peers.cc:597] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43404 dropped due to backpressure: service queue is full with 50 items. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:14.063373  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1823) took 3209 ms. Trace:
I20260709 13:00:13.784308  1619 rpcz_store.cc:276] 0709 13:00:11.885713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.780595 (+1894882us) service_pool.cc:224] Handling call
0709 13:00:13.783944 (+  3349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.336951  1687 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:14.067313  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 529) took 2021 ms (client timeout 2361 ms). Trace:
I20260709 13:00:13.799687  1694 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
W20260709 13:00:14.337589  1691 rpcz_store.cc:269] 0709 13:00:12.045898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.868706 (+822808us) service_pool.cc:224] Handling call
0709 13:00:14.067048 (+1198342us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b5400373554. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:14.067230 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70946560}
W20260709 13:00:13.878966  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.095676  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.322512  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:14.321293  2241 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:14.339582  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.958333  1690 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:14.323364  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.341707  1617 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:14.052105  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.946372  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:14.343019  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.338891  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.330919  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2296) took 2309 ms (client timeout 2032 ms). Trace:
I20260709 13:00:13.947211  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.345455  1613 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
W20260709 13:00:14.346037  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2304) took 2000 ms (client timeout 1779 ms). Trace:
W20260709 13:00:14.346474  1613 rpcz_store.cc:269] 0709 13:00:12.345303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.946995 (+1601692us) service_pool.cc:224] Handling call
0709 13:00:14.345961 (+398966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.944732  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1837) took 1743 ms. Trace:
I20260709 13:00:14.350893  1541 rpcz_store.cc:276] 0709 13:00:12.201541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.201715 (+   174us) service_pool.cc:224] Handling call
0709 13:00:12.603581 (+401866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.254099 (+650518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.944410 (+690311us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400311d54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:13.944656 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447392128}
I20260709 13:00:14.333778  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:14.353163  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2297) took 2318 ms (client timeout 2035 ms). Trace:
I20260709 13:00:14.322902  1536 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:14.353762  1612 rpcz_store.cc:269] 0709 13:00:12.035171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.945485 (+1910314us) service_pool.cc:224] Handling call
0709 13:00:14.353069 (+407584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.336849  1543 rpcz_store.cc:276] 0709 13:00:10.853719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.072843 (+219124us) service_pool.cc:224] Handling call
0709 13:00:11.178027 (+105184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.178473 (+   446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.063144 (+2884671us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b54001b7e50. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:14.063303 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217313536}
I20260709 13:00:14.356335  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1824) took 3486 ms. Trace:
I20260709 13:00:14.356812  1544 rpcz_store.cc:276] 0709 13:00:10.869662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.926040 (+ 56378us) service_pool.cc:224] Handling call
0709 13:00:10.985758 (+ 59718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.015165 (+ 29407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.356150 (+3340985us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b5400282150. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:14.356275 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94365056}
I20260709 13:00:14.357569  2241 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:14.344343  1614 rpcz_store.cc:269] 0709 13:00:12.022014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.071276 (+2049262us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:14.330826 (+259550us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:14.335054  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.343240  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2288) took 2457 ms (client timeout 2222 ms). Trace:
W20260709 13:00:14.366325  1616 rpcz_store.cc:269] 0709 13:00:11.885963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.946022 (+2060059us) service_pool.cc:224] Handling call
0709 13:00:14.343153 (+397131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:14.370219  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.950160  1585 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53894 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2310)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2317)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1893)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1887)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 550)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1886)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1889)
W20260709 13:00:14.379001  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2294) took 2375 ms (client timeout 1813 ms). Trace:
W20260709 13:00:14.380347  1615 rpcz_store.cc:269] 0709 13:00:12.003980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.356129 (+2352149us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:14.378937 (+ 22808us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:14.382084  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.383255  1619 raft_consensus.cc:2410] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 6 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:14.394263  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:14.394953  2275 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:13.775451  4504 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.397609  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:14.396379  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.399451  1615 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:14.399912  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2320) took 1135 ms. Trace:
I20260709 13:00:14.400219  1615 rpcz_store.cc:276] 0709 13:00:13.264794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.396121 (+1131327us) service_pool.cc:224] Handling call
0709 13:00:14.399865 (+  3744us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:14.377990  1585 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53894 dropped due to backpressure: service queue is full with 50 items [suppressed 4 similar messages]
I20260709 13:00:13.952409  4265 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:14.402638  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2272) took 2709 ms (client timeout 2960 ms). Trace:
W20260709 13:00:14.405694  1619 rpcz_store.cc:269] 0709 13:00:11.693736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.381680 (+2687944us) service_pool.cc:224] Handling call
0709 13:00:14.402583 (+ 20903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.405840  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.403081  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:14.406864  1615 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:14.404405  1541 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:14.406930  1691 raft_consensus.cc:2393] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 4: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:14.325220  4527 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.007s	sys 0.032s
I20260709 13:00:13.962921  4476 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:14.409211  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2280) took 2525 ms (client timeout 3260 ms). Trace:
W20260709 13:00:14.409555  1615 rpcz_store.cc:269] 0709 13:00:11.883745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.405605 (+2521860us) service_pool.cc:224] Handling call
0709 13:00:14.409154 (+  3549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.410403  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.410934  1615 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:14.411316  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2310) took 1299 ms. Trace:
I20260709 13:00:14.411566  1615 rpcz_store.cc:276] 0709 13:00:13.112155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.410214 (+1298059us) service_pool.cc:224] Handling call
0709 13:00:14.411276 (+  1062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.412271  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.412830  1615 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:14.413147  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2311) took 1251 ms. Trace:
I20260709 13:00:14.413340  1687 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:14.413422  1615 rpcz_store.cc:276] 0709 13:00:13.161517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.412090 (+1250573us) service_pool.cc:224] Handling call
0709 13:00:14.413103 (+  1013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.061714  4421 raft_consensus.cc:3055] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:13.836758  4524 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.401784  1585 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53894 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2310)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2317)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1893)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1897)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1887)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1895)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 550)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1886)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1889)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1896)
I20260709 13:00:13.903687  4329 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:14.324731  4099 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:13.823145  4528 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.837549  4529 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.414211  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:13.822769  4462 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:14.414202  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:14.415525  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:14.358224  4468 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:00:14.378971  4517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.031s	sys 0.043s
W20260709 13:00:14.415625  4527 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.010s	sys 0.033s
I20260709 13:00:13.029814  1693 rpcz_store.cc:276] 0709 13:00:11.073013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.073814 (+   801us) service_pool.cc:224] Handling call
0709 13:00:11.074117 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.074338 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:11.590230 (+515892us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.854852 (+1264622us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.854903 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:12.854955 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.855042 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.855191 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":730595,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":268645,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":83746,"thread_start_us":1761200,"threads_started":3,"wal-append.queue_time_us":1016937}
I20260709 13:00:14.422602  1687 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:14.422647  1686 raft_consensus.cc:2376] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8. Re-sending same reply.
I20260709 13:00:14.421425  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2327) took 1154 ms. Trace:
I20260709 13:00:14.415441  4421 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:14.378901  4169 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.405511  4265 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:14.356411  4487 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.110460  4488 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.427210  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:14.435429  1691 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:14.429755  1615 rpcz_store.cc:276] 0709 13:00:13.266563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.414052 (+1147489us) service_pool.cc:224] Handling call
0709 13:00:14.421377 (+  7325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.428864  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:14.422613  4329 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:14.440253  4169 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:14.431552  4377 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:14.428225  4517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.032s	sys 0.044s
I20260709 13:00:14.433284  1541 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:14.434895  2275 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:14.435812  1686 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:14.428898  4454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.534s	user 0.044s	sys 0.065s
I20260709 13:00:14.405471  4504 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.439357   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:14.439523  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2303) took 2147 ms (client timeout 1713 ms). Trace:
I20260709 13:00:14.428030  4063 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:14.429278  4524 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:14.446816  1618 rpcz_store.cc:269] 0709 13:00:12.287293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.434745 (+2147452us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:14.434868 (+   123us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:14.414966  4041 raft_consensus.cc:359] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:00:14.446452  4454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.553s	user 0.044s	sys 0.065s
I20260709 13:00:14.447849  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.428756  4468 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:14.466609  1511 leader_election.cc:336] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.524s (SENT)
I20260709 13:00:14.458595  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.465626  1615 raft_consensus.cc:2368] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:14.444330  4517 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:14.425513  4528 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.469192  1618 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:14.469712  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2312) took 1282 ms. Trace:
I20260709 13:00:14.470176  1618 rpcz_store.cc:276] 0709 13:00:13.208701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.458380 (+1249679us) service_pool.cc:224] Handling call
0709 13:00:14.469649 (+ 11269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.471040  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.471814  1618 raft_consensus.cc:2410] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:14.466447  4454 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:14.457144  4391 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:14.425604  4529 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.474050  4517 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:14.493829  1511 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.813s (SENT)
I20260709 13:00:14.473174  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2317) took 1209 ms. Trace:
I20260709 13:00:14.475950  4502 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:14.480954  4528 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:14.474493  4504 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:14.490823  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.517504  1615 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:14.517976  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2319) took 1253 ms. Trace:
I20260709 13:00:14.518296  1615 rpcz_store.cc:276] 0709 13:00:13.264550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.468150 (+1203600us) service_pool.cc:224] Handling call
0709 13:00:14.517912 (+ 49762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.508335  1618 rpcz_store.cc:276] 0709 13:00:13.263957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.470846 (+1206889us) service_pool.cc:224] Handling call
0709 13:00:14.473123 (+  2277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.519411  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.520421  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.521603  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.461839  4041 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 13:00:14.487946  4488 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:14.523439  1687 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:14.524748  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2314) took 1261 ms. Trace:
I20260709 13:00:14.525302  1618 rpcz_store.cc:276] 0709 13:00:13.263189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.521366 (+1258177us) service_pool.cc:224] Handling call
0709 13:00:14.524610 (+  3244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.526299  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:14.529628  4536 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:14.532711  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1611) took 3192 ms. Trace:
I20260709 13:00:14.533023  4426 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:14.535180  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 585) took 1919 ms (client timeout 1747 ms). Trace:
W20260709 13:00:14.535531  1545 rpcz_store.cc:269] 0709 13:00:12.616007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.163628 (+547621us) service_pool.cc:224] Handling call
0709 13:00:14.535015 (+1371387us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400355054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:14.535120 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107541376}
I20260709 13:00:14.529145  4265 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.533053  1690 rpcz_store.cc:276] 0709 13:00:11.340615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.037630 (+697015us) service_pool.cc:224] Handling call
0709 13:00:13.507402 (+1469772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.958136 (+450734us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b54000dc3a0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd1cdc0 00007f29ebda71c0 00007f29ebda8231 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c
0709 13:00:14.340806 (+382670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.532523 (+191717us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54002e4fd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:14.532646 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3398737024}
I20260709 13:00:14.539559  4468 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:14.539736  4487 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:14.540097  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.540861  1613 raft_consensus.cc:2410] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:14.538403  1617 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:14.541292  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:14.542086  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2308) took 1750 ms (client timeout 1936 ms). Trace:
W20260709 13:00:14.542452  1613 rpcz_store.cc:269] 0709 13:00:12.791815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.539866 (+1748051us) service_pool.cc:224] Handling call
0709 13:00:14.542033 (+  2167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:14.542925  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1878) took 3119 ms (client timeout 1673 ms). Trace:
W20260709 13:00:14.543339  1617 rpcz_store.cc:269] 0709 13:00:11.423703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.423831 (+   128us) service_pool.cc:224] Handling call
0709 13:00:14.323183 (+2899352us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:14.541808 (+218625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94989184}
W20260709 13:00:14.547245  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 121694us
I20260709 13:00:14.550244  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.550601  1618 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:14.550998  1617 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:14.549124  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:14.549072  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:14.542515  1615 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:14.552881  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2313) took 1290 ms. Trace:
I20260709 13:00:14.553299  1615 rpcz_store.cc:276] 0709 13:00:13.262855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.518902 (+1256047us) service_pool.cc:224] Handling call
0709 13:00:14.552811 (+ 33909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.554260  1693 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:14.554613  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 176004us
I20260709 13:00:14.555416  1510 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.556775  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:14.557458  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:14.558000  2277 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:14.558555  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:14.558995  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:14.559526  2276 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.559581  1689 raft_consensus.cc:2410] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:00:14.561637  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2316) took 1297 ms. Trace:
I20260709 13:00:14.561578  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:14.562188  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.562107  1618 rpcz_store.cc:276] 0709 13:00:13.263705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.526060 (+1262355us) service_pool.cc:224] Handling call
0709 13:00:14.561587 (+ 35527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.562472  2275 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:14.563107  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.563884  1618 raft_consensus.cc:2410] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:14.564487  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:14.564512  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 206987us
I20260709 13:00:14.565294  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.565487  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.565758  1617 raft_consensus.cc:2376] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7. Re-sending same reply.
I20260709 13:00:14.567119  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2322) took 1301 ms. Trace:
I20260709 13:00:14.552907  1585 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:14.567467  1618 rpcz_store.cc:276] 0709 13:00:13.265330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.562882 (+1297552us) service_pool.cc:224] Handling call
0709 13:00:14.567069 (+  4187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.566521  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.568316  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.569285  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.569703  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.569917  1613 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:14.570549  1618 raft_consensus.cc:2393] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:14.570942  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2283) took 2686 ms. Trace:
I20260709 13:00:14.571283  1618 rpcz_store.cc:276] 0709 13:00:11.884556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.568126 (+2683570us) service_pool.cc:224] Handling call
0709 13:00:14.570895 (+  2769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.572402  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.488137  4421 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:14.573624  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.576206  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.576969  2273 raft_consensus.cc:2410] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:00:14.577059  1509 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:14.578577  1509 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:14.578640  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.578933  2275 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:14.579313  1617 raft_consensus.cc:2376] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8. Re-sending same reply.
I20260709 13:00:14.576732  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2321) took 1311 ms. Trace:
I20260709 13:00:14.561390  4265 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:14.580530  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.580446  1615 rpcz_store.cc:276] 0709 13:00:13.265079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.554001 (+1288922us) service_pool.cc:224] Handling call
0709 13:00:14.576683 (+ 22682us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.583696  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.564903  4487 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:14.587790  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.588443  1613 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:14.589273  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.593465  2241 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:14.573580  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.572454  4377 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.590591  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2324) took 1324 ms. Trace:
I20260709 13:00:14.595911  1613 rpcz_store.cc:276] 0709 13:00:13.265836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.573126 (+1307290us) service_pool.cc:224] Handling call
0709 13:00:14.590549 (+ 17423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.579622  4534 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:14.593458  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.589537  2276 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:14.595479  4421 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.598368  1617 raft_consensus.cc:2410] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 6 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:14.598922  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2325) took 1332 ms. Trace:
I20260709 13:00:14.581125  4426 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:00:14.600883  2272 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:14.592880  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.603396  1615 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:14.603816  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 545) took 1318 ms. Trace:
I20260709 13:00:14.604112  1615 rpcz_store.cc:276] 0709 13:00:13.285193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.583540 (+1298347us) service_pool.cc:224] Handling call
0709 13:00:14.603763 (+ 20223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.604976  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.605254  1539 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:14.606016  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.582062  4169 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:14.606977  4169 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:14.607407  1541 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:00:14.607738  1541 pending_rounds.cc:85] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 5
I20260709 13:00:14.608099  1541 pending_rounds.cc:107] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:00:14.607829  4169 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:14.609710  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.610419  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1881) took 1147 ms. Trace:
I20260709 13:00:14.610747  1612 rpcz_store.cc:276] 0709 13:00:13.463425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.609463 (+1146038us) service_pool.cc:224] Handling call
0709 13:00:14.610368 (+   905us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:14.611660  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2302) took 2410 ms (client timeout 1712 ms). Trace:
W20260709 13:00:14.612035  1620 rpcz_store.cc:269] 0709 13:00:12.200925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.611491 (+2410566us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:14.611594 (+   103us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:14.612843  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:13.315696  1584 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53910 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2279)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2310)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2317)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2278)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 546)
I20260709 13:00:14.613816  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.614419  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2315) took 1351 ms. Trace:
I20260709 13:00:14.625869  1620 rpcz_store.cc:276] 0709 13:00:13.263470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.613588 (+1350118us) service_pool.cc:224] Handling call
0709 13:00:14.614374 (+   786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.608393  1541 raft_consensus.cc:2889] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:14.606335  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:14.614663  4501 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:14.616514  1543 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:14.617045  4529 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:14.617209  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2294) took 1322 ms. Trace:
I20260709 13:00:14.617442  1539 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:14.599236  1617 rpcz_store.cc:276] 0709 13:00:13.266121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.582631 (+1316510us) service_pool.cc:224] Handling call
0709 13:00:14.598850 (+ 16219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.634857  1539 pending_rounds.cc:85] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 2
I20260709 13:00:14.635143  1539 pending_rounds.cc:107] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:14.635406  1539 raft_consensus.cc:2889] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:14.619354  4290 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:14.580977  4528 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:14.620621  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:14.621917  4403 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.620241  1544 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:14.556059  4041 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:14.623099  1615 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:00:14.582167  4502 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:14.594946  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.607764  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 592) took 1484 ms. Trace:
W20260709 13:00:14.625046  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 72196.6us
I20260709 13:00:14.599431  1538 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:00:14.586444  4476 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:14.577814  4504 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:00:14.629087  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.635603  1617 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:14.633168  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.622635  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.643610  1537 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:14.632970  1688 rpcz_store.cc:276] 0709 13:00:13.294884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.421975 (+127091us) service_pool.cc:224] Handling call
0709 13:00:13.422345 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.614652 (+192307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.614683 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.644445 (+ 29762us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.734281 (+ 89836us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:13.734334 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.616869 (+882535us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54003246d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:14.616913 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.616963 (+    50us) raft_consensus.cc:1685] finished
0709 13:00:14.616977 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.617157 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3362,"raft.queue_time_us":383,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":41173,"spinlock_wait_cycles":441389440,"thread_start_us":89429,"threads_started":1,"wal-append.queue_time_us":128832}
I20260709 13:00:14.586292  4391 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:00:14.624591  4329 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:14.648655  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1880) took 3157 ms. Trace:
I20260709 13:00:14.668584  1615 rpcz_store.cc:276] 0709 13:00:11.491482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.622508 (+3131026us) service_pool.cc:224] Handling call
0709 13:00:14.622851 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:14.648413 (+ 25562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.648596 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:14.649703  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 818123us
I20260709 13:00:14.653535  1540 rpcz_store.cc:276] 0709 13:00:13.123298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.266238 (+142940us) service_pool.cc:224] Handling call
0709 13:00:14.607591 (+1341353us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400281754. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:14.607710 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972249984}
I20260709 13:00:14.653738  1538 pending_rounds.cc:85] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 3
I20260709 13:00:14.670104  1538 pending_rounds.cc:107] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 13:00:14.670429  1538 raft_consensus.cc:2889] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:14.574891  4454 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.659066  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2276) took 2785 ms. Trace:
I20260709 13:00:14.671814  1617 rpcz_store.cc:276] 0709 13:00:11.873207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.635170 (+2761963us) service_pool.cc:224] Handling call
0709 13:00:14.635429 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.658819 (+ 23390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.659016 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.672974  1617 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:00:14.659602  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2318) took 1395 ms (client timeout 1524 ms). Trace:
W20260709 13:00:14.673949  1616 rpcz_store.cc:269] 0709 13:00:13.264250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.622394 (+1358144us) service_pool.cc:224] Handling call
0709 13:00:14.659551 (+ 37157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.632572  4487 raft_consensus.cc:697] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:14.676311  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 81413.7us
I20260709 13:00:14.677781  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1623) took 3761 ms. Trace:
W20260709 13:00:14.670907  1659 leader_election.cc:336] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.848s (SENT)
W20260709 13:00:14.680308  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.680644  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.681387  2273 raft_consensus.cc:2393] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:14.681416  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:14.682276  2276 raft_consensus.cc:2368] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6.
W20260709 13:00:14.680788  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.643216  4290 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:14.678896  1538 rpcz_store.cc:276] 0709 13:00:10.916507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.149634 (+233127us) service_pool.cc:224] Handling call
0709 13:00:11.149903 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.599193 (+3449290us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54003de120. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd1cdc0 00007f29ebda7d87 00007f29ebda8470 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c
0709 13:00:14.677489 (+ 78296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.677711 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4278995840}
I20260709 13:00:14.687382  1615 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:00:14.690075  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:14.690793  1538 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:14.691920  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:14.692046  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.692466  1538 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:14.693068  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.693218  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:14.693928  1540 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:14.694061  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.683826  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.695446  1620 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:14.696534  1620 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:14.697039  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2292) took 2783 ms. Trace:
I20260709 13:00:14.697309  1620 rpcz_store.cc:276] 0709 13:00:11.913886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.696025 (+2782139us) service_pool.cc:224] Handling call
0709 13:00:14.696303 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.696849 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.696996 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.685959  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:14.697482  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:14.699936  1538 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:14.700780  2270 raft_consensus.cc:2410] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:14.701033  2241 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.685496  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2278) took 2792 ms. Trace:
I20260709 13:00:14.702215  1617 rpcz_store.cc:276] 0709 13:00:11.883211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.672476 (+2789265us) service_pool.cc:224] Handling call
0709 13:00:14.672763 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.673287 (+   524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.675858 (+  2571us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.702435  4529 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.704115  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.685186  4169 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:14.704909  4169 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.707953  4169 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:14.705997  1620 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:00:14.708940  1620 pending_rounds.cc:85] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 4
I20260709 13:00:14.709208  1620 pending_rounds.cc:107] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:14.707819  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.710150  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:14.710876  2274 raft_consensus.cc:2368] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9.
I20260709 13:00:14.711649  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.712179  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2277) took 2829 ms. Trace:
I20260709 13:00:14.712509  1615 rpcz_store.cc:276] 0709 13:00:11.882891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.669503 (+2786612us) service_pool.cc:224] Handling call
0709 13:00:14.687176 (+ 17673us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:14.711958 (+ 24782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.712133 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.714272  1616 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:14.705613  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.715795  2270 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:14.709476  1620 raft_consensus.cc:2889] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:14.705554  4529 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:14.718134  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:14.720148  2269 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:14.632347  4392 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:00:14.718981  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2290) took 2832 ms. Trace:
I20260709 13:00:14.722506  1616 rpcz_store.cc:276] 0709 13:00:11.886493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.674550 (+2788057us) service_pool.cc:224] Handling call
0709 13:00:14.714004 (+ 39454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.718692 (+  4688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.718918 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.668296  4329 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.725155  2272 raft_consensus.cc:1217] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:00:14.677680  4379 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.727532  1511 leader_election.cc:336] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.099s (SENT)
I20260709 13:00:14.728065  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.731113  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.732555  2271 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:14.731585  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2306) took 2142 ms. Trace:
I20260709 13:00:14.733270  1620 rpcz_store.cc:276] 0709 13:00:12.588821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.698182 (+2109361us) service_pool.cc:224] Handling call
0709 13:00:14.698426 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.731309 (+ 32883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.731524 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.664736  4099 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:00:14.650454  4403 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.671250  4419 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:00:14.737139  2272 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:14.711824  4476 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:14.677134  4404 consensus_queue.cc:1059] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:00:14.739059  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 125226us
I20260709 13:00:14.739928  2274 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:14.726701  4329 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:14.643896  4501 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.736299  1616 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:14.750316  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 549) took 1187 ms. Trace:
I20260709 13:00:14.750856  1616 rpcz_store.cc:276] 0709 13:00:13.563295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.723429 (+1160134us) service_pool.cc:224] Handling call
0709 13:00:14.736154 (+ 12725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.749965 (+ 13811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.750250 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.684147  4063 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:00:14.747164  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 95021.4us
I20260709 13:00:14.747885  2241 leader_election.cc:400] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4.
I20260709 13:00:14.748126  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 550) took 1149 ms. Trace:
I20260709 13:00:14.755059  2241 leader_election.cc:403] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:14.755245  1620 rpcz_store.cc:276] 0709 13:00:13.598650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.734313 (+1135663us) service_pool.cc:224] Handling call
0709 13:00:14.747543 (+ 13230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.747753 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.747787 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.747838 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:14.747887 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.747952 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.748063 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:14.762588  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 107659us
I20260709 13:00:14.743151  4502 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:14.744601  4529 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:14.743445  4540 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:14.772012  4419 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:14.736567  4379 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:14.773521  1616 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:14.774854  4403 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:14.778319  1616 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:14.738549  4515 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:00:14.785895  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1883) took 1141 ms. Trace:
I20260709 13:00:14.785912  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:14.798290  1620 rpcz_store.cc:276] 0709 13:00:13.644568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.757558 (+1112990us) service_pool.cc:224] Handling call
0709 13:00:14.785276 (+ 27718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.785502 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.785537 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.785591 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:14.785642 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.785706 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.785829 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.782974  4524 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4.
I20260709 13:00:14.760807  4404 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:00:14.798933  1616 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:14.804031  2277 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:14.658236  4543 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:14.683646  4539 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:14.813971  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 153039us
I20260709 13:00:14.823799  2276 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:14.827382  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:14.802647  4540 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:14.829546  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 71665.7us
I20260709 13:00:14.830497  4540 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.830937  4540 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:14.769573  4487 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.782502  4290 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:14.801052  4552 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:00:14.832661  2269 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:14.845377  1616 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.869356  1688 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:14.835850  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.905200  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.823768  4551 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.825784  4544 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.908838  1660 leader_election.cc:336] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.614s (SENT)
I20260709 13:00:14.913738  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:14.917188  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 155403us
I20260709 13:00:14.919497  1545 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:14.920143  1659 leader_election.cc:400] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9.
W20260709 13:00:14.922232  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 147780us
I20260709 13:00:14.922183  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:14.919552  1511 leader_election.cc:336] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.155s (SENT)
I20260709 13:00:14.934098  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:14.936070  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.936295  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:14.937063  2277 raft_consensus.cc:2393] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:14.832393  4543 raft_consensus.cc:697] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:14.855481  4515 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.924476  4041 ts_tablet_manager.cc:1434] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 1.170s	user 0.009s	sys 0.011s
W20260709 13:00:14.945722  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 182050us
W20260709 13:00:14.948269  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 113844us
I20260709 13:00:14.949173  1585 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:14.947569  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:14.844583  4537 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:14.961326  4570 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:14.962325  4560 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:14.963665  4570 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:14.961521  1511 leader_election.cc:336] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.158s (SENT)
I20260709 13:00:14.964383  4570 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:14.964923  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.966290  2241 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:14.967062  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:14.800203  4476 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:14.844324  4063 consensus_queue.cc:1059] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:00:14.930338  4524 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:14.970837  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:14.953307  1659 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:14.972055  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:14.983019  1618 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
W20260709 13:00:14.983369  1511 leader_election.cc:336] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.159s (SENT)
I20260709 13:00:14.983824  1511 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.978308  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:14.969225  4504 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:14.985010  4504 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.985371  4504 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:14.985394  4063 raft_consensus.cc:3055] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:14.985904  4063 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:14.986699  4063 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.987897  4063 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.980934  4524 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:14.990720  4377 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:14.991099  4524 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:14.991360  4329 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.992393  4427 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:14.993407  4329 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:14.995733  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:14.996061  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:14.997786  1537 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:14.947810  4041 ts_tablet_manager.cc:1467] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Tablet startup took 1205ms
W20260709 13:00:14.999524  1511 leader_election.cc:336] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.222s (SENT)
W20260709 13:00:15.001176  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.003427  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:14.981069  4528 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:14.981563  4517 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:14.932495  4544 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:14.995285  4488 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:15.006309  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 57231.6us
I20260709 13:00:14.998577  4550 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:14.994144  4426 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:15.016445  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:15.004861  1511 leader_election.cc:336] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.224s (SENT)
W20260709 13:00:15.019091  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 69531us
I20260709 13:00:15.012106  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1886) took 1064 ms. Trace:
I20260709 13:00:15.023496  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:15.024722  2272 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:15.000797  4546 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:15.040756  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.050290  1614 raft_consensus.cc:2368] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9.
I20260709 13:00:14.998785  4560 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:14.994001  4504 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.930347  4551 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:14.967921  4515 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.050462  1511 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:15.013732  4528 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.013255  4517 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.053879  2275 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:15.011765  4454 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:15.041949  4550 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:15.057049  1542 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:15.057839  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:15.040838  4554 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:00:15.049760  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 546) took 1764 ms. Trace:
I20260709 13:00:15.063601  1694 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:14.975746  4537 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.018867  4501 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.066895  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:15.041630  4421 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:15.056730  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:15.086100  1692 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.049969  4426 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.075557  2277 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:15.067716  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:15.090195  1541 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:15.091068  1659 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:15.078109  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 73276.1us
I20260709 13:00:15.079970  1686 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:15.085032  2275 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:15.086125  1690 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:15.096112  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.097000  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.075749  4517 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:15.067616  4528 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.083056  1617 rpcz_store.cc:276] 0709 13:00:13.285446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.703121 (+1417675us) service_pool.cc:224] Handling call
0709 13:00:14.703385 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.703558 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:14.810841 (+107283us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.049454 (+238613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.049503 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:15.049547 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.049606 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.049703 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200603,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":110472,"spinlock_wait_cycles":37715200,"thread_start_us":345213,"threads_started":3,"wal-append.queue_time_us":199880}
I20260709 13:00:15.101956  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 548) took 1540 ms. Trace:
I20260709 13:00:15.107398  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.108057  1617 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:15.108958  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.083299  4550 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.082885  4546 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.113068  1617 raft_consensus.cc:2368] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
W20260709 13:00:15.113423  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.107101  1615 rpcz_store.cc:276] 0709 13:00:13.561435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.713179 (+1151744us) service_pool.cc:224] Handling call
0709 13:00:14.732418 (+ 19239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.732583 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:15.000397 (+267814us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.101645 (+101248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.101700 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:15.101749 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.101808 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.101911 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17793,"prepare.queue_time_us":171863,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"thread_start_us":317510,"threads_started":2}
I20260709 13:00:15.117682  1617 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:15.079558  4569 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:15.101794  4426 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.121129  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1888) took 1172 ms. Trace:
I20260709 13:00:15.138173  1617 rpcz_store.cc:276] 0709 13:00:13.948582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.117151 (+1168569us) service_pool.cc:224] Handling call
0709 13:00:15.117479 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.120847 (+  3368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.121068 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:15.118157  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 96633us
I20260709 13:00:15.101116  4578 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:15.141510  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:15.147917  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.144887  1692 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 13:00:15.067230  4575 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:00:15.146883  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 815) took 3519 ms (client timeout 1888 ms). Trace:
I20260709 13:00:15.089450  4559 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:00:15.157455  1615 raft_consensus.cc:3055] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:15.156893  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 87635.8us
W20260709 13:00:15.151366  2268 rpcz_store.cc:269] 0709 13:00:11.627627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.628373 (+   746us) service_pool.cc:224] Handling call
0709 13:00:15.146728 (+3518355us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540045a6d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:15.146819 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523064576}
I20260709 13:00:15.122188  4063 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:15.157933  1615 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.137290  4569 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.074469  4560 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.163169  4063 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:15.167266  4544 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:15.147354  4578 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:15.171546  1615 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:15.180039  1615 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.075263  4543 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.193768  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.177266  4063 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:15.174222  4569 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.182927  4473 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.148895  4577 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:00:15.181170  4504 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:15.201790  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:15.181749  4578 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.194474  4574 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.194319  4559 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.196020  4329 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.212179  1537 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:15.218415  1616 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:00:15.218817  1616 pending_rounds.cc:85] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 4
I20260709 13:00:15.219149  1616 pending_rounds.cc:107] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:15.221441  1616 raft_consensus.cc:2889] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:15.222600  4548 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:15.223351  4590 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:15.223847  4590 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.224210  4590 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:15.226061  4537 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.226109  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:15.228551  4586 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:15.229065  4586 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.230070  4441 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.229868  4586 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:15.230737  4441 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:15.179673  4582 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:15.287496  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1882) took 1643 ms. Trace:
W20260709 13:00:15.218092  4564 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:00:15.289584  1616 rpcz_store.cc:276] 0709 13:00:13.644299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.751794 (+1107495us) service_pool.cc:224] Handling call
0709 13:00:14.769128 (+ 17334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.287237 (+518109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.287436 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:15.216725  4438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.637s	user 0.005s	sys 0.028s
I20260709 13:00:15.290939  1616 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:15.322873  1541 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:00:15.323069  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.301774  1511 leader_election.cc:336] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.032s (SENT)
W20260709 13:00:15.332736  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 131021us
I20260709 13:00:15.333029  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:15.333658  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.333755  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:15.292073  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 131388us
I20260709 13:00:15.216804  4559 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.218215  4329 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:15.331491  4438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.759s	user 0.006s	sys 0.028s
I20260709 13:00:15.323568  4544 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:15.345628  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:15.351202  4587 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:15.353276  4329 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:15.354591  4377 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:15.356679  4517 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.357800  2274 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:15.358301  1511 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.562s (SENT)
I20260709 13:00:15.358736  1511 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:15.359313  4581 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:00:15.359807  1511 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.895s (SENT)
I20260709 13:00:15.360126  4376 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.361272  1685 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:15.362507  4063 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.363148  1584 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:15.363493  4601 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:15.364215  4601 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:15.364637  4601 raft_consensus.cc:697] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.364637  4063 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.365475  4601 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:15.368722  1511 leader_election.cc:336] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.703s (SENT)
I20260709 13:00:15.368877  4524 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.369138  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:15.369896  2272 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:15.372649  4441 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:15.373664  4487 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.377796  4550 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:15.001874  4041 ts_tablet_manager.cc:1469] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Trace:
0709 12:59:56.695796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.695931 (+   135us) service_pool.cc:224] Handling call
0709 12:59:57.231514 (+535583us) ts_tablet_manager.cc:934] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
0709 13:00:00.875455 (+3643941us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:01.641868 (+766413us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:01.664356 (+ 22488us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:02.497802 (+833446us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:02.595931 (+ 98129us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:02.617448 (+ 21517us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:02.619810 (+  2362us) inbound_call.cc:177] Queueing success response
0709 13:00:08.918247 (+6298437us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:13.743297 (+4825050us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:13.750439 (+  7142us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:13.784210 (+ 33771us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":9754,"mutex_wait_us":426,"raft.queue_time_us":26087,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8379,"tablet-copy.queue_time_us":423553,"tablet-download-pool.queue_time_us":151,"tablet-download-pool.run_cpu_time_us":2512,"tablet-download-pool.run_wall_time_us":5447423,"thread_start_us":349389,"threads_started":2}
I20260709 13:00:15.340147  4476 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.385881  1615 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:00:15.386541  1615 pending_rounds.cc:85] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 3
I20260709 13:00:15.386847  1615 pending_rounds.cc:107] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:00:15.365106  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:15.393122  3985 raft_consensus.cc:3055] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:15.393543  3985 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:15.387197  1615 raft_consensus.cc:2889] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:15.398306  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1896) took 1021 ms. Trace:
W20260709 13:00:15.398648  1511 leader_election.cc:336] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.772s (SENT)
I20260709 13:00:15.399785  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:15.400485  1615 rpcz_store.cc:276] 0709 13:00:14.376593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.148911 (+772318us) service_pool.cc:224] Handling call
0709 13:00:15.157334 (+  8423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.395389 (+238055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.398026 (+  2637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.346446  4544 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.415035  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:15.415614  1540 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:15.390561  4540 consensus_meta.cc:287] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 13:00:15.349773  4539 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:00:15.389096  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.422204  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:15.428651  4426 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.423122  4540 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.436077  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:15.444448  1542 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:15.437317  4423 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.394263  3985 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:15.450255  3985 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.450317  4544 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.451838  4544 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:15.412662  4441 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.454715  4590 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:15.455689  4585 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:00:15.456641  4590 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:15.458122  4550 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:15.459395  4580 log.cc:927] Time spent T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 13:00:15.460834  4117 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:15.461212  4117 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:15.454603  4578 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.439100  4593 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:15.440514  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:15.462325  1545 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:15.463110  1612 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:15.463749  4593 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:15.464598  4593 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.465341  4578 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:15.465858  4566 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.545s	user 0.001s	sys 0.000s
I20260709 13:00:15.463127  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:15.467100  1545 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
I20260709 13:00:15.467873  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:15.468727  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:15.469141  1545 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:15.470474  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:15.442534  4524 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:15.425413  4517 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:15.472111  4426 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:15.472908  1542 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:15.445621  4540 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:15.476559  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 51866.2us
W20260709 13:00:15.477716  1511 leader_election.cc:336] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53910 dropped due to backpressure: service queue is full with 50 items
I20260709 13:00:15.478070  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:15.479117  4537 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:15.443790  4559 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.435591  1536 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:15.446334  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:15.487839  1538 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.413458  4548 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:15.412864  4476 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:15.494501  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:15.495219  2275 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:15.489408  1545 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
W20260709 13:00:15.506944  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.508829  1538 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:15.509572  4548 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.510516  4548 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:15.513082  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.519188  2275 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:15.520471  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:15.521294  2275 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:15.525456  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:15.525581  1540 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:15.526171  2275 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
W20260709 13:00:15.525625  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.527526  2241 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:15.529440  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:15.530431  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:15.534768  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.534938  2271 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:15.528612  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:15.535851  2276 raft_consensus.cc:2393] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:15.531071  2241 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:15.536818  4377 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:15.536872  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:15.537441  4377 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.537746  4329 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:15.537926  4377 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.538300  4329 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:15.539176  4329 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.540683  1659 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.541540  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.541493  4404 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:15.542384  1659 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.543048  4423 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:15.543360  1659 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.543524  4423 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:15.543671  4063 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:15.543804  4404 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:15.544142  4063 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.544322  4404 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.544567  4063 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.544848  4500 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:15.544479  4423 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.545281  4500 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.545656  4500 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:15.547186  1511 leader_election.cc:336] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.035s (SENT)
I20260709 13:00:15.547875  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:15.548741  4476 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.542275  4491 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:15.553704  4404 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.553283  4063 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.556772  4063 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.557001  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:15.557653  2271 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.568073  4404 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.569949  4500 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.455057  4441 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.573755  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:15.645272  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 71571.4us
I20260709 13:00:15.577447  1612 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:15.566542  4377 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.532478  4524 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:15.585384  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:15.648743  1545 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
W20260709 13:00:15.648787  1584 connection.cc:256] RPC call timeout handler was delayed by -3.1944209750000141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 13:00:15.515003  4528 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.588488  2275 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:15.599284  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 212630us
I20260709 13:00:15.599790  2271 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:15.602065  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:15.636222  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.462066  4117 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:15.644416  1615 raft_consensus.cc:3055] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:15.654582  1615 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.654625  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:15.652118  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.655246  1686 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:15.653612  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:15.656803  1692 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:15.658110  2275 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:15.653699  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:15.646152  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:15.659018  1690 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:15.659795  3985 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:15.660060  1688 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:15.660386  3985 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:15.661065  4524 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:15.661291  3985 consensus_queue.cc:1059] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:15.661973  4524 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.049726  1620 rpcz_store.cc:276] 0709 13:00:13.948137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.813841 (+865704us) service_pool.cc:224] Handling call
0709 13:00:14.837224 (+ 23383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.011750 (+174526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.011783 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.011828 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:15.011888 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.011946 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.012056 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":211942,"thread_start_us":158846,"threads_started":1}
W20260709 13:00:15.649364  1584 connection.cc:256] RPC call timeout handler was delayed by -3.109820974999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:00:15.666723  1584 connection.cc:256] RPC call timeout handler was delayed by -3.0405209749999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:00:15.669623  1584 connection.cc:256] RPC call timeout handler was delayed by -3.0009209750000423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 13:00:15.669914  1584 connection.cc:256] RPC call timeout handler was delayed by -2.9559209750000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 13:00:15.670197  1584 connection.cc:256] RPC call timeout handler was delayed by -2.93342097499999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 13:00:15.670503  1584 connection.cc:256] RPC call timeout handler was delayed by -2.9082209750000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 13:00:15.670794  1584 connection.cc:256] RPC call timeout handler was delayed by -2.9028209749999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:00:15.671078  1584 connection.cc:256] RPC call timeout handler was delayed by -2.8758209750000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 13:00:15.671341  1584 connection.cc:256] RPC call timeout handler was delayed by -2.8515209750000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:00:15.671590  1584 connection.cc:256] RPC call timeout handler was delayed by -2.8515209750000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:00:15.671839  1584 connection.cc:256] RPC call timeout handler was delayed by -2.8083209750000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 13:00:15.672099  1584 connection.cc:256] RPC call timeout handler was delayed by -2.7597209749999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 13:00:15.672425  1584 connection.cc:256] RPC call timeout handler was delayed by -2.710220975000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 13:00:15.672691  1584 connection.cc:256] RPC call timeout handler was delayed by -2.5284209750000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2264s for a response
W20260709 13:00:15.672940  1584 connection.cc:256] RPC call timeout handler was delayed by -2.3106209750000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2506s for a response
W20260709 13:00:15.673216  1584 connection.cc:256] RPC call timeout handler was delayed by -1.5789209750000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33190000000000003s for a response
I20260709 13:00:15.673697  1584 leader_election.cc:400] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 13:00:15.668422  1659 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.675557  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:15.676460  2275 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
W20260709 13:00:15.677917  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2282) took 3793 ms (client timeout 1825 ms). Trace:
I20260709 13:00:15.678400  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.680145  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:15.681201  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:15.682367  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:15.683171  1690 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:15.684784  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:15.678333  1611 rpcz_store.cc:269] 0709 13:00:11.884273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.027118 (+142845us) service_pool.cc:224] Handling call
0709 13:00:15.677758 (+3650640us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54001013d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:15.677852 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3734507776}
I20260709 13:00:15.685540  1690 raft_consensus.cc:2410] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:15.686504  1686 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:15.686736  1693 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:15.649091  4537 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.694381  1689 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:15.694895  1693 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:15.695027  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:15.695950  2271 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.686168  1692 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:15.699577  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:15.699986  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:15.699993  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:15.685904  4423 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:15.663937  4441 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.665148  4528 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:15.662421  4546 raft_consensus.cc:3055] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:15.704847  4590 consensus_queue.cc:1059] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.705452  4403 raft_consensus.cc:3055] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:15.686568  4117 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:15.708045  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:15.683436  4517 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.665153  4404 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:15.711269  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.678848  4099 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.759061  4423 raft_consensus.cc:697] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:15.682943  4063 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:15.718539  1692 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.775086  1691 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:00:15.777359  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 69370.3us
I20260709 13:00:15.691540  4376 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:15.790548  4376 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.662110  3985 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:00:15.790992  4590 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.701097  1703 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-dbe29c0d913c42cfb39d487a69abfd46 received from {username='slave'} at 127.0.0.1:52426
I20260709 13:00:15.792629  1703 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-dbe29c0d913c42cfb39d487a69abfd46 on tablet dbe29c0d913c42cfb39d487a69abfd46 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:15.760040  2275 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:15.753135  4546 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:15.795425  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:15.795938  2275 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:15.796039  4546 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:15.797150  4546 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.790997  4376 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.801440  4528 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.801901  4528 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.771404  4403 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:15.803435  4403 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.804286  4403 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.807034  2275 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:15.779102  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:15.783459  4099 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.783998  4500 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.783803  4423 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.784241  4063 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:15.785118  4377 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:15.716364  4427 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:00:15.788105  4603 log.cc:927] Time spent T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:00:15.789857  2271 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:15.705487  4438 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.816829  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:15.819314  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 102893us
I20260709 13:00:15.820359  2271 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:15.818671  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:15.809804  4578 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.824455  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:15.825569  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:15.826352  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:15.827183  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:15.827405  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:15.820564  4602 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:15.830549  4561 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:15.835515  4063 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.807638  4517 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.845417  2273 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:15.845944  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:15.846244  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 866) took 1162 ms. Trace:
I20260709 13:00:15.847123  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:15.846803  2273 rpcz_store.cc:276] 0709 13:00:14.684357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.684921 (+   564us) service_pool.cc:224] Handling call
0709 13:00:15.844688 (+1159767us) spinlock_profiling.cc:243] Waited 9.65 ms on lock 0x7b5800013e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:00:15.845203 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.845952 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.846183 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22202112}
I20260709 13:00:15.828641  4438 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:15.830508  4601 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:15.828214  4590 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:15.829720  4404 raft_consensus.cc:2764] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:15.828217  4586 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:15.843250  4602 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.858776  4528 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:15.861416  4376 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.849062  4574 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.848994  4577 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:00:15.850804  4582 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:15.864228  4582 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.865164  4582 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.856216  4601 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.866765  4379 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:15.864274  1687 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:15.827340  4461 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:00:15.850536  4438 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:15.869062  4438 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.869117  4601 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:15.855684  4586 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:15.871098  4586 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.853498  4590 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:15.873229  4590 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:15.847913  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:15.881840  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.882419  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:15.883306  1612 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:15.878815  4605 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:00:15.885149  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:15.895613  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:15.903416  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.900907  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:15.913283  2268 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.900660  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:15.899371  4569 consensus_meta.cc:287] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.696s	user 0.005s	sys 0.004s
I20260709 13:00:15.882157  4561 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:15.931183  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.883163  4500 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:15.936445  1612 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:15.937304  2268 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:15.937394  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:15.936511  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 106327us
I20260709 13:00:15.938650  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.899696  4473 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:15.900642  4376 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.939611  1612 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:15.900064  4379 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.886102  4438 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.936985  4500 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:15.951225  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.953094  1692 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:15.954807  1691 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:15.957815  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 553) took 2349 ms (client timeout 3010 ms). Trace:
W20260709 13:00:15.958144  1618 rpcz_store.cc:269] 0709 13:00:13.608631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.589083 (+980452us) service_pool.cc:224] Handling call
0709 13:00:15.957668 (+1368585us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540024a754. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:15.957769 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894096128}
I20260709 13:00:15.959050  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.960040  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.964087  1659 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.946251  4602 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.966740  4500 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.967816  4500 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:15.973706  4576 raft_consensus.cc:3055] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:15.974109  4576 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:15.974505  4099 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:15.978103  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.980851  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:15.980729  1615 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:15.981786  1615 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:15.981613  1618 raft_consensus.cc:2410] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:15.982378  2277 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:15.983446  1659 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.983471  2275 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:15.983441  2243 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:15.982537  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:15.987123  2268 raft_consensus.cc:2368] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
W20260709 13:00:15.988968  1660 leader_election.cc:336] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.664s (SENT)
I20260709 13:00:15.989526  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:15.991767  1691 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:15.992522  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:15.992944  1660 leader_election.cc:336] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.673s (SENT)
I20260709 13:00:15.993376  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:15.993556  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:15.994029  4419 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:15.994359  4613 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
W20260709 13:00:16.001681  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.003321  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:15.995168  2271 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:16.005402  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 872) took 1318 ms. Trace:
I20260709 13:00:16.014130  2269 rpcz_store.cc:276] 0709 13:00:14.687271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.725455 (+ 38184us) service_pool.cc:224] Handling call
0709 13:00:14.735379 (+  9924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.899415 (+164036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.005138 (+1105723us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x7b540071dc54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:16.005319 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223157504}
I20260709 13:00:16.019380  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:15.996441  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:16.021834  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:15.996793  2273 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:16.026847  1660 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:16.028401  1660 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:16.029253  2268 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:15.936141  4569 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:15.953972  4517 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:15.996280  4619 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:16.033241  1690 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:16.018538  4376 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:16.043083  1660 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:16.054472  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:16.036906  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:16.055639  1691 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:16.038969  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:15.990518  4528 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:16.031914  1692 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:16.016331  4561 raft_consensus.cc:697] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:15.994831  4404 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.994611  4419 raft_consensus.cc:697] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:16.036581  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.053094  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:16.084009  1689 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:16.084153  1618 raft_consensus.cc:2410] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:00:16.001168  4567 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.079s	user 0.002s	sys 0.003s
I20260709 13:00:16.029265  4461 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:15.995985  4403 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:16.057670  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.050800  2243 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:16.106067  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 55368.8us
I20260709 13:00:16.059108  2276 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:16.032209  4422 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:16.062987  4618 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:16.057986  4427 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:16.109465  1687 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:16.110778  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:16.064594  4586 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.065497  4438 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:16.065690  4544 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:16.057721  4504 consensus_queue.cc:1059] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:16.070336  4515 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:16.089470  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.097332  4377 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.030292  4576 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.074492  4569 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:16.126492  4561 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:16.128007  4590 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:16.118500  4548 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:00:16.129900  4590 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:16.110996  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:16.075815  4376 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:16.134811  4376 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.130506  4117 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:00:16.138614  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 868) took 1453 ms. Trace:
I20260709 13:00:16.138990  2270 rpcz_store.cc:276] 0709 13:00:14.685008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.726890 (+ 41882us) service_pool.cc:224] Handling call
0709 13:00:14.732605 (+  5715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.746891 (+ 14286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.746933 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.752772 (+  5839us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.921425 (+168653us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:15.480125 (+558700us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b1800322de0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:15.813150 (+333025us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b1800322de0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ef79d3c7 00007f29ebdaf9a7 00007f29ebdbf0bf
0709 13:00:15.813276 (+   126us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.818174 (+  4898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.818243 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.000535 (+182292us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:16.138404 (+137869us) raft_consensus.cc:1685] finished
0709 13:00:16.138431 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.138563 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12057,"prepare.queue_time_us":41644,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":18919,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":7481,"spinlock_wait_cycles":44445056,"thread_start_us":186010,"threads_started":2,"wal-append.queue_time_us":144433}
I20260709 13:00:16.142875  4576 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:16.112959  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.114153  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:16.147750  2271 raft_consensus.cc:2368] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7.
I20260709 13:00:16.115981  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2323) took 2850 ms. Trace:
W20260709 13:00:16.118372  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 62396.9us
W20260709 13:00:16.118870  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 83307.8us
W20260709 13:00:16.120942  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.110569  4534 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:16.107980  4619 raft_consensus.cc:697] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:16.125214  4377 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.130786  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.132033  4419 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.133497  4560 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:16.133948  4540 raft_consensus.cc:3055] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:16.149137  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:16.150220  1537 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:16.150336  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:16.222972  1539 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 13:00:16.148725  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:16.224311  4377 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:16.225190  4500 raft_consensus.cc:2764] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:00:16.226187  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 77540.8us
I20260709 13:00:16.229089  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:16.229404  1660 leader_election.cc:400] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:16.229715  1660 leader_election.cc:403] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:16.115087  4422 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:16.148383  1613 rpcz_store.cc:276] 0709 13:00:13.265609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.699333 (+1433724us) service_pool.cc:224] Handling call
0709 13:00:15.957772 (+1258439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.958042 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.958069 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.958102 (+    33us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:15.958132 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.958183 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.115832 (+157649us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540024a750. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:16.115927 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1117,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":2893234048}
I20260709 13:00:16.232086  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:16.259378  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.166960  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.287485  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:16.289091  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 61009.1us
I20260709 13:00:16.290061  1585 leader_election.cc:400] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:16.291316  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:16.291841  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:16.292532  1692 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:16.293138  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:16.295440  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.320523  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.291906  1694 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:16.321077  4500 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:16.481834  4504 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:16.387619  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.482424  4504 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.414487  4290 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.482569  4539 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:16.483366  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.472312  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:16.484349  4504 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:16.484493  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.501230  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.503789  1544 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:16.323458  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.504918  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:16.505461  1537 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:16.502442  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.403215  2276 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:16.507593  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:16.535184  2277 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:16.514094  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:16.476660  2269 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:16.322017  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:16.508579  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:16.321039  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.399268  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1901) took 1974 ms. Trace:
I20260709 13:00:16.539165  1615 rpcz_store.cc:276] 0709 13:00:14.425340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.401995 (+976655us) service_pool.cc:224] Handling call
0709 13:00:15.402303 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.980442 (+578139us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4c004a29c0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea071a20 00007f29ea082a29 00007f29ea048644 00007f29ea06ff2d 00007f29ea06fb93 00007f29ebda018b 00007f29ebda0cb5 00007f29ebd9bf30 00007f29ebd9d7de 00007f29ebda7b49 00007f29ebda8416
0709 13:00:16.113373 (+132931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.113405 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.113440 (+    35us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:16.113475 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.399067 (+285592us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540036d654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:16.399110 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.399219 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12874,"raft.queue_time_us":43843,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":566143104,"thread_start_us":79514,"threads_started":1}
I20260709 13:00:16.541374  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.360066  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:16.411260  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2295) took 4404 ms (client timeout 3176 ms). Trace:
W20260709 13:00:16.543818  1619 rpcz_store.cc:269] 0709 13:00:12.007134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.411072 (+4403938us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:16.411198 (+   126us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:16.544889  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.485702  2273 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Advancing to term 4
I20260709 13:00:16.391872  1510 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:16.348680  1688 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:16.508800  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:16.549618  1538 raft_consensus.cc:2410] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:16.322476  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:16.550561  2270 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:16.552786  1691 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:16.538431  1539 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:16.336189  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:16.417533  4628 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:00:16.287256  4540 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:16.576282  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.482435  4426 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:16.596807  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.628120  1620 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 13:00:16.501262  4551 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:16.598999  4441 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:16.386581  4586 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:16.599434  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.594559  4473 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:16.387377  4422 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:16.387737  4619 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.484570  4539 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:16.420629  4637 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:00:16.606135  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 50708.8us
I20260709 13:00:16.658092  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:16.592649  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 104286us
I20260709 13:00:16.662561  1658 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:16.343307  4629 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
W20260709 13:00:16.396564  4606 log.cc:927] Time spent T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.749s	user 0.004s	sys 0.002s
I20260709 13:00:16.322930  1509 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:16.603158  1618 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:00:16.559561  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 167745us
W20260709 13:00:16.676172  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2309) took 3651 ms (client timeout 1980 ms). Trace:
I20260709 13:00:16.676331  1510 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:16.614388  1619 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
W20260709 13:00:16.676543  1614 rpcz_store.cc:269] 0709 13:00:13.024862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.978077 (+1953215us) service_pool.cc:224] Handling call
0709 13:00:16.675995 (+1697918us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b5400067a54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:16.676117 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150943488}
I20260709 13:00:16.616704  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:16.577975  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:16.630229  2243 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:16.678131  1613 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:16.681890  2270 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:16.321274  4537 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.447608  4635 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.320s
I20260709 13:00:16.643591  1615 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:16.385840  4632 consensus_queue.cc:1059] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.330s
W20260709 13:00:16.686422  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 363510us
I20260709 13:00:16.320083  4427 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.316s
I20260709 13:00:16.347114  4403 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.317s
I20260709 13:00:16.345899  4569 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.294s
I20260709 13:00:16.322919  4590 consensus_queue.cc:1059] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.318s
I20260709 13:00:16.653192  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 826) took 1612 ms. Trace:
I20260709 13:00:16.383821  4544 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.258s
I20260709 13:00:16.661087  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:16.667165  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:16.615306  4578 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:00:16.748319  2272 rpcz_store.cc:276] 0709 13:00:15.040913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.060103 (+ 19190us) service_pool.cc:224] Handling call
0709 13:00:15.060356 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.370257 (+309901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.652978 (+1282721us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b540071e8d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:16.653137 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711397248}
W20260709 13:00:16.749251  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 82143.3us
I20260709 13:00:16.445869  4377 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.682538  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.684494  1614 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:16.684710  1617 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:16.685103  1618 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:16.757915  1618 pending_rounds.cc:85] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 8
I20260709 13:00:16.758284  1618 pending_rounds.cc:107] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:16.711392  1619 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:16.758618  1618 raft_consensus.cc:2889] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:16.760883  1618 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:16.762115  1618 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:16.712883  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.763942  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:16.415660  4568 consensus_queue.cc:1059] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.305s
I20260709 13:00:16.642383  4426 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.775316  4476 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:16.733210  1686 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:16.775739  4476 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.776127  4476 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:16.776393  4551 raft_consensus.cc:3055] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:16.776784  4551 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:16.756448  1613 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:16.753609  2273 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:00:16.670804  4421 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:16.675593  4517 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:00:16.777885  4421 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.777669  4551 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.778295  4421 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.651389  4473 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:16.767081  1615 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:16.778877  1615 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:16.778806  4634 consensus_queue.cc:1059] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.164s
I20260709 13:00:16.779275  4473 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.780001  4634 raft_consensus.cc:3055] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:16.779807  1615 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:16.780165  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:16.780443  4634 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:16.780743  1615 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.758978  1619 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:16.781280  4634 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.781723  1619 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.782444  4634 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:16.773464  4377 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.775125  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:16.776832  4426 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:16.780850  1612 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:16.766209  4468 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:16.770740  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 109742us
I20260709 13:00:16.795476  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:16.699090  1510 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:16.783073  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1613) took 5441 ms (client timeout 1905 ms). Trace:
W20260709 13:00:16.796648  1685 rpcz_store.cc:269] 0709 13:00:11.341181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.604831 (+263650us) service_pool.cc:224] Handling call
0709 13:00:16.782929 (+5178098us) spinlock_profiling.cc:243] Waited 3.72 s on lock 0x7b5400305054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:16.783017 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8551466880}
I20260709 13:00:16.686694  4500 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:16.798429  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 99425.2us
I20260709 13:00:16.772976  4063 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.686456  4539 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:16.736855  4502 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.735306  4379 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:16.755842  4529 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:16.801081  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:16.783458  2273 pending_rounds.cc:85] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 3
I20260709 13:00:16.798396  1615 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:16.840473  2273 pending_rounds.cc:107] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 13:00:16.840785  2273 raft_consensus.cc:2889] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:16.809418  2274 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.028s	sys 0.018s
I20260709 13:00:16.789343  4504 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:16.816272  2241 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:16.799501  4618 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.786216  4637 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:16.788666  4578 consensus_queue.cc:1243] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:16.824353  2277 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:16.792068  4551 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:16.841272  2274 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.028s	sys 0.018s
I20260709 13:00:16.730583  4537 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:16.817291  4500 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.817957  4546 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:16.824406  4426 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:16.849269  4529 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.822953  4063 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:16.860730  4502 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:16.870164  4500 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:16.880800  4502 raft_consensus.cc:697] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:16.882016  4544 raft_consensus.cc:3055] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:16.706420  4540 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.882438  4544 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:16.883064  4540 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.883380  4544 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.884739  4544 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:16.879113  4529 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:16.849891  4379 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.881695  4502 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:16.890435  4376 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.890969  4376 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:16.891204  4528 consensus_queue.cc:1175] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 7 } }
W20260709 13:00:16.879837  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 249660us
I20260709 13:00:16.856061  4618 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:16.930537  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 278988us
W20260709 13:00:16.931625  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.920s (SENT) [suppressed 37 similar messages]
W20260709 13:00:16.932647  1511 leader_election.cc:336] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 3.176s (SENT)
I20260709 13:00:16.934234  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:16.952646  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 188747us
W20260709 13:00:16.965293  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.955492  4379 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:16.971488  4379 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:16.971942  4379 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:16.972354  4379 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:16.948450  4543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.001s	sys 0.015s
W20260709 13:00:16.985627  4543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.004s	sys 0.016s
W20260709 13:00:17.007266  4646 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:17.009310  4528 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:17.009840  4528 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.010246  4528 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:16.910528  4539 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:17.023945  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 207726us
I20260709 13:00:16.993814  4063 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:17.034873  1619 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.037472  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.021751  4376 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:17.024077  4377 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:17.039016  4500 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.106952  4537 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.107879  4655 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:17.111613  4645 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:00:17.112826  4476 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.114583  4618 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.119109  4653 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.156140  4290 consensus_meta.cc:287] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.673s	user 0.002s	sys 0.007s
I20260709 13:00:17.164634  1686 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:17.106285  4379 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.165786  4560 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.175957  4426 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:17.180891  4560 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.166033  4653 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:17.214895  4610 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 1.417s	user 0.002s	sys 0.006s
I20260709 13:00:17.221269  4664 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.221897  4664 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.217160  4665 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.224596  4665 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:17.230613  4656 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:00:17.259393  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 326479us
W20260709 13:00:17.266598  1511 leader_election.cc:336] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.136s (SENT)
I20260709 13:00:17.267652  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:17.268707  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 467550us
I20260709 13:00:17.270082  1510 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:17.271627  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.272399  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.274798  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.277362  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:17.297502  1510 leader_election.cc:400] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7.
W20260709 13:00:17.300652  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.300675  1510 leader_election.cc:403] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:17.306967  1619 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:17.309379  4379 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.311278  4290 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.312203  4473 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:17.312695  4421 consensus_meta.cc:287] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.526s	user 0.004s	sys 0.005s
I20260709 13:00:17.312289  4290 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.313129  4473 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.313469  4421 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.316150  4421 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:17.316651  4473 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.317296  4473 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:17.316864  4426 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.317797  4473 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:17.319267  4473 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.325506  4476 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.328716  4500 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:17.332846  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.335198  4537 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:17.334844  4502 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:17.344746  4476 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:17.214975  4659 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:00:17.352885  4290 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.402078  4673 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:00:17.425414  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.429069  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 122044us
I20260709 13:00:17.215042  4663 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 13:00:17.428239  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 122852us
I20260709 13:00:17.433502  4678 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.434289  4678 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.423174  4379 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:17.437160  4678 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.439112  1616 raft_consensus.cc:3055] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:17.439666  1616 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:17.440991  1616 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.443044  1616 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:17.446789  4660 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.447459  4660 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.449532  4660 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:17.451243  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.004s	sys 0.007s
W20260709 13:00:17.451742  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.004s	sys 0.007s
I20260709 13:00:17.452600  4528 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:17.453297  4529 consensus_meta.cc:287] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.566s	user 0.003s	sys 0.014s
I20260709 13:00:17.453763  4529 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.454807  4655 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:17.454996  4528 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.455304  4655 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:17.456601  4655 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.457916  4655 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:17.459475  4577 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:17.467960  4517 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:17.472810  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:17.473702  1538 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:17.471242  4529 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:17.490157  4577 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:17.492972  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.493216  4577 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.477592  4421 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:17.495167  4421 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.495638  4560 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.497793  4421 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.499089  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:17.499996  1540 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:17.504141  4634 consensus_meta.cc:287] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.002s
I20260709 13:00:17.507131  4546 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:17.507716  4546 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:17.510068  1511 leader_election.cc:336] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.149s (SENT)
I20260709 13:00:17.516010  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:17.523193  4529 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:17.524374  4529 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:17.524704  4529 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:17.526103  4577 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.526969  4577 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.529690  4577 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.534812  4632 raft_consensus.cc:3055] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:17.535298  4632 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:17.535485  1616 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:00:17.535876  1616 pending_rounds.cc:85] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 8
I20260709 13:00:17.536111  1616 pending_rounds.cc:107] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:17.536415  1616 raft_consensus.cc:2889] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:17.536526  4632 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.537222  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 575) took 1314 ms. Trace:
I20260709 13:00:17.537637  1616 rpcz_store.cc:276] 0709 13:00:16.222686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.671269 (+448583us) service_pool.cc:224] Handling call
0709 13:00:16.754577 (+ 83308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.438800 (+684223us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400369aa0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd1cdc0 00007f29ebda71c0 00007f29ebda8231 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c
0709 13:00:17.536953 (+ 98153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.537175 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236678016}
W20260709 13:00:17.539233  4627 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:00:17.540549  4639 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.919s	user 0.007s	sys 0.000s
W20260709 13:00:17.540859  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 57060.3us
I20260709 13:00:17.542148  4560 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:17.544286  4643 log.cc:927] Time spent T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.661s	user 0.004s	sys 0.003s
W20260709 13:00:17.546744  4644 log.cc:927] Time spent T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.650s	user 0.003s	sys 0.003s
I20260709 13:00:17.547920  1689 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:17.548259  1689 pending_rounds.cc:85] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 6
I20260709 13:00:17.548564  1689 pending_rounds.cc:107] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:17.548789  1689 raft_consensus.cc:2889] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:17.550359  4421 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.550984  4421 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.551270  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.552126  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:17.552898  1692 raft_consensus.cc:2368] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:00:17.553133  4421 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.553797  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:17.534863  4476 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:17.555016  4476 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.555584  4539 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:17.557370  4665 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.550547  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.557502  4476 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.553929  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1873) took 1046 ms. Trace:
I20260709 13:00:17.552702  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:17.558110  4659 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:17.559185  4560 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.557507  4539 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:17.525902  4529 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.559875  1691 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:17.521072  1509 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:17.562820  4476 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.552162  1693 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:17.560087  4632 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.558178  4528 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:17.558308  4377 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:17.579871  1538 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:17.576364  4528 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:17.596989  1545 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:17.585649  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.599086  1693 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:00:17.598783  4560 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.560508  1543 rpcz_store.cc:276] 0709 13:00:16.507806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.552152 (+ 44346us) service_pool.cc:224] Handling call
0709 13:00:16.594763 (+ 42611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.594974 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:16.859552 (+264578us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.500465 (+640913us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b180049a080. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a
0709 13:00:17.515267 (+ 14802us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.515364 (+    97us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:17.515470 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.520314 (+  4844us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.553786 (+ 33472us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36542,"prepare.queue_time_us":398002,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":1639,"raft.queue_time_us":13742,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"spinlock_wait_cycles":27748736,"thread_start_us":417143,"threads_started":2,"wal-append.queue_time_us":331823}
I20260709 13:00:17.599304  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.600318  1542 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 3.
I20260709 13:00:17.600835  1543 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:17.600996  4560 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.580700  4529 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:17.601444  1688 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:17.601814  4674 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.602620  4674 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.605247  4674 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.591409  1689 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:17.565117  4290 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:17.591639  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:17.597882  4546 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:00:17.607394  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 95608.5us
I20260709 13:00:17.593698  4377 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.596982  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.595207  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.592901  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:17.597818  4528 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.620967  1688 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:17.608212  1545 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:17.577356  4476 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.582501  4659 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.624517  1540 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:17.625404  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:17.625433  1691 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:17.626199  1687 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:17.626623  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1889) took 3677 ms. Trace:
I20260709 13:00:17.628031  4476 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.629844  4377 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.630749  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.630666  4674 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.631685  1536 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:17.638281  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:17.640758  1616 raft_consensus.cc:2410] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:17.642122  4515 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.642771  4515 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.647454  4403 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.647625  1543 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:17.647825  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:17.634500  1617 rpcz_store.cc:276] 0709 13:00:13.948807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.139745 (+1190938us) service_pool.cc:224] Handling call
0709 13:00:16.676134 (+1536389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.757582 (+ 81448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.626251 (+868669us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400067a50. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:17.626422 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3531933440}
I20260709 13:00:17.648166  4403 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.648864  4528 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:17.650537  4546 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.655028  4674 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.657302  4674 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.658277  4510 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:17.658408  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 65774.2us
W20260709 13:00:17.660270  4675 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.425s	user 0.001s	sys 0.001s
I20260709 13:00:17.665777  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:17.666493  2272 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.666815  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:17.668140  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.669940  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:17.671103  4655 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.671512  1612 raft_consensus.cc:2410] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:17.671600  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:17.671802  4655 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.674351  4655 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.636690  4421 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.680039  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:17.681252  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44349.7us
I20260709 13:00:17.666147  2276 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:17.638346  4660 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.668422  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:17.689211  2272 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:17.690752  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:17.692498  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:17.684345  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:17.689697  4659 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.686378  4529 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.689996  4502 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7.
I20260709 13:00:17.704592  4546 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.720343  1689 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:17.691399  4655 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:00:17.721799  1538 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:17.722440  1615 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.691352  4290 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.730319  2273 raft_consensus.cc:2393] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:17.691231  4421 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:17.739832  4379 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:17.742949  1538 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:17.729965  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:17.751341  2269 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:17.752209  1545 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:17.755544  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.756539  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:17.717473  4546 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.718683  4529 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:17.766798  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.773188  4546 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.775230  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:17.777176  4618 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.777921  4618 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.779841  4618 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:17.781510  2271 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:17.781847  2269 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:17.784003  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.786439  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.786981  1687 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:17.788410  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.789242  4290 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.796238  1615 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:17.754777  4500 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.799973  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:17.800648  2269 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
W20260709 13:00:17.803093  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.810047  4515 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.811969  4117 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:17.812549  4117 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.814404  4117 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:17.820029  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.815954  4504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.023s	sys 0.049s
I20260709 13:00:17.816206  2243 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:17.818037  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:17.805398  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:17.821153  1545 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:17.814519  1544 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:17.815584  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.797963  4510 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:00:17.820611  4504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.023s	sys 0.049s
I20260709 13:00:17.825896  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:17.805164  4618 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:17.824453  4504 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:17.828524  1687 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:17.828922  1689 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:17.828991  4452 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:17.842367  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.833181  4528 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:17.843961  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:17.824733  4500 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.845150  4452 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.853752  4682 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:00:17.854081  4452 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.856431  4452 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.864475  4376 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.865224  4376 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.832612  4618 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.875834  4504 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.846261  4510 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.877936  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 844) took 1768 ms. Trace:
I20260709 13:00:17.878844  4510 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.879560  4403 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.880435  4534 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:17.880909  4534 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:17.881645  4500 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:17.882542  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.876276  4529 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.853202  4528 raft_consensus.cc:697] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:17.850904  4634 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:17.890235  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:17.875926  4421 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:17.873093  4376 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:17.886600  4659 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.897877  1538 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:17.902550  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.910442  4634 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:17.912653  4634 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:17.915630  4655 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:17.919845  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:17.921258  1510 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:17.922245  4290 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:17.922696  4169 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:17.923089  4169 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.923427  4169 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:17.924125  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.925661  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.927012  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.928231  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.928409  1620 raft_consensus.cc:3055] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:17.928799  1620 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:17.929169  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.929831  1620 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:17.930876  1536 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:17.931463  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:17.922739  4290 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:17.932268  1545 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:17.933795  1541 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.926662  1539 raft_consensus.cc:2410] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:00:17.932643  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.939688  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.878294  2274 rpcz_store.cc:276] 0709 13:00:16.109068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.111703 (+  2635us) service_pool.cc:224] Handling call
0709 13:00:16.111949 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.225112 (+113163us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:16.863322 (+638210us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.876380 (+1013058us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b180044ea80. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a
0709 13:00:17.876652 (+   272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.876713 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:17.876786 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.877612 (+   826us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540075fb54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:17.877649 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.877774 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2012,"prepare.queue_time_us":729735,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":3565,"spinlock_wait_cycles":273779968,"thread_start_us":700933,"threads_started":2,"wal-append.queue_time_us":326723}
I20260709 13:00:17.939990  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:17.943707  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:17.948639  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:17.949126  1694 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:17.945716  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:17.951706  1687 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:17.954123  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:17.943203  4422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.013s	sys 0.010s
I20260709 13:00:17.947962  4117 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:17.955703  1620 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.960289  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.963415  1685 raft_consensus.cc:2410] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:17.972368  4117 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:17.974929  1511 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.832s (SENT)
I20260709 13:00:17.979403  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.980252  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 843) took 1402 ms. Trace:
I20260709 13:00:17.950150  4379 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:17.948418  4627 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:17.984552  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:17.939751  4655 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:00:17.980731  2277 rpcz_store.cc:276] 0709 13:00:16.577568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.577712 (+   144us) service_pool.cc:224] Handling call
0709 13:00:17.979932 (+1402220us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540052e9d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:17.980052 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336343296}
I20260709 13:00:17.954943  4546 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:17.957857  4422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.013s	sys 0.010s
I20260709 13:00:17.993695  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:17.974526  4117 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:18.000288  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:18.006479  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 120863us
I20260709 13:00:17.985816  4379 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:17.993901  4537 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:18.011022  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.013881  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:18.014894  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 54641.5us
I20260709 13:00:17.956436  4528 consensus_queue.cc:237] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:18.025709  1509 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:18.025317  1685 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:18.026839  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:18.028957  4169 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:18.030090  1540 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:18.015516  4379 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.043020  1541 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:18.016348  4476 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.041697  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:18.019737  4537 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:18.049916  1689 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:18.049736  1509 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:18.053021  1687 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:18.057425  4540 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:18.057974  4540 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:18.058830  4681 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:18.060019  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:18.050036  4537 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:18.062865  1511 leader_election.cc:336] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.915s (SENT)
I20260709 13:00:18.062417  1620 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:18.066391  1617 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:18.067133  1511 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:18.056857  4502 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:18.066893  1617 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:18.078233  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1918) took 2033 ms. Trace:
I20260709 13:00:18.079414  4664 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:18.080440  4618 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:18.078536  1620 rpcz_store.cc:276] 0709 13:00:16.035383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.629076 (+593693us) service_pool.cc:224] Handling call
0709 13:00:16.629389 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.928132 (+1298743us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540036aea0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd1cdc0 00007f29ebda71c0 00007f29ebda8231 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c
0709 13:00:18.063498 (+135366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.069150 (+  5652us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356824960}
W20260709 13:00:18.087420  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 79254.7us
I20260709 13:00:18.088914  2274 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:18.090129  2276 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:18.090266  2269 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:18.090723  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:18.090999  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:18.090217  2268 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:18.065873  4552 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:00:18.062201  4681 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.092480  4681 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.100792  1509 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:18.098887  4627 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.103001  2268 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:18.104173  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:18.114250  4681 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:18.116513  4681 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:18.082655  4546 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.124527  1694 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:18.035503  4290 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:18.072777  4502 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:18.130465  4671 log.cc:927] Time spent T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.703s	user 0.005s	sys 0.001s
I20260709 13:00:18.134452  4560 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:18.137387  4560 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:18.139340  4560 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:18.139206  1617 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:18.140352  4681 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:18.119976  4668 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:00:18.095885  4655 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:18.145269  1511 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.990s (SENT)
I20260709 13:00:18.155700  2270 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:18.156644  4653 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:18.158432  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 133561us
I20260709 13:00:18.158887  4627 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.159371  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:18.159433  4627 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:18.161659  4627 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:18.163740  4540 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:18.164776  4688 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:00:18.165144  1537 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:18.166656  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:18.167235  2268 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:18.168155  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:18.170079  4546 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:18.170871  4546 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:18.139931  4502 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:18.071076  4476 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:18.149405  4473 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:18.173343  4546 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:18.188792  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:18.201294  1617 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.145262  4660 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:18.211647  1537 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:00:18.212116  1537 pending_rounds.cc:85] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 8
I20260709 13:00:18.212383  1537 pending_rounds.cc:107] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:18.212666  1537 raft_consensus.cc:2889] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:18.185833  4634 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.238610  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:18.251956  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:18.289649  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 188913us
I20260709 13:00:18.189718  4655 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:18.306128  1509 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:18.314831  1544 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:18.283260  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:18.319579  2270 raft_consensus.cc:2410] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:18.204293  4681 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:18.201148  4473 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:18.253981  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.321221  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:18.325672  1542 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:18.303090  4528 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.253285  4660 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:18.327850  4290 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:18.329339  4577 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:18.329648  4691 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 13:00:18.330003  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.329869  4290 raft_consensus.cc:697] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:18.330817  2275 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:18.331187  4290 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:18.304481  4377 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.335633  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:18.336688  2269 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:18.312297  4659 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:18.337423  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.337404  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:18.304936  4421 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:18.342242  4377 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:18.346580  1617 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:00:18.348004  1617 pending_rounds.cc:85] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 7
I20260709 13:00:18.348280  1617 pending_rounds.cc:107] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:18.348544  1617 raft_consensus.cc:2889] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:18.357683  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.281993  4546 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:00:18.361519  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:18.325678  4473 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.369379  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:19.120047  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 918079us
I20260709 13:00:18.382432  1689 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:18.878916  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:19.123553  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:18.596935  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:18.686846  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:18.400470  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:18.493525  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.120282  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.740862  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.619973  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:18.426973  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:18.427399  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:18.494352  1510 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:18.369455  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 232659us
W20260709 13:00:19.129206  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.446727  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:18.468891  1693 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:00:19.130615  1691 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.136394  1542 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.139501  1687 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:19.137854  1541 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 4: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:19.129550  1538 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
W20260709 13:00:18.602129  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 76328us
W20260709 13:00:18.800748  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 570) took 2723 ms (client timeout 1809 ms). Trace:
I20260709 13:00:19.135108  1693 pending_rounds.cc:85] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 7
I20260709 13:00:19.140707  1693 pending_rounds.cc:107] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:18.690757  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:19.141059  1693 raft_consensus.cc:2889] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:19.141332  1686 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:18.679215  4534 consensus_meta.cc:287] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.000s
W20260709 13:00:18.812602  4709 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.481s	user 0.002s	sys 0.000s
W20260709 13:00:18.843634  4379 consensus_meta.cc:287] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.790s	user 0.005s	sys 0.006s
I20260709 13:00:19.142767  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:19.148699  1539 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
W20260709 13:00:18.687263  4686 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:00:19.140570  1690 rpcz_store.cc:269] 0709 13:00:16.054143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.054265 (+   122us) service_pool.cc:224] Handling call
0709 13:00:18.669837 (+2615572us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54003a9b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:18.777675 (+107838us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5052097280}
W20260709 13:00:18.815472  4708 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.454s	user 0.001s	sys 0.000s
I20260709 13:00:19.151105  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:19.084415  4063 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:19.128377  4707 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.001s	sys 0.016s
I20260709 13:00:18.426258  4634 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.153159  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:18.703470  4377 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.133759  4681 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.155750  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:19.150660  2275 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:18.357827  4528 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:18.609309  4546 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.545s
W20260709 13:00:19.161304  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.002s	sys 0.013s
W20260709 13:00:19.164681  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.002s	sys 0.013s
I20260709 13:00:18.386776  4421 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:19.156625  4707 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.002s	sys 0.016s
I20260709 13:00:19.168558  1539 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
W20260709 13:00:19.169039  1540 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.005s	sys 0.012s
W20260709 13:00:19.169368  1540 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.005s	sys 0.012s
I20260709 13:00:18.385250  4659 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.149752  4534 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.170260  4655 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.166049  4377 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:00:19.185333  2271 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:19.206486  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 581) took 1277 ms. Trace:
I20260709 13:00:19.209434  1545 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:19.157742  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:19.157191  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:19.212494  1538 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:19.167273  4063 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.211355  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:19.172075  4702 log.cc:927] Time spent T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.837s	user 0.001s	sys 0.010s
W20260709 13:00:19.216185  1537 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.010s	sys 0.022s
W20260709 13:00:19.216477  1537 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.011s	sys 0.022s
W20260709 13:00:19.158037  4560 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.008s	sys 0.020s
I20260709 13:00:19.208868  1692 rpcz_store.cc:276] 0709 13:00:17.929125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.931511 (+  2386us) service_pool.cc:224] Handling call
0709 13:00:17.958266 (+ 26755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.023941 (+ 65675us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:18.023984 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.052097 (+ 28113us) log.cc:844] Serialized 26 byte log entry
0709 13:00:18.303885 (+251788us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:18.303920 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.303988 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.814823 (+510835us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:19.197477 (+382654us) raft_consensus.cc:1685] finished
0709 13:00:19.197503 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.206391 (+  8888us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21789,"raft.queue_time_us":22344,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":169313536,"thread_start_us":171836,"threads_started":1,"wal-append.queue_time_us":293397}
W20260709 13:00:19.217545  4674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.008s	sys 0.023s
I20260709 13:00:19.153122  4379 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.207029  4655 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:19.164212  4634 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:19.248566  4560 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.008s	sys 0.020s
I20260709 13:00:19.249431  4376 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.273222  1691 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:19.257443  1542 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:19.300200  1686 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
W20260709 13:00:19.258549  4674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.015s	sys 0.030s
I20260709 13:00:19.208012  4672 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 13:00:19.305596  1658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.009s
W20260709 13:00:19.306013  1658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.008s	sys 0.009s
W20260709 13:00:19.306193  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 89574.7us
W20260709 13:00:19.308149  4502 consensus_meta.cc:287] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.093s	user 0.011s	sys 0.000s
I20260709 13:00:19.302500  4717 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.303750  4290 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:19.299530  4705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.045s	sys 0.087s
I20260709 13:00:19.304775  4169 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:19.325407  4664 consensus_queue.cc:1059] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:19.326239  4664 raft_consensus.cc:3055] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:19.326553  4664 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:19.327418  4664 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.328634  4664 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:19.302153  4655 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:19.312567  4063 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:19.331805  4537 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.260s	user 0.012s	sys 0.000s
W20260709 13:00:19.332091  4705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.045s	sys 0.088s
I20260709 13:00:19.332883  4528 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.303146  4376 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:19.332806  4712 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:00:19.354617  4379 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:19.340771  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:19.345139  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 209377us
I20260709 13:00:19.323841  4502 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:19.357810  4659 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.360755  4655 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:19.361996  4706 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.029s	user 0.005s	sys 0.008s
I20260709 13:00:19.364372  4634 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:19.368582  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.343690  4717 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.369673  4634 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.370275  4634 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.371268  4717 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:19.371948  4473 consensus_meta.cc:287] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.989s	user 0.009s	sys 0.000s
I20260709 13:00:19.372356  4473 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:19.333025  4290 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:19.373961  1543 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:19.350798  4537 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:19.449291  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 71749.4us
I20260709 13:00:19.448128  4063 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:19.469900  4063 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.471731  4063 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:19.472733  4711 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:00:19.474646  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 863) took 1404 ms. Trace:
I20260709 13:00:19.376708  4634 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:19.375066  4721 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:19.448815  4717 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:19.512400  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.501788  4683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.138s	user 0.036s	sys 0.049s
I20260709 13:00:19.475042  2277 rpcz_store.cc:276] 0709 13:00:18.070447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.070621 (+   174us) service_pool.cc:224] Handling call
0709 13:00:18.078654 (+  8033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.079092 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:18.187296 (+108204us) log.cc:844] Serialized 14 byte log entry
0709 13:00:18.526814 (+339518us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.142095 (+615281us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.147278 (+  5183us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:19.147313 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.147370 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.472160 (+324790us) spinlock_profiling.cc:243] Waited 946 us on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:19.474140 (+  1980us) raft_consensus.cc:1685] finished
0709 13:00:19.474446 (+   306us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.474588 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72326,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":7534,"raft.queue_time_us":811,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":3871,"spinlock_wait_cycles":2175744,"thread_start_us":330730,"threads_started":2,"wal-append.queue_time_us":926995}
I20260709 13:00:19.517114  2241 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:19.568635  1511 leader_election.cc:336] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.590s (SENT)
W20260709 13:00:19.578799  1660 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.000s	sys 0.009s
W20260709 13:00:19.579310  1660 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.000s	sys 0.010s
W20260709 13:00:19.579754  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 801052us
I20260709 13:00:19.502338  4502 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.501569  4719 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:19.518579  4683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.036s	sys 0.049s
I20260709 13:00:19.599169  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1887) took 1313 ms. Trace:
I20260709 13:00:19.600147  1540 rpcz_store.cc:276] 0709 13:00:18.269370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.269496 (+   126us) service_pool.cc:224] Handling call
0709 13:00:18.305592 (+ 36096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.326841 (+ 21249us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:19.172353 (+845512us) log.cc:844] Serialized 14 byte log entry
0709 13:00:19.582789 (+410436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:19.582855 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:19.582924 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.583009 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.583140 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":859230,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":97,"thread_start_us":1178179,"threads_started":2}
W20260709 13:00:19.618824  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 262626us
W20260709 13:00:19.623797  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 407815us
W20260709 13:00:19.626477  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.575404  4379 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:19.516474  4634 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:00:19.628083  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1892) took 1165 ms. Trace:
W20260709 13:00:19.632344  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.579142  4725 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:19.634186  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.637154  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:19.633021  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 129145us
I20260709 13:00:19.527087  4717 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:19.641041  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:19.632383  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:19.641659  1691 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:19.599632  4719 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:19.639191  2241 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:19.639840  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:19.642840  1541 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:19.633708  1537 rpcz_store.cc:276] 0709 13:00:18.462286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.462464 (+   178us) service_pool.cc:224] Handling call
0709 13:00:18.468402 (+  5938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.498719 (+ 30317us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:19.216801 (+718082us) log.cc:844] Serialized 14 byte log entry
0709 13:00:19.627772 (+410971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:19.627818 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:19.627866 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.627927 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.628026 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29279,"prepare.queue_time_us":756410,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":1002726,"threads_started":2}
I20260709 13:00:19.643522  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:19.626597  4377 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:19.626824  4063 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:19.644521  1619 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:19.647957  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:19.650491  4720 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:00:19.652222  4660 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.654520  2271 raft_consensus.cc:1217] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 13:00:19.654989  2271 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:19.655921  2277 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:19.657166  2275 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:19.658787  2272 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:19.659968  2270 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:19.660741  4534 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:19.663019  4476 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:19.663106  4704 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.321s	user 0.009s	sys 0.021s
I20260709 13:00:19.664981  1612 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:19.665933  1690 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:19.666268  1690 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:19.668501  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 344) took 10657 ms. Trace:
I20260709 13:00:19.328293   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:19.645712  4725 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.644629  4719 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:19.645427  1617 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:19.682273  1617 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:19.690932  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 53072.8us
I20260709 13:00:19.709734  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:19.713716  2270 raft_consensus.cc:2393] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:19.713121  1617 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.720145  4717 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:19.701740  4528 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 13:00:19.722712  1511 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.543s (SENT)
I20260709 13:00:19.668979  1440 rpcz_store.cc:276] 0709 13:00:09.011191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.011623 (+   432us) service_pool.cc:224] Handling call
0709 13:00:19.668267 (+10656644us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:10.976846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:10.977349 (+   503us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:10.977394 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:00:10.977404 (+    10us) tablet.cc:662] Decoding operations
0709 13:00:11.394324 (+416920us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:11.396106 (+  1782us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:11.403438 (+  7332us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:00:12.042461 (+639023us) tablet.cc:701] Row locks acquired
0709 13:00:12.059956 (+ 17495us) write_op.cc:260] PREPARE: finished
0709 13:00:12.201391 (+141435us) write_op.cc:270] Start()
0709 13:00:12.316344 (+114953us) write_op.cc:276] Timestamp: P: 1783602012164709 usec, L: 0
0709 13:00:12.317701 (+  1357us) op_driver.cc:348] REPLICATION: starting
0709 13:00:12.480098 (+162397us) log.cc:844] Serialized 7141 byte log entry
0709 13:00:13.676895 (+1196797us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b1800024a60. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb8522 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:13.811380 (+134485us) op_driver.cc:464] REPLICATION: finished
0709 13:00:14.444835 (+633455us) write_op.cc:301] APPLY: starting
0709 13:00:14.445704 (+   869us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:14.478864 (+ 33160us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:14.478907 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:14.480850 (+  1943us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:14.481263 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:00:14.481310 (+    47us) write_op.cc:312] APPLY: finished
0709 13:00:14.481702 (+   392us) log.cc:844] Serialized 125 byte log entry
0709 13:00:14.481884 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:14.482049 (+   165us) write_op.cc:454] Released schema lock
0709 13:00:14.482117 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:14.540999 (+ 58882us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:14.541990 (+   991us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":610377,"apply.run_cpu_time_us":4374,"apply.run_wall_time_us":86138,"num_ops":18,"prepare.queue_time_us":170368,"prepare.run_cpu_time_us":27353,"prepare.run_wall_time_us":2568189,"raft.queue_time_us":131416,"raft.run_cpu_time_us":44310,"raft.run_wall_time_us":644395,"replication_time_us":1493504,"spinlock_wait_cycles":6428544,"thread_start_us":1816273,"threads_started":4,"wal-append.queue_time_us":1032050,"wal-append.run_cpu_time_us":33017,"wal-append.run_wall_time_us":1972070}]]}
I20260709 13:00:19.726919  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:19.728438  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:19.733798  1615 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:19.729117  1511 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.609s (SENT)
I20260709 13:00:19.680140  4736 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:00:19.679937  4672 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:19.679052  1690 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.713078  4063 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.731120  4683 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:19.713227  4377 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:19.736603  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:19.675283  4537 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:19.737147  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.066s	sys 0.118s
I20260709 13:00:19.735360  2243 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:19.751971  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.067s	sys 0.119s
W20260709 13:00:19.752264  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 1.25777e+06us
I20260709 13:00:19.674829  4725 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:19.672700  4473 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.698417  4634 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.750298  1617 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:19.711972  4534 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.751412  1616 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
W20260709 13:00:19.778728  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 49650.2us
I20260709 13:00:19.779052  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:19.759119  2272 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.784142  1690 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.672809  4379 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.736737  4672 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.805117  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:19.805899  1544 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:19.807953  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:19.809852  2270 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:19.813726  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 61285.8us
I20260709 13:00:19.815034  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:19.815678  2277 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:19.817711  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:19.820232  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:19.774624  4731 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:19.820761  1540 raft_consensus.cc:2376] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6. Re-sending same reply.
W20260709 13:00:19.823017  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 71999.1us
I20260709 13:00:19.793258  4721 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:19.828368  4721 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.828747  4721 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.827808  1439 catalog_manager.cc:5697] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.830041  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:19.810720  4672 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.831013  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:19.783492  4668 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.780639  4707 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.835038  1693 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:19.842761  2276 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:19.830120  1439 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 7 to 8, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.843884  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:19.843904  1617 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:19.844034  1439 catalog_manager.cc:5697] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 5 to 9, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:00:19.846130  1439 catalog_manager.cc:5697] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:00:19.859716  4063 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:19.860359  4063 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:19.860706  4063 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.861049  4063 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:19.863471  4743 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.864001  4743 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.866210  4747 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.866525  4377 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.866904  4747 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:19.780480  4634 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.825358  4731 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:19.885390  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.869841  1439 catalog_manager.cc:5697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.867957  2271 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEARNER]: Advancing to term 5
I20260709 13:00:19.825433  4725 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.799019  4534 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.897441  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:19.868817  4717 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:19.911614  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 61227.8us
W20260709 13:00:19.889962  4664 consensus_meta.cc:287] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.561s	user 0.003s	sys 0.009s
I20260709 13:00:19.913152  1619 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
W20260709 13:00:19.913831  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 134428us
I20260709 13:00:19.913915  1509 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:19.912009  1439 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 9, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.889047  4376 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:19.921419  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:19.889173  4290 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.952917  2276 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:19.889333  4747 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.953222  1439 catalog_manager.cc:5697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:19.956472  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:19.961588  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 140040us
W20260709 13:00:19.962782  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 48937.1us
I20260709 13:00:19.963474  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:19.967481  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 99978us
I20260709 13:00:19.919595  4717 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:19.848433  4668 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.971837  1509 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:19.978536  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.972975  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 142968us
I20260709 13:00:19.982470  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:19.983251  2272 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:19.911540  4725 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:19.995165  1611 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.040s	sys 0.060s
I20260709 13:00:19.971705  4376 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:00:19.964003  4660 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.867851  4707 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:19.995539  1658 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:20.035928  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.022604  1615 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:20.038458  2276 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEARNER]: Advancing to term 5
I20260709 13:00:19.919442  4746 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.963184  4747 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.023747  2277 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:20.022136  1693 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:00:19.997330  4725 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:19.974086  4290 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:19.976481  4717 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:20.105479  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.968694  4476 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:00:20.107437  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.048838  4707 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:20.044960  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 49476.1us
W20260709 13:00:20.049022  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 248065us
I20260709 13:00:20.050702  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:20.051723  2269 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:20.045858  1611 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.040s	sys 0.065s
W20260709 13:00:20.000931  1585 connection.cc:256] RPC call timeout handler was delayed by -1.355734434999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:00:20.110842  1585 connection.cc:256] RPC call timeout handler was delayed by -1.1049091429999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 13:00:20.066707  1690 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:19.866290  4728 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.045861  4537 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:20.075496  4534 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:20.083349  4634 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:20.074947  4379 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:20.081753  2275 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:19.967530  4737 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:00:19.955431  4726 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 13:00:20.088289  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:20.078723  4746 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:20.079622  4731 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 13:00:19.995666  4730 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:00:20.035928  4683 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.975471  4724 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:19.994942  4734 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.238s
I20260709 13:00:20.083366  4421 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:19.996292  4733 log.cc:927] Time spent T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:00:19.985113  4560 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:20.103276  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.156426  1615 raft_consensus.cc:2410] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:20.102726  2271 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:20.084092  4743 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:20.117017  1617 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:20.119050  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:19.972520  4719 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.163815  2273 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:20.135092  2243 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:20.139945  2277 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:20.144881  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:20.145161  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 327497us
I20260709 13:00:20.033447  4748 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:00:20.120154  4725 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:00:20.140048  4290 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:20.094805  4660 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:20.165127  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.196939  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 130028us
I20260709 13:00:20.168081  2272 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:20.195632  2243 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:20.115024  4502 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:00:20.184887  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.132958  4747 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:20.134382  4537 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:20.314915  1511 leader_election.cc:336] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.920s (SENT)
I20260709 13:00:20.147049  4754 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:20.141206  4534 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:00:20.153682  4724 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:20.306773  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 323839us
W20260709 13:00:20.218924  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 103744us
I20260709 13:00:20.163216  4664 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.166972  4421 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:20.163741  4634 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:20.311679  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.312304  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 143057us
I20260709 13:00:20.162935  4560 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.315421  1511 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:20.317502  4528 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:20.346643  2243 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:20.347417  1617 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:20.348182  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:20.196084  4758 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:00:20.268532  4743 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:20.120995  4728 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:20.315733  2241 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:20.343427  4731 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.348990  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:20.349221  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 202620us
I20260709 13:00:20.254109  4721 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.363620  4721 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:20.362223  4734 consensus_queue.cc:1059] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:00:20.154697  4683 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.327023  4421 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:20.394941  4421 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.304901  4063 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.378005  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:20.376251  4726 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.400918  4379 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:20.380648  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.335395  4560 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.439425  4749 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:00:20.478256  4749 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:20.468384  4721 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:20.479133  1618 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:20.465161  4743 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:20.480123  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.480453  4743 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.481215  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.481515  4502 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:00:20.482393  4502 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:20.482898  4502 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:20.483781  4502 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.484933  4502 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.474898  4379 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:20.485896  4379 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.386363  4683 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:20.387041  4668 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:20.387918  4537 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:20.389664  4755 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:00:20.323500  4754 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:20.488639  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.489658  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.489820  4754 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:20.398898  4672 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
I20260709 13:00:20.442799  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:20.380120  4759 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:20.490659  4672 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.373343  4736 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:20.355712  4737 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:20.399698  4290 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:20.396111  4724 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.329792  4376 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:00:20.491626  4736 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:20.468393  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 91126.2us
W20260709 13:00:20.469810  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 95638.9us
W20260709 13:00:20.469866  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 154233us
W20260709 13:00:20.380086  4763 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:20.471252  1585 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:20.349992  4528 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.490367  1612 raft_consensus.cc:2410] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:20.482425  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:20.482331  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:20.499954  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 245541us
I20260709 13:00:20.469064  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 597) took 2144 ms. Trace:
W20260709 13:00:20.502944  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.506556  1510 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:20.508821  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:20.447724  4758 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:00:20.509135  1617 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:20.519853  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.509420  1618 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:20.633915  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:20.656106  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 147335us
W20260709 13:00:20.664516  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.655478  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.502789  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 171224us
W20260709 13:00:20.619127  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 290276us
I20260709 13:00:20.508486  4747 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:20.527580  1584 leader_election.cc:400] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:00:20.656358  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:20.527966  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 68578.2us
W20260709 13:00:20.600471  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 239004us
W20260709 13:00:20.661815  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 155321us
I20260709 13:00:20.742805  2241 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:20.776217  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.779511  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:20.779830  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:20.782199  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.508615  4736 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:20.801748  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 59085.2us
I20260709 13:00:20.781096  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:20.810441  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:20.811653  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 643) took 1008 ms. Trace:
I20260709 13:00:20.654639  1611 rpcz_store.cc:276] 0709 13:00:18.324673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.324827 (+   154us) service_pool.cc:224] Handling call
0709 13:00:19.121781 (+796954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.121972 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:20.109771 (+987799us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.452591 (+342820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.468734 (+ 16143us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:20.468797 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.468885 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.469006 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1356,"prepare.queue_time_us":652453,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":11551,"raft.queue_time_us":49910,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":15106,"thread_start_us":1308543,"threads_started":3,"wal-append.queue_time_us":398810}
W20260709 13:00:20.559836  4768 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:00:20.509155  4719 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:20.561295  4754 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:20.527375  4528 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.828159  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.828888  1618 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:20.823185  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:20.823664  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.812188  1542 rpcz_store.cc:276] 0709 13:00:19.803500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.803636 (+   136us) service_pool.cc:224] Handling call
0709 13:00:19.804053 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:20.078752 (+274699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.078784 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:20.079321 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 13:00:20.123601 (+ 44280us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:20.442635 (+319034us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.475176 (+ 32541us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.500746 (+ 25570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.663659 (+162913us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400282654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:20.663727 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.811364 (+147637us) raft_consensus.cc:1685] finished
0709 13:00:20.811398 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.811584 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32650,"prepare.queue_time_us":187408,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":61173,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":4550,"spinlock_wait_cycles":540510976,"thread_start_us":341856,"threads_started":2,"wal-append.queue_time_us":98494}
I20260709 13:00:20.825081  1509 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:20.823974  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:20.530561  4721 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.494594  4717 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:20.505879  4737 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:20.662621  4683 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.664371  4660 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:20.833312  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.563982  4728 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:20.834722  1511 leader_election.cc:336] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 3.023s (SENT)
W20260709 13:00:20.839167  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 58143.1us
I20260709 13:00:20.898378  1511 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:20.823173  4672 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:20.837456  4476 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.774883  4727 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:20.859450  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.829734  1620 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:00:20.659472  4376 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
I20260709 13:00:20.820107  4674 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:20.801095  4537 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:20.911597  1612 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:20.567056  4746 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:20.964781  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:20.968611  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 69430us
W20260709 13:00:20.971022  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 160498us
I20260709 13:00:20.918622  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:20.910532  1617 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:20.921732  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:20.922820  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 163968us
I20260709 13:00:20.973065  1611 raft_consensus.cc:2410] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:20.973388  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:20.973960  1690 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.978657  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:20.972102  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:20.939819  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 160040us
I20260709 13:00:20.854974  4655 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.876950  4754 raft_consensus.cc:697] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:20.972330  1618 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.980410  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:20.979274  1620 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
W20260709 13:00:20.983891  2276 consensus_meta.cc:287] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.934s	user 0.015s	sys 0.003s
I20260709 13:00:20.943346  4727 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.956960  4726 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.855463  4721 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.969300  4672 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:21.024155  2276 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:20.992468  4786 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:21.011317  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.011528  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:20.993184  4655 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:20.957229  4476 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.011952  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:20.923060  4719 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:20.993299  1693 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:21.043370  1692 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:21.002641  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 178531us
I20260709 13:00:21.024837  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 873) took 1182 ms. Trace:
I20260709 13:00:21.025545  1620 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:21.024951  1689 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:21.039178  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:21.041501  1690 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
W20260709 13:00:21.051438  4756 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:00:21.063720  4674 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:21.064308  4379 consensus_meta.cc:287] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.000s
I20260709 13:00:21.064807  4379 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.065141  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 868) took 1224 ms. Trace:
I20260709 13:00:21.065569  2268 rpcz_store.cc:276] 0709 13:00:19.841067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.841181 (+   114us) service_pool.cc:224] Handling call
0709 13:00:19.841493 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.841793 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.841826 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.842286 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.117700 (+275414us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:20.117732 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.117787 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.064949 (+947162us) raft_consensus.cc:1685] finished
0709 13:00:21.064964 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.065090 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21205,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":274024,"threads_started":1,"wal-append.queue_time_us":660171}
I20260709 13:00:21.024628  4753 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:21.066820  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 55363.8us
I20260709 13:00:21.035095  4786 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.067461  4786 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.068408  4726 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:21.051749  4768 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:21.070339  4655 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:21.070895  4655 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.071733  1620 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 13:00:21.071884  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 101478us
I20260709 13:00:21.072613  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 646) took 1260 ms. Trace:
I20260709 13:00:21.044719  2276 rpcz_store.cc:276] 0709 13:00:19.842758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.973077 (+130319us) service_pool.cc:224] Handling call
0709 13:00:20.005708 (+ 32631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.024585 (+1018877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.024785 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:21.070832  1611 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:21.082850  4655 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.063717  4737 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.084961  4655 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:21.072074  1620 pending_rounds.cc:85] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 5
I20260709 13:00:21.085646  1620 pending_rounds.cc:107] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:21.085878  1620 raft_consensus.cc:2889] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:21.072965  1545 rpcz_store.cc:276] 0709 13:00:19.811830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.825688 (+ 13858us) service_pool.cc:224] Handling call
0709 13:00:19.848091 (+ 22403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:19.961499 (+113408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.961544 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:20.051316 (+ 89772us) log.cc:844] Serialized 52 byte log entry
0709 13:00:20.323499 (+272183us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:20.333066 (+  9567us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.333637 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.333780 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.072421 (+738641us) raft_consensus.cc:1685] finished
0709 13:00:21.072442 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.072560 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84124,"prepare.queue_time_us":8865,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":94394,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":5080,"thread_start_us":175538,"threads_started":1,"wal-append.queue_time_us":290859}
I20260709 13:00:21.087577  2273 raft_consensus.cc:2410] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:21.089067  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:21.081210  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 573367us
I20260709 13:00:21.020969  4727 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.983134  4537 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:21.093048  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 92152.9us
W20260709 13:00:21.119033  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 46434.9us
I20260709 13:00:21.120080  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:21.161247  1620 raft_consensus.cc:3055] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:21.161684  1620 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:21.162412  1620 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:21.167727  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 46847.7us
I20260709 13:00:21.168671  2241 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:21.086654  4719 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:21.180225  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.187703  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:21.187902  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:21.188822  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:21.119134  4379 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:21.189651  1620 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:21.175139  4764 log.cc:927] Time spent T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.680s	user 0.001s	sys 0.000s
I20260709 13:00:21.174167  4674 raft_consensus.cc:2764] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:21.068889  4726 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:21.092968  4376 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:00:21.197702  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:21.197801  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:21.198475  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:21.177701  4734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.002s	sys 0.007s
I20260709 13:00:21.226432  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:21.227484  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:21.175465  4063 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:21.226468  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 371980us
I20260709 13:00:21.104336  2277 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:21.200858  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:21.199242  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 131058us
I20260709 13:00:21.195327  2276 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:21.191113  4560 consensus_meta.cc:287] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.714s	user 0.006s	sys 0.009s
I20260709 13:00:21.258600  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:21.259348  1540 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.180146  4672 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:00:21.224659  4734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.002s	sys 0.007s
I20260709 13:00:21.283061  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:21.283803  1538 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:21.280094  1540 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:21.281014  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:21.286482  1544 raft_consensus.cc:2376] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7. Re-sending same reply.
I20260709 13:00:21.288558  1542 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:21.281328  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:21.293354  1541 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
W20260709 13:00:21.300792  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 134034us
I20260709 13:00:21.236601  4534 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:21.305433  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:21.312059  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 611) took 1209 ms. Trace:
I20260709 13:00:21.312537  1619 rpcz_store.cc:276] 0709 13:00:20.102420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.103201 (+   781us) service_pool.cc:224] Handling call
0709 13:00:20.103556 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.103952 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.103988 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.104507 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.144566 (+ 40059us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:20.144596 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.144661 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.311826 (+1167165us) raft_consensus.cc:1685] finished
0709 13:00:21.311848 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.311994 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127412,"raft.queue_time_us":43088,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":14930,"thread_start_us":39725,"threads_started":1,"wal-append.queue_time_us":230520}
I20260709 13:00:21.315783  1659 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:21.315232  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:21.319765  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:21.319926  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:21.372947  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 145506us
I20260709 13:00:21.302937  4655 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.314725  4717 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:21.229158  4754 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.284552  4560 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:21.391697  1620 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 13:00:21.400544  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 206052us
I20260709 13:00:21.397683  1620 pending_rounds.cc:85] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 5
I20260709 13:00:21.403534  1620 pending_rounds.cc:107] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:21.403851  1620 raft_consensus.cc:2889] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:21.405874  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:21.406036  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.325977  4719 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:21.409924  4792 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.410403  4792 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.410356  4791 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:00:21.410930  4792 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.421680  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1942) took 1028 ms. Trace:
I20260709 13:00:21.422194  1620 rpcz_store.cc:276] 0709 13:00:20.392940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.160832 (+767892us) service_pool.cc:224] Handling call
0709 13:00:21.161142 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.421162 (+260020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.421532 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:21.426843  1618 raft_consensus.cc:2410] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:00:21.430770  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 114892us
I20260709 13:00:21.432209  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:21.433554  1659 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:21.329568  4737 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:00:21.463980  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.383606  4655 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.297834  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:00:21.473968  1545 raft_consensus.cc:606] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:21.474287  1545 raft_consensus.cc:614] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:21.399004  4721 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:21.476677  4734 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:21.477147  4734 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:21.477535  4734 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.479877  4799 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:21.480237  4799 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:21.480540  4799 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.480564  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1924) took 1317 ms. Trace:
I20260709 13:00:21.480993  1616 rpcz_store.cc:276] 0709 13:00:20.163106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.170227 (+  7121us) service_pool.cc:224] Handling call
0709 13:00:20.303762 (+133535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.311404 (+  7642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.311433 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.315951 (+  4518us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.501557 (+185606us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:20.775740 (+274183us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b480024c258. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f0cceaa1 00007f29f0cc5b37 00007f29f0cc59ca 00007f29f0dbd26f 00007f29f0dbcf37 00007f29f0dd155c 00007f29f0dd1508 00007f29f0dd1488 00007f29f0dd1443 00007f29f0dd06ec 00007f29efcfaa96
0709 13:00:20.820176 (+ 44436us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.866380 (+ 46204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.866451 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.480315 (+613864us) raft_consensus.cc:1685] finished
0709 13:00:21.480400 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.480513 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107799,"prepare.queue_time_us":824849,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2164,"raft.queue_time_us":130458,"raft.run_cpu_time_us":3460,"raft.run_wall_time_us":416900,"spinlock_wait_cycles":93868544,"thread_start_us":456097,"threads_started":2,"wal-append.queue_time_us":1144219}
I20260709 13:00:21.484404  1692 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:21.492691  4791 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.493284  4791 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:21.498973  4801 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.499471  4801 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.501492  4801 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:21.510236  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.510833  1694 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:21.511047  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.512236  1686 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:21.513339  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.514281  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:21.515256  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.515699  4791 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:21.516207  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.517174  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.396191  4769 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:21.458374  4672 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:21.527071  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:21.527315  1509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.015s	sys 0.010s
W20260709 13:00:21.528633  1509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.015s	sys 0.010s
I20260709 13:00:21.528645  1686 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:21.512282  1694 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:21.529948  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 704796us
I20260709 13:00:21.477151  4537 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:21.540608  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.522869  4476 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:21.540583  1509 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:21.554262  4421 consensus_meta.cc:287] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 1.152s	user 0.008s	sys 0.002s
I20260709 13:00:21.533443  4769 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:21.553095  4672 raft_consensus.cc:697] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:21.540132  4787 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:21.540098  4798 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:00:21.580801  4681 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:21.552464  4737 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:00:21.613148  4655 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:21.608726  4769 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:21.614060  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:21.618741  2277 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:21.615100  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:21.614791  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:21.553598  4792 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.619668  2268 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:21.622493  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:21.598198  4376 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:21.588140  4421 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:21.605041  4726 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:21.622193  4737 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:21.623162  2276 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.617765  4717 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:21.617868  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 77369.7us
I20260709 13:00:21.673662  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:21.676440  4726 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:21.671684  4737 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:21.691092  1511 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.655s (SENT)
I20260709 13:00:21.682235  1510 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:21.695511  1659 leader_election.cc:336] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.599s (SENT)
W20260709 13:00:21.700999  1659 leader_election.cc:336] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.768s (SENT)
I20260709 13:00:21.695528  2276 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:21.698304  1509 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:21.701812  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:21.693835  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 311456us
I20260709 13:00:21.621858  4681 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:21.704028  1659 leader_election.cc:336] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.770s (SENT)
I20260709 13:00:21.705399  1510 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:21.680752  4808 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:21.709632  4290 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:21.722628  4476 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.723160  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:21.723320  4560 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:21.749280  4502 consensus_meta.cc:287] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.250s	user 0.009s	sys 0.001s
W20260709 13:00:21.724920  4766 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.949s	user 0.001s	sys 0.001s
W20260709 13:00:21.750067  4812 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:00:21.711436  1659 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:21.706334  4797 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:21.696427  4726 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:21.702721  4737 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:21.706836  4537 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:21.739078  4476 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:21.706815  4731 consensus_meta.cc:287] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.345s	user 0.013s	sys 0.000s
I20260709 13:00:21.754686  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.754813  4421 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:21.757644  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 861088us
W20260709 13:00:21.741147  4806 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:00:21.711503  4808 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:21.779587  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 69166.8us
W20260709 13:00:21.780112  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 659198us
I20260709 13:00:21.678388  4672 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.794759  1614 raft_consensus.cc:2410] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:00:21.795042  1511 leader_election.cc:336] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.753s (SENT)
I20260709 13:00:21.800096  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:21.795271  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:21.797371  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.756886  4725 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 13:00:21.804881  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 99563.6us
I20260709 13:00:21.805541  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1925) took 1624 ms. Trace:
I20260709 13:00:21.758477  4290 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:21.783022  4476 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:21.799578  4736 consensus_meta.cc:287] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.000s
W20260709 13:00:21.910707  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 104932us
I20260709 13:00:21.911494  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:21.805860  1615 rpcz_store.cc:276] 0709 13:00:20.180983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.268135 (+ 87152us) service_pool.cc:224] Handling call
0709 13:00:20.317494 (+ 49359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:20.471038 (+153544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.471072 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:20.497365 (+ 26293us) log.cc:844] Serialized 52 byte log entry
0709 13:00:20.824196 (+326831us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:21.192061 (+367865us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.805122 (+613061us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.805282 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.805346 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.805379 (+    33us) raft_consensus.cc:1685] finished
0709 13:00:21.805388 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.805498 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605782,"prepare.queue_time_us":560228,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":3390,"raft.queue_time_us":64545,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":590764,"threads_started":3,"wal-append.queue_time_us":990574}
I20260709 13:00:21.809481  1585 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:21.834028  4421 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.918975  4421 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.919010  4726 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.921228  4421 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:21.839908  4792 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:21.840519  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:21.796170  4537 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:21.922143  1616 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.922591  4537 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.913584  4736 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.925633  4734 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:21.926815  4736 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:21.927356  4818 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:00:21.914932  4290 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:21.922078  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:21.794549  4808 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:21.914494  1511 leader_election.cc:336] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.867s (SENT)
I20260709 13:00:21.949465  1616 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
W20260709 13:00:21.909220  4727 consensus_meta.cc:287] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.000s
I20260709 13:00:21.829618  4795 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:21.950306  2243 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.585s (SENT) [suppressed 45 similar messages]
W20260709 13:00:21.959235  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 124253us
I20260709 13:00:21.808236  4769 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 13:00:21.968377  1545 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:21.984411  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:21.968689  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:21.959550  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:22.022351  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 46062us
I20260709 13:00:22.022796  1538 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
W20260709 13:00:21.975390  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 170735us
W20260709 13:00:22.019788  4805 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:00:22.019961  4807 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:00:22.020223  4816 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:00:21.984018  4725 raft_consensus.cc:2764] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:22.040724  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:21.950942  4655 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:21.994488  4786 consensus_meta.cc:287] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.927s	user 0.000s	sys 0.010s
I20260709 13:00:22.051393  1585 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:21.983952  4747 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:00:22.056334  1585 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:22.020119  4774 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:00:21.952656  4799 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.037360  4820 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.210876  4747 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:22.162748  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:22.107930  4725 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:22.213394  2276 raft_consensus.cc:2410] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:22.213680  4725 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:22.214295  4725 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.053120  4728 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.162s
I20260709 13:00:22.214844  1687 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:22.063867  4655 raft_consensus.cc:697] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:22.215857  4838 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:00:22.216580  4655 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:22.217073  4826 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
W20260709 13:00:22.217232  4823 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:00:22.065068  4786 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:00:22.103799  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 67628.5us
I20260709 13:00:22.218344  4813 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:00:22.065028  4731 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:22.218988  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:22.219403  4731 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:22.123037  4830 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.220069  1584 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:22.104465  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 877) took 1326 ms. Trace:
I20260709 13:00:22.203131  1686 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:22.211818  4822 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:00:22.116613  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 386622us
I20260709 13:00:22.145334  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:22.125022  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:22.220080  1689 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:22.168694  2268 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEARNER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:22.221583  2274 rpcz_store.cc:276] 0709 13:00:20.777994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.778126 (+   132us) service_pool.cc:224] Handling call
0709 13:00:20.823317 (+ 45191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.216729 (+393412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.216761 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.274234 (+ 57473us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.536367 (+262133us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:21.536406 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.536478 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.099056 (+562578us) raft_consensus.cc:1685] finished
0709 13:00:22.099082 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.104409 (+  5327us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146487,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":9242,"thread_start_us":638495,"threads_started":2,"wal-append.queue_time_us":321114}
I20260709 13:00:21.957814  4727 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:22.256243  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 111008us
W20260709 13:00:22.149253  4827 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:00:22.259562  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1935) took 1868 ms. Trace:
I20260709 13:00:22.262754  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:22.220580  4830 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.265817  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:22.271392  1620 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:22.097057  4746 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:22.269934  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:22.266374  1611 rpcz_store.cc:276] 0709 13:00:20.390921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.075153 (+684232us) service_pool.cc:224] Handling call
0709 13:00:21.112886 (+ 37733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.170499 (+ 57613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.170526 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.190035 (+ 19509us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.386553 (+196518us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:21.406186 (+ 19633us) log.cc:844] Serialized 14 byte log entry
0709 13:00:22.259296 (+853110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.259359 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.259396 (+    37us) raft_consensus.cc:1685] finished
0709 13:00:22.259407 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.259509 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":552979,"prepare.queue_time_us":27096,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5414,"raft.queue_time_us":538311,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4905,"thread_start_us":489015,"threads_started":2,"wal-append.queue_time_us":324558}
I20260709 13:00:22.110797  4734 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:22.276157  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:22.277436  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:22.278584  1539 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:22.281255  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:22.283319  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:22.284049  1615 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:22.065300  4748 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.211s
I20260709 13:00:22.267439  4769 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:22.289081  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:22.297904  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.275683  4746 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.122886  4781 consensus_queue.cc:1059] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:00:22.220042  4731 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.350031  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:22.375628  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:22.376036  1616 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.290725  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:22.282956  4736 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:22.346730  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 76911.1us
W20260709 13:00:22.376642  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 86000.2us
I20260709 13:00:22.289376  4681 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:22.384400  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:22.386063  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:22.368979  4528 consensus_meta.cc:287] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.483s	user 0.012s	sys 0.012s
I20260709 13:00:22.369225  4746 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.383836  4734 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:22.384094  4674 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:22.396623  4743 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.390321  4421 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:00:22.423007  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 201996us
I20260709 13:00:22.410812  4734 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.421496  4774 raft_consensus.cc:3055] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:22.396817  4736 consensus_queue.cc:1059] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:00:22.412106  4769 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.417591  4781 consensus_queue.cc:1243] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:22.396381  4528 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.414974  4792 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:22.393352  4797 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:00:22.416877  4674 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.427335  4774 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:22.431749  4724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.564s	user 0.011s	sys 0.012s
W20260709 13:00:22.468786  4724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.631s	user 0.011s	sys 0.012s
I20260709 13:00:22.469254  4830 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:22.470250  4846 raft_consensus.cc:2764] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:22.428097  4734 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.403929  4767 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:00:22.476521  2269 raft_consensus.cc:2393] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:22.480427  1616 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:22.440625  4786 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:22.440809  4781 raft_consensus.cc:3055] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:22.433508  4769 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.488759  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:22.481985  4846 consensus_queue.cc:1059] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:00:22.491830  4808 consensus_meta.cc:287] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.534s	user 0.002s	sys 0.007s
I20260709 13:00:22.485136  4781 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:22.487701  4727 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:22.504575  4769 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:22.510126  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 122306us
W20260709 13:00:22.510996  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 125016us
I20260709 13:00:22.511929  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:22.512262  4855 consensus_queue.cc:1059] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:22.512991  4855 consensus_queue.cc:1243] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:22.514545  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:22.516697  1691 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:22.518520  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2366) took 1055 ms. Trace:
I20260709 13:00:22.518905  1691 rpcz_store.cc:276] 0709 13:00:21.463592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.463712 (+   120us) service_pool.cc:224] Handling call
0709 13:00:22.518344 (+1054632us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400304654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:22.518441 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2418889088}
I20260709 13:00:22.491905  4799 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:22.496995  4845 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.527148  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:22.527350  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:22.527362  2274 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:22.528661  2276 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:22.539759  1660 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.592s (SENT)
I20260709 13:00:22.540444  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:22.541731  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:22.519332  4731 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:22.544479  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 73671.3us
I20260709 13:00:22.545966  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:22.507491  4808 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.550169  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:22.550866  1690 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:22.550944  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:22.551584  1545 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.548575  4674 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:22.555847  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:22.556573  1538 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.542030  4799 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.547693  4781 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.499850  4774 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.567130  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:22.545259  4797 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:22.553587  4528 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:22.552371  4845 raft_consensus.cc:3055] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:22.589799  4845 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:22.590727  4845 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:22.592108  4780 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 1.716s	user 0.005s	sys 0.000s
I20260709 13:00:22.592321  4845 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.575616  1545 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
W20260709 13:00:22.588367  4737 consensus_meta.cc:287] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.805s	user 0.006s	sys 0.005s
I20260709 13:00:22.599527  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:22.625578  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:22.626412  1693 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
W20260709 13:00:22.597497  4476 consensus_meta.cc:287] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.002s
I20260709 13:00:22.599015  4864 raft_consensus.cc:3055] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:22.642247  4831 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:00:22.699879  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 149820us
I20260709 13:00:22.625137  4774 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.624290  4731 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.700735  1538 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:22.709635  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:22.596992  4737 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:22.689168  4864 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:22.883836  4864 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:22.677886  4476 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:22.896931  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 187363us
I20260709 13:00:22.897949  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:22.844609  4725 consensus_meta.cc:287] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.004s
I20260709 13:00:22.900259  4725 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:22.904102  4860 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:22.863436  4862 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:00:22.875111  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2361) took 1670 ms. Trace:
I20260709 13:00:22.702291  4858 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.890399  4476 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:22.848153  4781 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.943332  1688 rpcz_store.cc:276] 0709 13:00:21.204686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.204883 (+   197us) service_pool.cc:224] Handling call
0709 13:00:21.236075 (+ 31192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.615918 (+379843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.616463 (+   545us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.620218 (+  3755us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.780505 (+160287us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:21.958650 (+178145us) log.cc:844] Serialized 14 byte log entry
0709 13:00:22.021137 (+ 62487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.021423 (+   286us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.569430 (+548007us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18003690a0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:22.848725 (+279295us) raft_consensus.cc:1685] finished
0709 13:00:22.874801 (+ 26076us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.875025 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7763,"prepare.queue_time_us":249328,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":2280,"raft.queue_time_us":38883,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":7041,"spinlock_wait_cycles":7208192,"thread_start_us":590399,"threads_started":3,"wal-append.queue_time_us":363536}
I20260709 13:00:23.064531  4725 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:23.213191  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:23.119836  4863 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:23.244707  4746 consensus_meta.cc:287] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.837s	user 0.007s	sys 0.003s
W20260709 13:00:23.290597  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 392696us
I20260709 13:00:23.292153  1584 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:23.303149  4737 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:23.305703  4731 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:23.305857  4757 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:00:23.307633  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.087s	sys 0.165s
W20260709 13:00:23.308351  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.087s	sys 0.166s
I20260709 13:00:23.299129  4668 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:23.315796  4668 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:23.318262  4668 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:23.263650  4746 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:23.319165  4869 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:00:23.301167  4860 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:23.323640  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:23.324815  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:23.327715  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.328406  1620 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
W20260709 13:00:23.330128  1659 connection.cc:256] RPC call timeout handler was delayed by -1.0207457690000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3264s for a response
I20260709 13:00:23.308444  4725 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.299436  4863 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:00:23.337569  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.338153  1620 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 4: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:23.310582  4731 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:23.340742  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:00:23.343009  1545 raft_consensus.cc:606] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:23.343333  1545 raft_consensus.cc:614] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:23.343122  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:23.352393  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3800218079999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260709 13:00:23.355264  1511 leader_election.cc:336] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.964s (SENT)
I20260709 13:00:23.355707  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:23.349013  4839 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.134s	user 0.010s	sys 0.000s
W20260709 13:00:23.360844  1511 leader_election.cc:336] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.000s (SENT)
W20260709 13:00:23.353473  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.052s	sys 0.110s
W20260709 13:00:23.361434  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.052s	sys 0.110s
I20260709 13:00:23.361339  1511 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:23.363440  1511 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.000s (SENT)
I20260709 13:00:23.334589  4725 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:23.362774  4707 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:23.364003  4737 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:23.397421  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 596) took 1884 ms (client timeout 2055 ms). Trace:
W20260709 13:00:23.397863  1687 rpcz_store.cc:269] 0709 13:00:21.513336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.516973 (+  3637us) service_pool.cc:224] Handling call
0709 13:00:23.397269 (+1880296us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b5400124b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:23.397365 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603116416}
I20260709 13:00:23.399130  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 915) took 2212 ms. Trace:
I20260709 13:00:23.399510  2269 rpcz_store.cc:276] 0709 13:00:21.186691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.186814 (+   123us) service_pool.cc:224] Handling call
0709 13:00:23.398935 (+2212121us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54005cf3d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:23.399060 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2837070208}
W20260709 13:00:23.399881  4845 consensus_meta.cc:287] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.807s	user 0.006s	sys 0.003s
I20260709 13:00:23.401675  4858 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.402112  4858 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:23.403668  4734 consensus_meta.cc:287] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.923s	user 0.009s	sys 0.001s
W20260709 13:00:23.403666  4847 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.978s	user 0.000s	sys 0.010s
W20260709 13:00:23.419785  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 124440us
I20260709 13:00:23.407706  4734 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:23.421402  4746 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:23.422710  4858 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:23.457726  2273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45390 (request call id 881) took 2678 ms (client timeout 3011 ms). Trace:
W20260709 13:00:23.458191  2273 rpcz_store.cc:269] 0709 13:00:20.779210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.779301 (+    91us) service_pool.cc:224] Handling call
0709 13:00:23.455169 (+2675868us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54004a5e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:23.457660 (+  2491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690412928}
I20260709 13:00:23.456341  4787 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:23.457244  4771 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:23.475067  4774 consensus_meta.cc:287] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.764s	user 0.006s	sys 0.005s
I20260709 13:00:23.461596  4731 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:23.483778  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 62752.4us
I20260709 13:00:23.480121  4787 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:23.487319  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 121491us
W20260709 13:00:23.488099  1511 connection.cc:256] RPC call timeout handler was delayed by -1.1059161789999621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2544s for a response
I20260709 13:00:23.488801  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1922) took 3336 ms. Trace:
I20260709 13:00:23.481756  4771 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:23.489391  1613 rpcz_store.cc:276] 0709 13:00:20.120750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.166348 (+ 45598us) service_pool.cc:224] Handling call
0709 13:00:20.195239 (+ 28891us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.195496 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.195522 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.195985 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.469546 (+273561us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:22.591746 (+2122200us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b24000f86a8. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8b3e9c4 00007f29e8b3cacb 00007f29e8cf7dc9 00007f29e8cf7a55 00007f29e8cf709d 00007f29eb92910e 00007f29eb94088c 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221
0709 13:00:23.456241 (+864495us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b180037ca20. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ef79d3c7 00007f29ebdaf9a7 00007f29ebdbf0bf
0709 13:00:23.456412 (+   171us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.456649 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.456762 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:23.456820 (+    58us) raft_consensus.cc:1685] finished
0709 13:00:23.456837 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.456994 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":797790,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":983,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10140,"spinlock_wait_cycles":101247104,"thread_start_us":435684,"threads_started":2,"wal-append.queue_time_us":462990}
I20260709 13:00:23.496992  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.498201  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.508267  1613 raft_consensus.cc:2376] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7. Re-sending same reply.
I20260709 13:00:23.524722  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.525497  1613 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:23.526396  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.526750  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1955) took 1263 ms. Trace:
I20260709 13:00:23.527140  1613 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:23.527184  1616 rpcz_store.cc:276] 0709 13:00:22.263202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.491869 (+228667us) service_pool.cc:224] Handling call
0709 13:00:22.492236 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:22.649280 (+157044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:22.677125 (+ 27845us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:22.686209 (+  9084us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.361848 (+675639us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:23.476802 (+114954us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.477515 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.477581 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:23.526524 (+ 48943us) raft_consensus.cc:1685] finished
0709 13:00:23.526543 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.526667 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17607,"prepare.queue_time_us":122744,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":52658,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":20281,"thread_start_us":736999,"threads_started":3,"wal-append.queue_time_us":630985}
W20260709 13:00:23.529654  1511 leader_election.cc:336] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.765s (SENT)
I20260709 13:00:23.530090  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.530110  1511 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:23.530757  1616 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:23.531519  1511 leader_election.cc:336] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.773s (SENT)
I20260709 13:00:23.531914  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:23.531828  4707 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:23.532984  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.534062  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.523725  4734 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:23.537748  1616 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:23.541402  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.541678  4707 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:23.541841  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.542361  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.542606  1613 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:23.542929  1616 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:23.543447  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.543684  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.543990  1613 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:23.544857  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.545795  1613 raft_consensus.cc:2410] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:00:23.546365  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.546525  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.547262  1613 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:23.549064  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.547487  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.549950  1616 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:23.550712  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.551301  1616 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:23.547096  4879 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:23.553766  4879 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:23.556355  4879 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:23.558100  4707 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:23.558653  4707 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:23.561225  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:23.562815  1687 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:23.561234  4707 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:23.563989  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:23.565014  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:23.567625  1511 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.026s (SENT)
I20260709 13:00:23.568383  1511 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:23.570366  1511 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.152s (SENT)
I20260709 13:00:23.572078  1613 raft_consensus.cc:2410] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:23.572227  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.576578  1616 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:23.586797  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.587571  1616 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:23.588014  4877 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:00:23.588311  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.588855  1616 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:00:23.589587  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:23.593511  1660 leader_election.cc:336] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.129s (SENT)
I20260709 13:00:23.594105  1660 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:23.599956  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 70584.5us
I20260709 13:00:23.601452  4884 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:23.576144  4660 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:23.604183  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:23.604758  1693 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
W20260709 13:00:23.622916  1511 leader_election.cc:336] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.698s (SENT)
I20260709 13:00:23.623406  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:23.624114  4660 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:23.625746  1538 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:23.625176  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 1928) took 3299 ms (client timeout 3120 ms). Trace:
W20260709 13:00:23.628036  1614 rpcz_store.cc:269] 0709 13:00:20.319828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.346426 (+ 26598us) service_pool.cc:224] Handling call
0709 13:00:23.618278 (+3271852us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001a36d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:23.619437 (+  1159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2997939584}
I20260709 13:00:23.629951  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53120c1adf947fd992e5950edf26301"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:48306
I20260709 13:00:23.630295  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.630537  1693 raft_consensus.cc:606] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:23.631772  1693 raft_consensus.cc:614] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:23.632560  4376 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:23.633052  4376 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:23.638025  4844 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 1.267s	user 0.004s	sys 0.010s
I20260709 13:00:23.631122  1614 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:23.642117  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.642848  1614 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:23.643242  4843 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.261s	user 0.009s	sys 0.010s
I20260709 13:00:23.643613  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.644742  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.645244  1614 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:23.645951  4743 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:23.646325  4743 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:23.646509  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.647044  1614 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:23.647159  4743 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:23.648126  4743 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:23.663157  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:23.663476  2271 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:23.664216  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:23.667680  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.668391  1618 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:23.669076  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.669984  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.670426  1618 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:23.671527  4834 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.546s	user 0.007s	sys 0.007s
W20260709 13:00:23.677420  1511 leader_election.cc:336] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.815s (SENT)
I20260709 13:00:23.677556  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:23.678356  2272 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:23.678544  1614 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
W20260709 13:00:23.680984  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.679404  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.682984  1614 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:23.683501  1511 leader_election.cc:336] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.869s (SENT)
I20260709 13:00:23.686836  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:23.689322  4864 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:23.689463  4376 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:23.691588  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.691787  4376 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:23.692386  1617 raft_consensus.cc:2410] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:00:23.697973  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.698545  1614 raft_consensus.cc:2376] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8. Re-sending same reply.
I20260709 13:00:23.698915  2269 raft_consensus.cc:3055] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:23.699913  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.700443  1617 raft_consensus.cc:2376] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8. Re-sending same reply.
I20260709 13:00:23.699242  2269 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:23.702066  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.702683  1614 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:23.703500  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.704075  1614 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:23.704696  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.705289  1614 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:23.705196  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.706127  1615 raft_consensus.cc:2410] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:00:23.706161  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.706915  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.707612  1615 raft_consensus.cc:2410] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:00:23.707787  1584 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53910 dropped due to backpressure: service queue is full with 50 items
I20260709 13:00:23.708300  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:23.708794  1615 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:23.711409  1693 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:23.712400  2275 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:23.714710  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.702565  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:23.715648  2277 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:23.716276  2243 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:23.717105  1614 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
W20260709 13:00:23.716578  1511 leader_election.cc:336] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.087s (SENT)
I20260709 13:00:23.716706  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:23.717311  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:23.717999  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:23.718638  2243 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:23.718966  1660 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:23.719393  2243 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:23.708024  1584 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53910 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2418)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2419)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2420)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2423)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2346)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 629)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2404)
W20260709 13:00:23.721385  1511 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.090s (SENT)
I20260709 13:00:23.721773  1511 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:23.722649  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:23.717639  1510 leader_election.cc:400] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:23.723328  1510 leader_election.cc:403] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:23.717774  4534 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.320s	user 0.021s	sys 0.041s
W20260709 13:00:23.724166  4534 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.333s	user 0.021s	sys 0.041s
I20260709 13:00:23.724282  4789 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:23.724509  4534 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:23.724843  4789 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.725281  4789 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:23.725687  4781 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:23.726186  4781 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:23.726738  4751 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:23.727290  4799 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:23.728263  4781 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:23.730284  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:23.744335  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:23.745860  2269 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:23.742115  4707 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:23.705120  4787 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.145056  2272 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:23.941642  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.762791  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.789451  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:23.885067  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2374) took 1970 ms (client timeout 2168 ms). Trace:
I20260709 13:00:23.809296  1690 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:24.086119  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.161960  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.077616  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1914) took 2778 ms. Trace:
I20260709 13:00:23.802505  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.145179  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:23.792055  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.164175  1542 raft_consensus.cc:2410] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:23.805763  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1956) took 1542 ms. Trace:
I20260709 13:00:24.164803  1616 rpcz_store.cc:276] 0709 13:00:22.263947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.590300 (+1326353us) service_pool.cc:224] Handling call
0709 13:00:23.590586 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.600618 (+ 10032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.600657 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.606413 (+  5756us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.657767 (+ 51354us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:23.660058 (+  2291us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.660463 (+   405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.660523 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:23.805501 (+144978us) raft_consensus.cc:1685] finished
0709 13:00:23.805529 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.805693 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2676,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":4166,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":4157,"thread_start_us":32896,"threads_started":1,"wal-append.queue_time_us":185407}
I20260709 13:00:23.833319  2277 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:23.757763  2269 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:24.154743  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:24.160866  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 439386us
I20260709 13:00:24.168640  1537 raft_consensus.cc:2410] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:23.810904  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.169171  1617 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:23.790110  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:23.789826  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:23.960644  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.837908  1620 raft_consensus.cc:2410] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:24.150179  1618 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
W20260709 13:00:24.173228  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.162330  1539 rpcz_store.cc:276] 0709 13:00:21.299368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.306506 (+  7138us) service_pool.cc:224] Handling call
0709 13:00:21.306797 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:22.279084 (+972287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.077350 (+1798266us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400354654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:24.077537 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233956736}
I20260709 13:00:24.175891  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:23.731065  4820 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:24.176373  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:24.160753  1689 rpcz_store.cc:269] 0709 13:00:21.914225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.957616 (+ 43391us) service_pool.cc:224] Handling call
0709 13:00:23.884885 (+1927269us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54001ab8d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:23.885011 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454085376}
I20260709 13:00:24.179670  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:24.072304  4835 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.798s	user 0.003s	sys 0.015s
I20260709 13:00:23.720505  4760 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:24.177691  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:24.182598  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.049839  4747 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.188725  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:23.986531  4672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.699s	user 0.016s	sys 0.039s
I20260709 13:00:23.839044  4707 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:24.183525  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:24.183863  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:23.742306  4751 raft_consensus.cc:697] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:24.079052  4842 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 1.862s	user 0.005s	sys 0.028s
W20260709 13:00:24.186088  1511 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.885s (SENT)
I20260709 13:00:24.187575  2271 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:23.743767  4655 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:24.187973  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.050395  4765 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:23.751533  4858 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:24.189518  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.221879  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.189783  1618 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:24.190104  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.182463  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.190387  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:24.158802  4884 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:24.223214  1617 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:24.223533  1542 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:24.196102  1537 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:24.176848  4743 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:24.195765  4672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.910s	user 0.023s	sys 0.045s
I20260709 13:00:23.720371  4476 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.468s
I20260709 13:00:24.199198  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:24.202054  1511 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.921s (SENT)
I20260709 13:00:24.274813  1511 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:24.207468  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.275559  1611 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:24.276374  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.276889  1611 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:24.277583  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.277782  1544 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 3.
I20260709 13:00:24.214967  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.214277  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.217068  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:24.179173  4793 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:24.253508  1539 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:24.253978  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.032s	sys 0.018s
I20260709 13:00:24.227788  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.199110  4747 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.190575  1583 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43404 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 637)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2418)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2419)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2420)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2423)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2346)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 629)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2376)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 635)
I20260709 13:00:24.260305  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.278496  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.282756  1541 raft_consensus.cc:2410] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:24.283053  1543 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:24.142925  4789 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.178408  4754 consensus_queue.cc:1059] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 13:00:24.281957  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 79918.8us
I20260709 13:00:24.301815  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.222128  4858 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:24.283246  1611 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:24.283744  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.032s	sys 0.018s
W20260709 13:00:24.303494  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 555798us
I20260709 13:00:24.303791  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.304255  4895 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:24.254864  4884 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.304749  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.305317  1611 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:24.305979  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.306756  4884 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.306929  4707 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:24.203389  4765 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:24.307689  4751 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.308331  4765 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:24.309250  4765 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.285989  1539 raft_consensus.cc:1217] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Deduplicated request from leader. Original: 3.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 13:00:24.310917  1539 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:24.253533  4743 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.286311  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.288189  4747 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.291708  4668 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:24.312021  1693 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 14: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:24.312844  4743 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:24.306802  4655 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:23.821398  4534 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.304768  4895 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.316198  4895 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.307729  4707 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:24.316969  4707 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:24.317719  4707 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.318127  4664 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.312986  1693 raft_consensus.cc:1217] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:00:24.318955  1693 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:24.318781  4664 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.320365  4707 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:24.321237  4664 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:24.322707  4787 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:24.306425  1611 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:24.302778  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:24.332192  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 619) took 3644 ms. Trace:
I20260709 13:00:24.332580  4895 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:24.330207  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.333788  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.334306  1614 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:24.334493  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:24.334846  4821 log.cc:927] Time spent T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 2.120s	user 0.005s	sys 0.007s
I20260709 13:00:24.331367  1511 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:24.335857  4655 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:24.336205  4655 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:24.336586  4655 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:24.337869  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 649) took 3105 ms. Trace:
W20260709 13:00:24.339551  4836 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 2.138s	user 0.014s	sys 0.017s
I20260709 13:00:24.332697  1619 rpcz_store.cc:276] 0709 13:00:20.687901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.316158 (+628257us) service_pool.cc:224] Handling call
0709 13:00:21.316511 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.926844 (+610333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.926886 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.927338 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.091445 (+164107us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:22.091713 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.091808 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:23.730528 (+1638720us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b480024c258. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f0cceaa1 00007f29f0cc5b37 00007f29f0cc59ca 00007f29f0dbd26f 00007f29f0dbcf37 00007f29f0dd155c 00007f29f0dd1508 00007f29f0dd1488 00007f29f0dd1443 00007f29f0dd06ec 00007f29efcfaa96
0709 13:00:24.078526 (+347998us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:24.331961 (+253435us) raft_consensus.cc:1685] finished
0709 13:00:24.331989 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.332129 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":592855,"raft.queue_time_us":610979,"raft.run_cpu_time_us":13449,"raft.run_wall_time_us":1786112,"spinlock_wait_cycles":475790336,"thread_start_us":163707,"threads_started":1,"wal-append.queue_time_us":288817}
I20260709 13:00:24.341167  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.341670  1619 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:24.342424  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.342671  4808 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:24.343211  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:24.343809  4781 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:24.343987  4668 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:24.346428  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:24.302956  4858 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:24.338207  1536 rpcz_store.cc:276] 0709 13:00:21.232808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.232929 (+   121us) service_pool.cc:224] Handling call
0709 13:00:21.287856 (+ 54927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.298391 (+ 10535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.298423 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.307597 (+  9174us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.674123 (+366526us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:21.680211 (+  6088us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.696564 (+ 16353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.696653 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.519039 (+822386us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b180048eb00. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb8522 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:24.334220 (+1815181us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:24.337676 (+  3456us) raft_consensus.cc:1685] finished
0709 13:00:24.337695 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.337819 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23340,"prepare.queue_time_us":6024,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":1671,"raft.queue_time_us":28269,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":70661,"spinlock_wait_cycles":492516608,"thread_start_us":359738,"threads_started":1,"wal-append.queue_time_us":807055}
I20260709 13:00:24.335093  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.367264  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.368273  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.369000  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.369475  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.369871  1690 raft_consensus.cc:2393] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:24.343389  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.335131  1611 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:24.359723  2241 connection.cc:256] RPC call timeout handler was delayed by -1.728628332000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:00:24.372013  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.372824  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.373766  1689 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:24.362094  2269 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:24.344333  4781 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.377462  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.377857  1539 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 11. Ops: [9.7-9.7]
I20260709 13:00:24.382337  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.383651  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.384466  1611 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:24.374711  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.385401  1689 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:24.371074  4747 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.386011  4747 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.386991  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.387814  1619 raft_consensus.cc:2393] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:24.388109  4747 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.388613  4747 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:24.388840  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.389043  4747 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.389513  1619 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:24.391291  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.391862  4747 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.392657  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.227838  4864 consensus_queue.cc:1059] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:00:24.397742  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.398386  1611 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:24.333105  4895 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:24.399873  2241 connection.cc:256] RPC call timeout handler was delayed by -1.2084283320000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 13:00:24.400270  2241 connection.cc:256] RPC call timeout handler was delayed by -1.1580283320000717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260709 13:00:24.400667  2241 connection.cc:256] RPC call timeout handler was delayed by -1.0691008969999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 13:00:24.401047  2241 connection.cc:256] RPC call timeout handler was delayed by -1.0691008969999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 13:00:24.402601  1511 leader_election.cc:336] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.333s (SENT)
I20260709 13:00:24.404820  1660 leader_election.cc:400] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:24.405205  1660 leader_election.cc:403] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:24.344359  4668 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:24.406708  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.409968  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.411759  1614 raft_consensus.cc:2410] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:24.416225  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.417104  1614 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:24.417115  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:24.412046  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.418752  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.419955  1690 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:24.421096  1690 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:00:24.426383  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 121360us
W20260709 13:00:24.427244  4892 log.cc:927] Time spent T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:00:24.427282  1510 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:24.407375  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.430363  1611 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 3: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:24.408771  4895 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:24.410072  4668 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:24.371229  4765 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:00:24.372319  4813 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:00:24.345208  4793 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.449903  4789 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:24.450716  4793 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:24.430687  4815 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:24.433858  1511 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.646s (SENT)
I20260709 13:00:24.380616  4655 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:24.441771  1619 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:24.472728  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.434579  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.441601  2241 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.433262  1614 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:24.480091  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.480827  1614 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.415267  4672 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:00:24.476019  1611 raft_consensus.cc:2376] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14. Re-sending same reply.
I20260709 13:00:24.483801  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.449024  4726 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:24.484534  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.488067  1611 raft_consensus.cc:2410] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:00:24.486656  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 45139.6us
I20260709 13:00:24.488998  2241 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.491446  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.492614  1611 raft_consensus.cc:2410] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:24.499692  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.463223  4815 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:24.479491  4864 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.484673  4754 raft_consensus.cc:3055] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:24.495472  4897 raft_consensus.cc:2764] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:00:24.484925  4760 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:24.485914  4672 consensus_queue.cc:1243] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer e2a2b76c98ee44ff95e6508c34da0e3d log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:00:24.508862  4728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.293s	user 0.002s	sys 0.029s
I20260709 13:00:24.515777  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:24.517138  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 148601us
I20260709 13:00:24.501807  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.563475  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:24.510073  4754 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:24.563304  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.507879  4815 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:24.544317  4728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.310s	user 0.002s	sys 0.030s
I20260709 13:00:24.515293  4534 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:24.564576  1614 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:24.575245  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.575306  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:24.576035  1614 raft_consensus.cc:2410] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:00:24.569506  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 164828us
I20260709 13:00:24.504786  4820 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.501761  4726 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:24.572042  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.587670  1611 raft_consensus.cc:2410] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:24.509610  4864 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:24.577521  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:24.589629  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.581355  1660 leader_election.cc:400] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
W20260709 13:00:24.570217  4773 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.018s	user 0.021s	sys 0.004s
I20260709 13:00:24.589880  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:24.590672  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.591064  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:24.525393  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 98173.4us
I20260709 13:00:24.573071  4897 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:24.577821  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 62102.6us
I20260709 13:00:24.595697  1611 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:24.599520  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.602320  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:24.603168  1619 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:24.546785  4900 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:00:24.610463  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:24.606158  2241 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.599782  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 928) took 2070 ms. Trace:
I20260709 13:00:24.615540  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:24.617456  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:24.610673  4828 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:24.619573  2275 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:24.597870  4903 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:00:24.590431  4534 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:24.620252  4721 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:24.609740  4897 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.600976  4907 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:24.615029  2270 rpcz_store.cc:276] 0709 13:00:22.529714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.529814 (+   100us) service_pool.cc:224] Handling call
0709 13:00:22.530076 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.230412 (+700336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.230449 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.231028 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.426174 (+195146us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b1800261580. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb9450d1 00007f29ebd60a0f
0709 13:00:23.477515 (+ 51341us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:23.477548 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.599497 (+1121949us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b5400660154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:24.599542 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.599600 (+    58us) raft_consensus.cc:1685] finished
0709 13:00:24.599614 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.599734 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14230,"raft.queue_time_us":14344,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8312,"spinlock_wait_cycles":1550688384,"thread_start_us":51169,"threads_started":1,"wal-append.queue_time_us":252981,"wal-append.run_cpu_time_us":1473,"wal-append.run_wall_time_us":1001517}
I20260709 13:00:24.593686  4888 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:24.616132  2268 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:24.597834  4751 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.582376  4846 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:00:24.602870  4773 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.056s	user 0.022s	sys 0.004s
I20260709 13:00:24.593791  4910 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:24.642549  4721 raft_consensus.cc:697] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:24.643133  4840 log.cc:927] Time spent T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 2.425s	user 0.008s	sys 0.012s
I20260709 13:00:24.600826  4864 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:24.593835  4913 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:00:24.619488  4828 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.599677  4906 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:24.620232  4781 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:24.598120  4902 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:00:24.650404  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.610827  4748 consensus_queue.cc:1059] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:00:24.645223  4897 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:24.662675  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:24.664606  2270 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:24.665570  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:24.666285  2277 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:24.667181  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:24.680063  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:24.680415  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:24.653450  4888 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:24.649570  4909 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:24.681125  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:24.682869  1658 leader_election.cc:400] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:24.609457  4754 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.685180  1539 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:24.680516  4919 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:24.690837  4888 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.692055  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1931) took 4371 ms. Trace:
I20260709 13:00:24.693077  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2342) took 1356 ms. Trace:
I20260709 13:00:24.681362  4748 consensus_queue.cc:1243] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:24.658907  4906 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:24.693490  1620 rpcz_store.cc:276] 0709 13:00:23.336745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.342925 (+  6180us) service_pool.cc:224] Handling call
0709 13:00:24.692885 (+1349960us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54001a45d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:24.693002 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118138752}
I20260709 13:00:24.693960  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:24.694187  4906 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.695647  4919 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.696611  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.697598  4919 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.692395  1612 rpcz_store.cc:276] 0709 13:00:20.320708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.003446 (+682738us) service_pool.cc:224] Handling call
0709 13:00:21.035683 (+ 32237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.780088 (+744405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.780136 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.798190 (+ 18054us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.050723 (+252533us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:22.052847 (+  2124us) log.cc:844] Serialized 14 byte log entry
0709 13:00:22.057292 (+  4445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.057367 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.642548 (+2585181us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:24.687436 (+ 44888us) raft_consensus.cc:1685] finished
0709 13:00:24.691857 (+  4421us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.692000 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":797711,"prepare.queue_time_us":1978,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":38,"raft.queue_time_us":757940,"raft.run_cpu_time_us":6428,"raft.run_wall_time_us":138136,"spinlock_wait_cycles":469142912,"thread_start_us":93047,"threads_started":1,"wal-append.queue_time_us":273389}
I20260709 13:00:24.698093  4919 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:24.687681  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.659813  4817 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:24.688880  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:24.699801  2277 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:24.699959  4919 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:24.697974  2270 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:24.700724  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.701350  1620 raft_consensus.cc:2368] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:24.702422  1658 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.686905  4828 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:24.707342  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.709609  1612 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:24.707746  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.710173  1620 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:24.701776  4668 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:24.670282  4655 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:24.651142  4751 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.713693  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.620801  4760 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.715121  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:24.719125  2270 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:24.702355  4895 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.687237  4707 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:24.717332  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.726536  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:24.715559  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 125964us
I20260709 13:00:24.724512  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.724774  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:24.725180  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.709277  4919 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:24.727414  1612 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 14: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:24.709743  4725 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.734393  1537 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:24.726795  4707 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:24.737366  4707 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:24.706187  4909 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.738142  4668 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:24.688748  4726 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.740077  4895 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.740437  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.740964  1618 raft_consensus.cc:2376] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8. Re-sending same reply.
I20260709 13:00:24.741045  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.741868  1618 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:24.741953  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.742373  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1961) took 2477 ms. Trace:
I20260709 13:00:24.738281  4707 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.743155  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.745832  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2350) took 1324 ms. Trace:
I20260709 13:00:24.742686  1618 rpcz_store.cc:276] 0709 13:00:22.264981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.741544 (+2476563us) service_pool.cc:224] Handling call
0709 13:00:24.741743 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.742201 (+   458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.742334 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.747607  1613 rpcz_store.cc:276] 0709 13:00:23.421718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.548782 (+127064us) service_pool.cc:224] Handling call
0709 13:00:24.745678 (+1196896us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b54001121d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:24.745785 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50703744}
I20260709 13:00:24.745903  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.743535  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.748914  1685 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:24.712502  4771 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:24.744037  2243 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:24.752317  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 894) took 1076 ms. Trace:
I20260709 13:00:24.752964  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.753541  1618 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:24.754143  1612 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:24.754161  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 626) took 2353 ms. Trace:
I20260709 13:00:24.754964  1618 rpcz_store.cc:276] 0709 13:00:22.400767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.748361 (+2347594us) service_pool.cc:224] Handling call
0709 13:00:24.748589 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.753954 (+  5365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.754117 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.756443  1618 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:24.756742  1618 pending_rounds.cc:85] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 2
I20260709 13:00:24.756968  1618 pending_rounds.cc:107] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:24.757195  1618 raft_consensus.cc:2889] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:24.752285  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:24.757664  1620 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:24.753219  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1927) took 1427 ms. Trace:
I20260709 13:00:24.752720  2271 rpcz_store.cc:276] 0709 13:00:23.676258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.678870 (+  2612us) service_pool.cc:224] Handling call
0709 13:00:23.688053 (+  9183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.200344 (+512291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.752099 (+551755us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b540071dc54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:24.752263 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148257152}
I20260709 13:00:24.759025  1538 rpcz_store.cc:276] 0709 13:00:23.325555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.325666 (+   111us) service_pool.cc:224] Handling call
0709 13:00:23.335134 (+  9468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.626130 (+290996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.753025 (+1126895us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400313154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:24.753167 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667882880}
I20260709 13:00:24.721365  4828 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:24.797056  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.797731  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.819468  1686 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 3.
I20260709 13:00:24.820220  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.821101  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:24.744935  4893 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.472s	user 0.001s	sys 0.001s
I20260709 13:00:24.753099  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:24.828142  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:24.822294  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.822585  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.818902  1694 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:24.832268  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.833343  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.833954  1694 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:24.818787  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2346) took 1445 ms. Trace:
I20260709 13:00:24.825044  1612 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:24.834249  1618 rpcz_store.cc:276] 0709 13:00:23.374316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.756000 (+1381684us) service_pool.cc:224] Handling call
0709 13:00:24.756200 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.797992 (+ 41792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.818729 (+ 20737us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.835762  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 628) took 1440 ms. Trace:
I20260709 13:00:24.836292  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.831848  1690 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:24.837962  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:24.836076  1618 rpcz_store.cc:276] 0709 13:00:23.395284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.835068 (+1439784us) service_pool.cc:224] Handling call
0709 13:00:24.835321 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.835486 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.835510 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.835546 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:24.835582 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.835630 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.835715 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.839119  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2345) took 1473 ms. Trace:
I20260709 13:00:24.839479  1612 rpcz_store.cc:276] 0709 13:00:23.365427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.754896 (+1389469us) service_pool.cc:224] Handling call
0709 13:00:24.824829 (+ 69933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.838873 (+ 14044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.839071 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.840504  2273 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:00:24.841336  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.842161  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:24.842726  1617 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:24.842664  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:24.843235  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2366) took 1235 ms. Trace:
I20260709 13:00:24.843573  1617 rpcz_store.cc:276] 0709 13:00:23.607409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.801797 (+1194388us) service_pool.cc:224] Handling call
0709 13:00:24.843188 (+ 41391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30976}
I20260709 13:00:24.844010  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:24.844969  4781 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:24.845105  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:24.839655  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.845968  1686 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:24.847177  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.847923  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:24.849399  1618 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:00:24.850075  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 629) took 1454 ms. Trace:
I20260709 13:00:24.842621  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 627) took 1447 ms. Trace:
I20260709 13:00:24.850915  1613 rpcz_store.cc:276] 0709 13:00:23.395018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.807560 (+1412542us) service_pool.cc:224] Handling call
0709 13:00:24.842210 (+ 34650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.842359 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.842382 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.842417 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:24.842451 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.842498 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.842579 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39552}
I20260709 13:00:24.851794  1543 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:24.851943  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.856077  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:24.857079  1538 raft_consensus.cc:2410] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:24.859515  1544 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:24.850474  1618 rpcz_store.cc:276] 0709 13:00:23.395528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.848744 (+1453216us) service_pool.cc:224] Handling call
0709 13:00:24.849043 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.849828 (+   785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.850018 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.860075  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.860592  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:24.861186  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.709363  4534 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.862416  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:24.801195  4900 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:24.866766  1612 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:24.867486  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2347) took 1461 ms. Trace:
I20260709 13:00:24.867910  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:24.867794  1612 rpcz_store.cc:276] 0709 13:00:23.406017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.840395 (+1434378us) service_pool.cc:224] Handling call
0709 13:00:24.866436 (+ 26041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.867220 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.867419 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.868726  1542 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:24.870440  1617 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:00:24.871203  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2357) took 1373 ms. Trace:
I20260709 13:00:24.871585  1617 rpcz_store.cc:276] 0709 13:00:23.497911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.844176 (+1346265us) service_pool.cc:224] Handling call
0709 13:00:24.870180 (+ 26004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.870935 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.871146 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.864084  1689 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:00:24.818419  4771 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.818866  4919 raft_consensus.cc:697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:24.882189  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:24.884742  1539 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: [10.12-10.12]
I20260709 13:00:24.885250  1620 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:24.888438  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1647) took 1079 ms. Trace:
I20260709 13:00:24.888998  1691 rpcz_store.cc:276] 0709 13:00:23.809295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.809438 (+   143us) service_pool.cc:224] Handling call
0709 13:00:24.154246 (+344808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.154518 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.154554 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:24.183704 (+ 29150us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.410867 (+227163us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:24.410901 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.410960 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.888202 (+477242us) raft_consensus.cc:1685] finished
0709 13:00:24.888227 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.888375 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":183036,"threads_started":1,"wal-append.queue_time_us":291047}
I20260709 13:00:24.846485  4855 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:24.823577  4904 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:00:24.869076  4905 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 13:00:24.894805  1685 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:24.896106  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:24.846550  4910 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:24.732403  4721 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.862540  4864 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:24.897104  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.866401  4781 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:24.851694  4748 consensus_queue.cc:1059] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:00:24.883347  4921 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:24.928536  4781 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:24.929047  4781 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.880743  4751 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:24.841583  4828 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.928910  4921 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:24.881821  4912 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.930614  1612 raft_consensus.cc:3055] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:24.886211  4900 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:24.910739  4858 consensus_meta.cc:287] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.001s
I20260709 13:00:24.910275  4904 consensus_queue.cc:1243] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:24.899596  4898 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:24.954993  1612 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:24.881453  4771 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:24.923692  4476 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:24.961534  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 99177.9us
I20260709 13:00:24.928005  4864 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:24.954993  4725 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:24.988046  1511 leader_election.cc:400] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8.
I20260709 13:00:24.968254  4858 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:24.988642  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 75806.7us
I20260709 13:00:24.972013  4910 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.990191  4864 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:25.010650  4926 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:00:25.011575  4924 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:00:25.013343  4864 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.013217  4900 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.014423  1613 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:25.015440  4906 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.016064  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 634) took 1400 ms. Trace:
I20260709 13:00:25.016397  1613 rpcz_store.cc:276] 0709 13:00:23.615355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.892081 (+1276726us) service_pool.cc:224] Handling call
0709 13:00:24.892377 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.014766 (+122389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.015878 (+  1112us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540024b154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:25.016014 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280284928}
I20260709 13:00:25.017417  4906 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.017812  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.018153  1615 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:25.018527  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1644) took 1210 ms. Trace:
I20260709 13:00:25.018874  1687 rpcz_store.cc:276] 0709 13:00:23.808427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.811273 (+  2846us) service_pool.cc:224] Handling call
0709 13:00:25.017684 (+1206411us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800003698. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:25.018476 (+   792us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26063232}
I20260709 13:00:25.019608  4828 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.020291  4820 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:25.021278  4771 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:25.023571  4849 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:25.023983  4849 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:24.995584  1612 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:25.026240  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1959) took 2761 ms. Trace:
I20260709 13:00:25.026626  1614 rpcz_store.cc:276] 0709 13:00:22.264614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.586562 (+2321948us) service_pool.cc:224] Handling call
0709 13:00:24.586853 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.588524 (+  1671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.588552 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:24.593862 (+  5310us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.761547 (+167685us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:24.949704 (+188157us) log.cc:844] Serialized 14 byte log entry
0709 13:00:24.949940 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.950034 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.026070 (+ 76036us) raft_consensus.cc:1685] finished
0709 13:00:25.026087 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.026193 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17931,"prepare.queue_time_us":172487,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":704,"raft.queue_time_us":1416,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":20680,"spinlock_wait_cycles":7213952,"thread_start_us":227466,"threads_started":2,"wal-append.queue_time_us":261875}
I20260709 13:00:25.004607  2274 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:25.029062  1614 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:25.029752  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2403) took 1343 ms. Trace:
I20260709 13:00:25.030109  1614 rpcz_store.cc:276] 0709 13:00:23.685904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.028566 (+1342662us) service_pool.cc:224] Handling call
0709 13:00:25.028860 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.029490 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.029697 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:24.983384  4911 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:00:25.024693  4849 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.047683  1612 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:25.048200  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 47096.2us
I20260709 13:00:25.043437  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:25.048978  1613 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:25.049646  1510 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:25.006173  4910 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.044962  4864 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.966631  4751 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:00:25.060913  4923 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:25.061321  4923 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:25.061682  4923 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.064049  1619 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:25.064169  1611 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:25.065304  1619 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:25.059942  1511 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:25.059033  4476 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:25.066121  4849 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.067050  4751 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:24.968819  4912 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.068507  1613 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:25.068804  4476 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:25.069244  4912 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:25.069262  4476 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:25.070007  4909 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:24.969135  4919 consensus_queue.cc:237] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.072829  4655 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.073302  4655 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:25.074330  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.075302  1614 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:25.069952  2241 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:25.078981  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.080461  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.080932  1687 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:25.081969  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:25.084268  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.084982  1691 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:25.085299  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.086825  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:25.087318  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.088016  1691 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:25.088896  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.087338  1694 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.084467  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.092829  4721 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.091197  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:25.120075  4765 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.004s	sys 0.008s
I20260709 13:00:25.092672  1687 raft_consensus.cc:2393] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:25.124459  1685 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:00:25.120520  4765 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.004s	sys 0.008s
I20260709 13:00:25.092583  1686 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:25.126112  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:25.129127  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 480164us
I20260709 13:00:25.070232  4476 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.135618  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.139731  1509 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.143025  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.148604  1612 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:25.149217  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2376) took 1521 ms. Trace:
I20260709 13:00:25.149545  1612 rpcz_store.cc:276] 0709 13:00:23.627920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.893415 (+1265495us) service_pool.cc:224] Handling call
0709 13:00:24.924412 (+ 30997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.930536 (+  6124us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b540006caa0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd1cdc0 00007f29ebda71c0 00007f29ebda8231 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c
0709 13:00:25.148994 (+218458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.149168 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11499392}
I20260709 13:00:25.150938  1612 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:00:25.172250  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.025177  4815 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.064260  4898 consensus_queue.cc:1059] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:00:25.181803  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:25.183703  1694 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:25.138376  4921 consensus_queue.cc:1059] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:00:25.122941  4808 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:00:25.060491  4935 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:00:25.187038  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:25.175712  4896 raft_consensus.cc:1064] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 13:00:25.193445  4896 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:25.179523  4747 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:00:25.189993  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.059160  4936 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:00:25.199338  1690 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:25.120826  4811 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:00:25.201726  2272 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 8. Ops: [6.8-6.8]
I20260709 13:00:25.211830  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:48306
I20260709 13:00:25.186234  4813 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:25.212566  1694 raft_consensus.cc:606] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:25.218775  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 79107.6us
I20260709 13:00:25.200073  4944 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:25.182327  4897 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.215791  4813 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:25.215349  4910 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.234752  4945 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:25.240506  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:25.262480  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:25.263908  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.264803  4534 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:25.265291  4534 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:25.265725  4534 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.267153  4942 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.267611  4942 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:25.268047  4942 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.268553  4904 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:25.266508  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.273460  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:25.276027  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 56594.1us
I20260709 13:00:25.276645  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:25.279083  2241 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:25.245177  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.275154  4828 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.258852   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:25.283982  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:25.275286  4790 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.252480  4945 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:25.286314  4945 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:25.286707  1690 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:25.286434  4813 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.287103  4945 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.287606  4813 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:25.288278  4945 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:25.246657  4290 raft_consensus.cc:3055] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:25.290246  4290 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:25.291007  4290 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.292205  4290 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.298560  4921 raft_consensus.cc:3055] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:25.258932  4811 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:25.299000  4921 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:25.299160  4811 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.299767  4921 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.300908  4921 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.307334  4815 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.325700  1692 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:25.326858  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1642) took 1519 ms. Trace:
I20260709 13:00:25.327191  1692 rpcz_store.cc:276] 0709 13:00:23.807659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.810786 (+  3127us) service_pool.cc:224] Handling call
0709 13:00:25.325325 (+1514539us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5800003698. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:00:25.325517 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.326607 (+  1090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.326802 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29752064}
I20260709 13:00:25.240258  4955 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:25.332073  4935 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:25.338330  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 61744.3us
I20260709 13:00:25.286010  4760 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:25.328577  4799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.002s	sys 0.006s
I20260709 13:00:25.256325  4781 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.343894  4897 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.347856  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2424) took 1621 ms. Trace:
I20260709 13:00:25.363819  1613 rpcz_store.cc:276] 0709 13:00:23.726068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.049595 (+1323527us) service_pool.cc:224] Handling call
0709 13:00:25.049856 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.068791 (+ 18935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.347554 (+278763us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54000e0e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:25.347781 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42238848}
W20260709 13:00:25.367986  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 88957.7us
I20260709 13:00:25.368134  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.369247  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:25.371663  1659 leader_election.cc:400] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
W20260709 13:00:25.356817  4799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.003s	sys 0.007s
I20260709 13:00:25.372782  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:25.375553  1618 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:25.338210  4935 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.377048  1659 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:25.379155  1509 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.379736  4945 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.381042  1693 raft_consensus.cc:3055] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:25.381368  1693 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:25.382005  1693 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.384745  4952 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:25.375018  4828 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:00:25.373302  4815 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:25.388427  4815 raft_consensus.cc:697] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:25.389274  4815 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.391552  4955 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.392007  4781 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:25.373629  4888 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 13:00:25.396656  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.396997  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:25.397683  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1643) took 1589 ms (client timeout 1831 ms). Trace:
W20260709 13:00:25.397994  1688 rpcz_store.cc:269] 0709 13:00:23.808055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.811013 (+  2958us) service_pool.cc:224] Handling call
0709 13:00:25.396857 (+1585844us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800003698. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:25.397630 (+   773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29168512}
I20260709 13:00:25.403615  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:25.404726  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:25.406396  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:25.407729  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:25.410629  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.411525  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:25.412537  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:25.413373  1693 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.415153  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:25.416424  1536 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:25.416746  1536 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:25.417367  1536 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.418157  1536 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.418973  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:25.419339  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:25.419735  2272 raft_consensus.cc:2410] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:25.420104  1692 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.419621  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:25.422897  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:25.423486  2268 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:25.424696  4942 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.430171  1692 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:25.439018  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:25.440392  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 61260.9us
W20260709 13:00:25.443022  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.445600  1693 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:25.379459  4935 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.446722  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2389) took 1081 ms. Trace:
I20260709 13:00:25.447438  1693 rpcz_store.cc:276] 0709 13:00:24.365228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.365665 (+   437us) service_pool.cc:224] Handling call
0709 13:00:24.365963 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.380954 (+1014991us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54000db4a0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd1cdc0 00007f29ebda71c0 00007f29ebda8231 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c
0709 13:00:25.446020 (+ 65066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.446653 (+   633us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046036864}
I20260709 13:00:25.452943  1613 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:25.453373  1613 pending_rounds.cc:85] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 6
W20260709 13:00:25.453852  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.454478  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:25.453823  1613 pending_rounds.cc:107] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:25.455503  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:25.456022  1613 raft_consensus.cc:2889] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.456598  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:25.453442  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:25.457751  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:25.458148  1538 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:25.460953  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.461035  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 48820.5us
I20260709 13:00:25.461745  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:25.463025  1659 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:25.458364  1541 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:25.464753  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:25.414304  4811 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.465979  4930 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:25.451695  4952 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:00:25.466413  4901 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:25.466763  4683 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:25.467404  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.467321  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 644) took 1002 ms. Trace:
I20260709 13:00:25.484704  1613 rpcz_store.cc:276] 0709 13:00:24.464488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.427925 (+963437us) service_pool.cc:224] Handling call
0709 13:00:25.452578 (+ 24653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.456660 (+  4082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.467274 (+ 10614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.468612  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.469609  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:25.453157  4908 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:25.446381  4955 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.492424  4923 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.488705  1659 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:25.496724  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:25.489223  4765 raft_consensus.cc:2764] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:25.497660  4940 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.498520  4940 consensus_queue.cc:1059] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:25.498929  4683 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:25.499675  4765 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:25.499855  4683 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:25.502851  4958 log.cc:927] Time spent T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:00:25.504647  1692 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:25.465394  4945 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.506721  4940 raft_consensus.cc:3055] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:25.507053  4940 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:25.507730  4940 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.508740  4940 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.510892  4943 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:25.511435  4943 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:25.511929  4943 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.485942  4930 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:25.515380  4930 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.516993  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2404) took 1830 ms. Trace:
I20260709 13:00:25.517405  1614 rpcz_store.cc:276] 0709 13:00:23.686198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.039000 (+1352802us) service_pool.cc:224] Handling call
0709 13:00:25.074963 (+ 35963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.075694 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.516769 (+441075us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54001a36d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:25.516924 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81923456}
I20260709 13:00:25.523078  4895 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:00:25.524857  4956 log.cc:927] Time spent T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 13:00:25.526937  4942 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.534950  4813 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:25.536631  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:25.558100  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:25.561375  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.562201  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.562768  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.564704  1536 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:00:25.565250  1536 pending_rounds.cc:85] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 8
I20260709 13:00:25.565622  1536 pending_rounds.cc:107] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:00:25.565946  1536 raft_consensus.cc:2889] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.575690  1614 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:25.494529  4923 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:25.535463  4813 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.576773  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:25.577636  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:25.577637  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:25.581821  1693 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.564391  4660 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.585073  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.585018  1542 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:25.593417  1660 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:25.594605  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:25.597186  4660 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.602281  1685 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:25.606891  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:25.609135  1685 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:25.615795  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2409) took 1928 ms (client timeout 1921 ms). Trace:
W20260709 13:00:25.622279  1615 rpcz_store.cc:269] 0709 13:00:23.692670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.599285 (+906615us) service_pool.cc:224] Handling call
0709 13:00:25.615612 (+1016327us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54001a40d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:25.615737 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939651456}
I20260709 13:00:25.616428  1612 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:25.616575  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:25.611498  4945 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:25.623967  1616 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
W20260709 13:00:25.624441  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2368) took 2011 ms (client timeout 2087 ms). Trace:
W20260709 13:00:25.624763  1616 rpcz_store.cc:269] 0709 13:00:23.612778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.611891 (+1999113us) service_pool.cc:224] Handling call
0709 13:00:25.624393 (+ 12502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.629667  2269 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:25.641952  4916 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.643020  4918 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:25.645550  4946 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:25.646256  4946 consensus_queue.cc:1243] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:25.647120  1694 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:25.647500  4655 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:25.648803  1540 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:25.649039  4946 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.649392  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1660) took 1897 ms. Trace:
I20260709 13:00:25.649505  4946 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.649744  1540 rpcz_store.cc:276] 0709 13:00:23.751686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.751801 (+   115us) service_pool.cc:224] Handling call
0709 13:00:25.648478 (+1896677us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b5800004e98. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:00:25.648637 (+   159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.649187 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.649345 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7892864}
I20260709 13:00:25.650499  4660 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:25.651539  4946 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:25.627293  4945 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:25.653198  1687 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:25.668624  1693 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:25.676054  4915 raft_consensus.cc:3055] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:25.680485  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.678834  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 66758.6us
I20260709 13:00:25.664069  4945 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.686189  1694 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:25.690733  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:25.642602  4916 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:25.697134  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 83338.4us
I20260709 13:00:25.705981  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:25.707448  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:25.687832  4904 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:25.705797  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:25.710688  1537 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:25.686993  4915 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:25.696640  4942 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:25.715207  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:25.720175  2277 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:25.689352  4534 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.715209  4930 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.713722  4946 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:25.729640  4966 log.cc:927] Time spent T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:25.726490  4813 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:25.728740  4942 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:25.741585  2271 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:25.744828  4962 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:25.745913  4901 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:25.746335  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 933) took 1083 ms. Trace:
I20260709 13:00:25.747337  4901 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:25.746719  2275 rpcz_store.cc:276] 0709 13:00:24.662651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.663342 (+   691us) service_pool.cc:224] Handling call
0709 13:00:24.686563 (+ 23221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.735758 (+ 49195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.735794 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:24.749731 (+ 13937us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.964232 (+214501us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:24.964270 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.745990 (+781720us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b54004d99d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:25.746036 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.746083 (+    47us) raft_consensus.cc:1685] finished
0709 13:00:25.746095 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.746282 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":208,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":112195328,"thread_start_us":117776,"threads_started":1,"wal-append.queue_time_us":243634}
I20260709 13:00:25.747761  4901 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.747660  4907 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:25.749534  4942 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.750471  4915 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.751335  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.751871  4915 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.751951  1690 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
W20260709 13:00:25.763085  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.763797  4945 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.767246  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:25.767499  4864 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.767887  1614 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:25.768035  4864 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.771003  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:25.771524  4945 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:25.771588  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:25.772066  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 640) took 1332 ms. Trace:
I20260709 13:00:25.772415  1618 rpcz_store.cc:276] 0709 13:00:24.439936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.248154 (+808218us) service_pool.cc:224] Handling call
0709 13:00:25.248378 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.375916 (+127538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.771880 (+395964us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54000578d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:25.772017 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291037568}
I20260709 13:00:25.772969  1615 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:25.773296  1615 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:25.773995  1618 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:25.731841  4930 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:25.775337  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:25.777312  1616 raft_consensus.cc:2376] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8. Re-sending same reply.
I20260709 13:00:25.777388  1585 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.778151  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:25.778895  1618 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:25.776033  1615 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.790661  4939 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:25.791095  1615 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:25.791304  4939 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.793568  4939 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:25.794735  4930 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.798295  2270 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:25.810773  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:25.811075  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 645) took 1305 ms. Trace:
I20260709 13:00:25.811508  1613 rpcz_store.cc:276] 0709 13:00:24.506020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.494250 (+988230us) service_pool.cc:224] Handling call
0709 13:00:25.494530 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.494754 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:25.613412 (+118658us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.810760 (+197348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.810804 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:25.810856 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.810919 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.811021 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105561,"prepare.queue_time_us":194831,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"thread_start_us":207477,"threads_started":2}
I20260709 13:00:25.814162  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.819203  1614 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:25.795315  4912 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.829595  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:25.837271  1616 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:25.822250  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 44929us
I20260709 13:00:25.839123  1585 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.841925  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:25.829586  1615 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:00:25.842857  1615 pending_rounds.cc:85] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 6
I20260709 13:00:25.843132  1615 pending_rounds.cc:107] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:00:25.843348  1615 raft_consensus.cc:2889] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.821823  2243 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.820436  4846 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.851359  4846 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.853579  4846 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.849896  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1971) took 1496 ms. Trace:
I20260709 13:00:25.854507  1611 rpcz_store.cc:276] 0709 13:00:24.353849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.065026 (+711177us) service_pool.cc:224] Handling call
0709 13:00:25.065275 (+   249us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:25.774003 (+708728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.774062 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:25.794982 (+ 20920us) log.cc:844] Serialized 52 byte log entry
0709 13:00:25.812190 (+ 17208us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:25.812224 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.812281 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.849716 (+ 37435us) raft_consensus.cc:1685] finished
0709 13:00:25.849734 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.849847 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":708376,"raft.queue_time_us":728451,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":16758,"threads_started":1,"wal-append.queue_time_us":44974}
I20260709 13:00:25.846164  1618 pending_rounds.cc:85] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 6
I20260709 13:00:25.856207  1618 pending_rounds.cc:107] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:25.857062  1618 raft_consensus.cc:2889] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.821300  4855 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.866179  4898 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.866714  4898 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:25.868774  4534 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.868964  4898 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:25.870343  4864 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:25.858222  1611 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:25.871758  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:25.874694  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:25.876843  4721 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:25.830478  4747 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.880240  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:25.850241  4858 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:25.882777  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 43743.5us
W20260709 13:00:25.901837  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.808459  4901 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.926925  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:25.830750  4828 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:00:25.877329  4721 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:25.836966  4912 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:25.861445  4787 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.857920  4728 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:26.002388  1613 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:26.002794  1613 pending_rounds.cc:85] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 6
I20260709 13:00:26.003047  1613 pending_rounds.cc:107] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:26.003269  1613 raft_consensus.cc:2889] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.943130  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:25.879619  4906 consensus_queue.cc:1059] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.122s
W20260709 13:00:25.980365  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 53800.6us
I20260709 13:00:26.008666  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.014745  4846 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:26.015311  4846 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.007306  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 904) took 1402 ms. Trace:
I20260709 13:00:26.017664  2273 rpcz_store.cc:276] 0709 13:00:24.605353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.605449 (+    96us) service_pool.cc:224] Handling call
0709 13:00:24.605695 (+   246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.846284 (+240589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.007105 (+1160821us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54006504d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:26.007255 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532314880}
I20260709 13:00:26.007575  4912 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:26.023043  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 80887.9us
I20260709 13:00:26.024062  1585 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.015753  4846 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:26.058140  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.293251  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.881094  4760 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.081246  1545 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: [10.12-10.12]
I20260709 13:00:25.924777  4781 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:26.325392  4781 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.325842  4781 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.027884  2243 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:25.925159  4672 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.300s
I20260709 13:00:26.227155  4721 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:26.228796  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 212110us
W20260709 13:00:26.231809  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 207792us
I20260709 13:00:26.232264  4901 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:26.232380  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 223746us
I20260709 13:00:25.923540  4725 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.925432  4900 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.310s
I20260709 13:00:25.977020  4898 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:26.236665  4943 consensus_meta.cc:287] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.012s
W20260709 13:00:26.250451  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.029578  4960 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:26.016741  4787 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:26.080858  4976 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:00:26.323139  4907 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:26.090941  4728 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:25.978574  4864 consensus_queue.cc:1059] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.293s
I20260709 13:00:26.250327  4747 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:26.248019  4849 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.340699  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:25.923540  4855 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.247452  4904 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.253s
I20260709 13:00:26.372020  1615 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:26.340241  4655 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:26.397619  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:26.406834  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.354578  4721 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:26.443087  4725 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:26.443542  4725 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:26.443926  4725 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.372306  4787 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:26.439344  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 98713.9us
I20260709 13:00:26.451313  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.452440  1584 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.453433  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.454380  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:26.455753  4864 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.360917  4943 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.456761  4728 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.456926  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1972) took 2102 ms. Trace:
I20260709 13:00:26.458485  1689 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:26.457897  4747 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.360565  4898 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.457976  4943 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:26.457355  1619 rpcz_store.cc:276] 0709 13:00:24.354140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.068241 (+714101us) service_pool.cc:224] Handling call
0709 13:00:25.068493 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:25.774843 (+706350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.774881 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:25.775291 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.247275 (+471984us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:26.247330 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.247394 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.456742 (+209348us) raft_consensus.cc:1685] finished
0709 13:00:26.456761 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.456878 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":705925,"raft.queue_time_us":725469,"raft.run_cpu_time_us":40,"raft.run_wall_time_us":40,"thread_start_us":419193,"threads_started":1,"wal-append.queue_time_us":646802}
I20260709 13:00:26.464782  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.450942  4655 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:26.466096  4864 consensus_queue.cc:1059] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:00:26.519899  4855 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:26.463753  4728 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.395596  4907 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:26.527627  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.534904  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:26.524343  4935 consensus_meta.cc:287] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.059s	user 0.006s	sys 0.009s
I20260709 13:00:26.553668  2272 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:26.525665  4728 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:26.529896  4855 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.559880  4728 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.567088  4655 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:26.568140  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2399) took 1033 ms. Trace:
W20260709 13:00:26.569242  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 104513us
I20260709 13:00:26.568972  1689 rpcz_store.cc:276] 0709 13:00:25.550400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.550548 (+   148us) service_pool.cc:224] Handling call
0709 13:00:25.550880 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.458955 (+908075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.567919 (+108964us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54001d06d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:26.568083 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086624640}
I20260709 13:00:26.570358  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.572152  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.575378  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:26.576237  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:26.556849  4935 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.581209  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:26.581833  1619 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 3.
I20260709 13:00:26.582731  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:26.584026  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:26.584587  1611 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:26.589509  4754 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.592730  4907 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:26.597463  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 1975) took 2235 ms. Trace:
I20260709 13:00:26.597837  1612 rpcz_store.cc:276] 0709 13:00:24.361735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.151673 (+789938us) service_pool.cc:224] Handling call
0709 13:00:25.616262 (+464589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.623579 (+  7317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.597283 (+973704us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54001a40d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:26.597409 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959473408}
I20260709 13:00:26.599647  1618 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.582873  4747 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:26.603718  4906 raft_consensus.cc:3055] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:26.604851  1612 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:26.604136  4906 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:26.610128  4906 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:26.611645  4906 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.612869  4725 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.618839  4898 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:26.620280  4930 consensus_meta.cc:287] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.808s	user 0.008s	sys 0.001s
W20260709 13:00:26.620888  4983 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.692s	user 0.011s	sys 0.007s
I20260709 13:00:26.620654  4930 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:26.622980  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:26.624424  1612 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:26.629989  4982 log.cc:927] Time spent T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.615s	user 0.000s	sys 0.009s
I20260709 13:00:26.629873  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:26.630160  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:26.630632  2276 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:26.631448  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 603528us
I20260709 13:00:26.632371  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:26.632476  4828 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.632781  4900 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:26.633183  4900 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:26.633415  2275 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:26.633942  4900 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.635844  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:26.636303  4858 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:26.636646  4858 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:26.636812  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.637377  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.638908  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2396) took 1104 ms. Trace:
I20260709 13:00:26.639077  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2402) took 1079 ms. Trace:
I20260709 13:00:26.640787  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:26.642072  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:26.643365  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:26.644170  1612 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:26.637411  4858 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.646173  4858 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.639256  1686 rpcz_store.cc:276] 0709 13:00:25.534069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.534184 (+   115us) service_pool.cc:224] Handling call
0709 13:00:25.534473 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.534704 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:25.630598 (+ 95894us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.754368 (+123770us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b48000b10d8. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f0cceaa1 00007f29f0cc5b37 00007f29f0cc59ca 00007f29f0dbd26f 00007f29f0dbcf37 00007f29f0dd155c 00007f29f0dd1508 00007f29f0dd1488 00007f29f0dd1443 00007f29f0dd06ec 00007f29efcfaa96
0709 13:00:25.755224 (+   856us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.009014 (+253790us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b1800440680. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:26.629102 (+620088us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b1800440680. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c32c0a 00007f29f2372219 00007f29efc7958f 00007f29e8cb8571 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd
0709 13:00:26.630570 (+  1468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:26.630617 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:26.630663 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.638775 (+  8112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.638864 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":940366,"prepare.queue_time_us":108598,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":890994,"raft.run_cpu_time_us":2352,"raft.run_wall_time_us":9552,"spinlock_wait_cycles":42196992,"thread_start_us":192665,"threads_started":2,"wal-append.queue_time_us":174975}
I20260709 13:00:26.622484  4930 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:26.647845  1619 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:26.648694  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:26.649153  1544 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:26.639432  1685 rpcz_store.cc:276] 0709 13:00:25.559723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.647345 (+ 87622us) service_pool.cc:224] Handling call
0709 13:00:25.647693 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:25.648302 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.648324 (+    22us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:25.648799 (+   475us) log.cc:844] Serialized 52 byte log entry
0709 13:00:25.740362 (+ 91563us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:25.806030 (+ 65668us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.638820 (+832790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.638880 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.638916 (+    36us) raft_consensus.cc:1685] finished
0709 13:00:26.638929 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.639032 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":834323,"prepare.queue_time_us":69004,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":6584,"raft.queue_time_us":90,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":75172,"threads_started":1,"wal-append.queue_time_us":178697}
I20260709 13:00:26.650097  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.580219  4855 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:26.654574  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:26.655494  1543 raft_consensus.cc:3055] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:26.656653  1543 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:26.657408  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:26.654794  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 774923us
I20260709 13:00:26.657336  1543 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.697094  1543 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:26.696187  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 64098.9us
I20260709 13:00:26.662108  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:26.661741  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:26.646636  4747 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:26.707693  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:26.709170  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 70409.5us
I20260709 13:00:26.671201  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:26.639093  4879 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:26.649113  4898 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:26.653517  4660 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.719413  2243 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.716784  4725 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:26.708051  4846 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:26.654048  4995 consensus_queue.cc:1059] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:00:26.729365  2243 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.729605  4995 raft_consensus.cc:3055] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:26.729955  4995 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:26.730361  4846 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:26.652405  4953 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.731827  4953 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.732168  4953 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.733747  4897 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:26.701089  4900 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.734441  4897 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:26.735975  4935 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:26.736095  4897 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:26.738924  4721 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:26.648589  4726 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:00:26.740187  4721 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.740603  4721 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:26.746198  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.750854  4721 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:26.754849  4986 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:26.750901  4953 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:26.755992  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2406) took 1190 ms. Trace:
I20260709 13:00:26.655776  4973 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.659375  4828 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.649544  4907 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:00:26.756726  4953 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:26.718837  4747 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.756348  1692 rpcz_store.cc:276] 0709 13:00:25.565917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.685112 (+119195us) service_pool.cc:224] Handling call
0709 13:00:25.695820 (+ 10708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:25.704253 (+  8433us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:25.718451 (+ 14198us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.652535 (+934084us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.652919 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.653079 (+   160us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:26.653101 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.653184 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.755819 (+102635us) raft_consensus.cc:1685] finished
0709 13:00:26.755840 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.755941 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":926619,"prepare.queue_time_us":16218,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":842197,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":8608,"thread_start_us":93661,"threads_started":1,"wal-append.queue_time_us":206436}
I20260709 13:00:26.759863  4747 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:26.760972  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.760881  4781 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.718997  4743 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:00:26.763098  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:26.763655  4942 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:26.764218  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:26.765295  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:26.701978  4920 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:26.769112  1541 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:26.769192  4765 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:26.770345  4765 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:26.770517  4919 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:26.771111  4919 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:26.772095  1613 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:26.772643  1613 pending_rounds.cc:85] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 6
I20260709 13:00:26.772017  4919 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:26.772900  1613 pending_rounds.cc:107] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:26.773247  1613 raft_consensus.cc:2889] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:26.773407  4919 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:26.762571  1539 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:26.775736  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 115335us
I20260709 13:00:26.776170  4660 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:26.781050  1612 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:26.781522  2276 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:26.785663  1612 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:26.787271  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.785745  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.788102  1543 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:00:26.788493  1543 pending_rounds.cc:85] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 5
I20260709 13:00:26.788942  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:26.789489  2275 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.790573  1543 pending_rounds.cc:107] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:00:26.790983  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:26.791201  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 120051us
I20260709 13:00:26.790870  4915 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:26.784610  4995 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.793740  4781 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:26.789076  4728 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.778554  4660 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:26.799059  1543 raft_consensus.cc:2889] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:26.804978  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 67244.4us
I20260709 13:00:26.827387  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:26.828586  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.829046  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:26.808197  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:26.830272  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.831384  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.832194  1538 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:26.809006  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:26.809940  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:26.823592  4915 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.833665  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:26.786865  4758 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.834952  4758 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:26.810906  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:26.838995  1691 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:26.830240  1689 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:26.833271  1686 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:26.752031  4787 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.822943  1539 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:26.843055  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:26.845891  2275 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:26.848227  1690 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:26.848886  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 145553us
I20260709 13:00:26.820200  4655 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:26.851289  4935 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:26.852392  4915 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:26.852602  4660 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:26.856498  4991 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260709 13:00:26.856976  4787 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:26.859691  1688 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:26.861022  1620 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:00:26.861727  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2408) took 1268 ms. Trace:
I20260709 13:00:26.862058  1688 rpcz_store.cc:276] 0709 13:00:25.592939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.766198 (+173259us) service_pool.cc:224] Handling call
0709 13:00:25.766454 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.860061 (+1093607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.861501 (+  1440us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540010a4d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:26.861665 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2513182592}
I20260709 13:00:26.863035  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:26.863365  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:26.864133  1620 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.865012  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 946) took 1458 ms. Trace:
I20260709 13:00:26.865373  2271 rpcz_store.cc:276] 0709 13:00:25.406340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.406445 (+   105us) service_pool.cc:224] Handling call
0709 13:00:26.864856 (+1458411us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54005de8d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:26.864962 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729080704}
W20260709 13:00:26.866930  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.853120  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:26.863586  1612 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:26.868499  4946 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.868744  4773 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:26.869184  4773 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.868966  4946 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.869516  4773 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.871018  1620 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:26.871905  4728 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:26.818117  4725 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.854616  1509 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:26.870285  1690 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
W20260709 13:00:26.874851  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 681) took 1470 ms (client timeout 1621 ms). Trace:
I20260709 13:00:26.875346  4817 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:26.876400  4655 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:26.824052  4940 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:26.825577  4933 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.878113  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:26.879944  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:26.875233  1544 rpcz_store.cc:269] 0709 13:00:25.404194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.404536 (+   342us) service_pool.cc:224] Handling call
0709 13:00:26.874624 (+1470088us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400355054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:26.874771 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2860062976}
I20260709 13:00:26.876775  4655 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:26.876380  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:26.893507  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.889372  1612 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:26.891912  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:26.904712  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:26.905501  1688 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:26.912869  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:26.912987  5011 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:26.914078  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:26.890471  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:26.890952  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:26.885460  4995 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.893214  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.920768  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:26.843910  4918 consensus_queue.cc:1059] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:00:26.927241  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:26.927911  1541 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.927724  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:26.918311  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.917085  1511 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:26.928669  1688 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:26.928701  1544 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:26.929973  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:26.877306  4765 consensus_queue.cc:1059] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:26.903416  4726 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.882715  4920 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:26.909833  4943 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:26.933614  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.937412  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:26.938047  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.873014  4725 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:26.888777  4660 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:00:26.940498  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.941293  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:26.929610  4953 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:26.946790  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 50551.2us
I20260709 13:00:26.958964  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:26.960464  2269 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:26.909615  4799 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:00:26.890412  4933 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:26.947978  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:26.977141  1688 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:26.962913  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.963034  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.978070  1539 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:26.978843  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:26.980353  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.981695  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:26.964308  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:26.982575  1540 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:26.984882  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.936062  4726 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.975323  2276 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:26.917019  4940 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:00:26.941805  4930 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:26.939952  4781 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:26.957674  1541 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:26.987685  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:26.987974  2276 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:26.988142  4906 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:26.989517  4725 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:27.048264  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 60601.9us
I20260709 13:00:26.992183  2273 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEARNER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:26.962213  4915 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:27.050407  4915 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:27.050637  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:27.050915  4915 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:27.032200  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.991412  2269 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:27.051872  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:27.051162  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:26.973291  4707 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:27.052763  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 138786us
I20260709 13:00:27.053678  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:26.975504  4943 raft_consensus.cc:3055] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:26.985440  4935 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:26.990443  4726 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:27.072263  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:27.079941  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:27.081499  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:27.087380  2268 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:26.986517  4754 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:26.992168  4855 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:27.046778  4781 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.990550  4846 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:27.048020  4728 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:27.071028  4707 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.073350  4930 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:27.099072  1510 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:27.108522  1510 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:27.074622  4864 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:27.075654  4725 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:27.069876  4996 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:27.075024  4943 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:27.092090  4906 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:27.102710  4781 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:27.093058  4660 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.089877  4901 consensus_queue.cc:1059] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:00:27.105402  4846 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:27.107702  4707 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:27.179791  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 126359us
I20260709 13:00:27.117661  4855 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.106106  4904 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.091465  4773 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:27.118427  4898 raft_consensus.cc:3055] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:27.208031  4997 log.cc:927] Time spent T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:00:27.090505  4655 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.210268  1660 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:27.207019  4943 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:27.242883  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.151217  4906 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:27.179970  4996 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.205718  4754 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:27.238828  5018 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.257439  5013 raft_consensus.cc:3055] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:27.146068  4811 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:00:27.184216  4846 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:27.261181  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 152696us
I20260709 13:00:27.147037  4974 consensus_queue.cc:1059] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:00:27.190908  4855 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:27.305469  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 95258.4us
W20260709 13:00:27.304804  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.194475  4898 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:27.184022  4660 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:27.265040  5017 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:00:27.350894  4773 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:27.351557  4773 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:27.351848  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:27.352414  1689 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:27.302093  5008 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 13:00:27.276299  5013 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:27.194473  4904 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.302305  4655 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:27.264559  4953 raft_consensus.cc:697] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:27.371423  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.385809  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:27.381484  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 69527.5us
I20260709 13:00:27.390420  4935 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:27.390873  4935 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:27.391134  1694 raft_consensus.cc:2410] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:27.352032  4773 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.394363  4773 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.394888  4773 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:27.395435  4773 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.395824  4773 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:27.396528  5004 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.484s	user 0.002s	sys 0.010s
I20260709 13:00:27.388455  4758 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:27.398912  4758 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:27.399356  4758 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.401183  4758 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.311120  4725 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:27.405025  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:27.347493  4974 consensus_queue.cc:1243] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:27.408571  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:27.415656  1659 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:27.417703  4898 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.419305  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:27.421341  5016 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:27.421720  4888 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:27.422107  5036 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:27.425315  4935 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.431030   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:27.431617  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 659) took 1428 ms. Trace:
I20260709 13:00:27.452481  1613 rpcz_store.cc:276] 0709 13:00:26.002941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.005127 (+  2186us) service_pool.cc:224] Handling call
0709 13:00:26.005383 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.773768 (+768385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.430664 (+656896us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54001711d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:27.431541 (+   877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762163968}
I20260709 13:00:27.431077  4953 consensus_queue.cc:237] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:27.265496  4996 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:27.432215  4855 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.433342  1614 pending_rounds.cc:85] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 7
I20260709 13:00:27.433441  1689 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:27.463501  1614 pending_rounds.cc:107] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:27.463892  1614 raft_consensus.cc:2889] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:27.464313  1689 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:27.433636  5027 consensus_queue.cc:1059] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:00:27.471794  4773 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.471946  4808 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:27.472465  5027 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:27.472414  4828 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:27.472976  5027 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:27.473753  5027 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.475498  2274 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:27.476737  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:27.477712  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:27.315680  4930 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:27.479596  4999 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.563s	user 0.005s	sys 0.000s
W20260709 13:00:27.434168  4858 consensus_meta.cc:287] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.784s	user 0.005s	sys 0.002s
I20260709 13:00:27.434513  4933 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.385344  4943 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:27.435271  4904 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:27.436522  4817 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:27.438815  4754 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.440987  4907 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:27.448251  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:27.443732  4997 log.cc:927] Time spent T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:00:27.465402  1694 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:27.465871  1689 pending_rounds.cc:85] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 7
I20260709 13:00:27.462222  5036 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:27.308108  5018 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.469508  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:27.470294  2270 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:27.470387  5029 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:00:27.470816  4864 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:27.520182  5033 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:27.520329  4864 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.471256  5030 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:27.471387  5022 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:00:27.483736  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2410) took 1708 ms. Trace:
I20260709 13:00:27.449112  4888 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.455977  4799 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:27.485762  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:27.485494  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:27.495292  5045 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:27.416078  4725 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:27.505560  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 57382.6us
I20260709 13:00:27.506270  5037 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:27.483603  4919 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.710s	user 0.002s	sys 0.010s
I20260709 13:00:27.512840  1689 pending_rounds.cc:107] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:27.546901  1689 raft_consensus.cc:2889] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:27.488483  4879 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.001s
W20260709 13:00:27.512818  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 163273us
I20260709 13:00:27.486429  4855 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:27.535923  5011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.005s	sys 0.022s
I20260709 13:00:27.485637  5039 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:27.553325  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:27.537238  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:27.460497  4906 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.507000  4817 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:27.530066  4888 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:27.488368  5027 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:27.520354  5024 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:27.558882  2272 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:27.528304  5028 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:27.519171  4915 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:27.546427  5000 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
W20260709 13:00:27.551999  5011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.005s	sys 0.023s
I20260709 13:00:27.563090  5024 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:27.563189  4846 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.546607  4799 raft_consensus.cc:697] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:27.568257  4726 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.577009  5024 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:27.530997  5030 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.538061  5045 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.551903  4879 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:27.585873  5045 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.585888  4996 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:27.585892  5030 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.554292  4855 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:27.561604  5016 consensus_queue.cc:1059] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:00:27.574644  5042 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.575163  4945 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:27.575980  4846 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.576251  4915 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:27.558173  5039 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.558087  4930 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:00:27.584992  5036 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:27.483704  5013 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:27.589880  4935 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.591367  5018 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.588184  4946 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.580897  5028 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.601684  5028 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:27.602115  4995 consensus_meta.cc:287] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.672s	user 0.002s	sys 0.008s
I20260709 13:00:27.602241  5013 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.605010  5039 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.607017  5037 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:27.597070  5042 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:27.635548  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 107143us
I20260709 13:00:27.531401  1540 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
W20260709 13:00:27.525167  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 134230us
I20260709 13:00:27.515131  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:27.642602  1542 raft_consensus.cc:2368] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:27.643736  1543 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
W20260709 13:00:27.647486  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 161946us
I20260709 13:00:27.653435  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:27.656287  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:27.659471  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:27.661180  1543 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:27.536639  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:27.550458  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:27.525642  1687 rpcz_store.cc:276] 0709 13:00:25.775294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.874957 (+ 99663us) service_pool.cc:224] Handling call
0709 13:00:25.875287 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.654783 (+779496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.654812 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.661443 (+  6631us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.886452 (+225009us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:26.886486 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.886547 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:27.478993 (+592446us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:27.480753 (+  1760us) raft_consensus.cc:1685] finished
0709 13:00:27.480780 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.483671 (+  2891us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":779086,"raft.queue_time_us":779638,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":38361,"spinlock_wait_cycles":26179456,"thread_start_us":224732,"threads_started":1,"wal-append.queue_time_us":254383}
I20260709 13:00:27.696206  4660 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.563591  4817 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:27.548010  4811 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:00:27.570923  4864 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.697553  4726 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:27.747269  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:27.901311  4907 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:28.029311  1614 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:27.894114  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.029804  4907 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:28.030871  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.031032  4846 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.720793  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 651) took 1881 ms. Trace:
I20260709 13:00:27.900094  4995 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:27.800994  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 138759us
I20260709 13:00:27.983932  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:27.815361  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 265672us
W20260709 13:00:27.796566  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 59461.7us
I20260709 13:00:27.837844  1692 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:27.891762  4950 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 13:00:27.902148  5030 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:27.746167  1687 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:27.890973  1691 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:27.581034  4754 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:28.076252  4754 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:27.814610  1690 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:27.796162  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:27.837258  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 287441us
I20260709 13:00:27.954643  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:27.751776  5056 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:28.071281  4995 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:27.799228  4781 consensus_meta.cc:287] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.010s
I20260709 13:00:28.073266  5030 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.074375  1620 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 4.
I20260709 13:00:28.075112  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:27.900851  5055 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:27.745399  2277 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:27.752219  4725 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:27.697763  5042 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:28.065969  1692 pending_rounds.cc:85] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 7
I20260709 13:00:28.118409  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 640) took 1293 ms. Trace:
I20260709 13:00:28.101102  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 644) took 1256 ms. Trace:
I20260709 13:00:28.118916  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 642) took 1298 ms. Trace:
I20260709 13:00:28.120380  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:28.123031  1691 rpcz_store.cc:276] 0709 13:00:26.820835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.839215 (+1018380us) service_pool.cc:224] Handling call
0709 13:00:27.880505 (+ 41290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.070109 (+189604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.076942 (+  6833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.121747  1687 rpcz_store.cc:276] 0709 13:00:26.813707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.697798 (+884091us) service_pool.cc:224] Handling call
0709 13:00:27.699453 (+  1655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.077109 (+377656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.106872 (+ 29763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.123171  1690 rpcz_store.cc:276] 0709 13:00:26.820290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.813366 (+993076us) service_pool.cc:224] Handling call
0709 13:00:27.813914 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.117385 (+303471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.118863 (+  1478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.128724  4879 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.064298  1616 rpcz_store.cc:276] 0709 13:00:25.812310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.837870 (+ 25560us) service_pool.cc:224] Handling call
0709 13:00:26.567279 (+729409us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:00:26.567487 (+   208us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:26.568789 (+  1302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.568815 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:26.571217 (+  2402us) log.cc:844] Serialized 52 byte log entry
0709 13:00:26.895807 (+324590us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:26.919805 (+ 23998us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.926888 (+  7083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.926953 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:27.667094 (+740141us) raft_consensus.cc:1685] finished
0709 13:00:27.667221 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.693304 (+ 26083us) inbound_call.cc:177] Queueing success response
0709 13:00:27.810192 (+116888us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18002dcd00. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
Metrics: {"mutex_wait_us":100657,"prepare.queue_time_us":31008,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":1623,"raft.queue_time_us":12025,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":1569,"spinlock_wait_cycles":51330688,"thread_start_us":188411,"threads_started":1,"wal-append.queue_time_us":320729}
I20260709 13:00:28.129500  4879 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.130424  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:28.131898  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:28.132340  4879 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:28.132555  1616 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
W20260709 13:00:28.129531  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.101802  4754 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.135325  1543 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:28.137254  5055 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.139014  5041 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:28.139721  5027 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:28.140544  1617 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:28.142022  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:28.143044  1613 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:28.143831  4846 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.145821  1539 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:28.147662  1536 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:28.148859  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:28.155234  2275 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:28.155752  4707 consensus_meta.cc:287] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.964s	user 0.000s	sys 0.019s
I20260709 13:00:27.806998  4855 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:27.838846  5016 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.156502  1540 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:27.837702  5037 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:28.119741  5056 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.156594  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:28.076844  4813 raft_consensus.cc:3055] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:28.136044  1692 pending_rounds.cc:107] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:27.718559  4655 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.492s
I20260709 13:00:27.816399  5043 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.343s
W20260709 13:00:28.223981  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.509131  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.208069  1537 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:28.207959  1541 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:28.568650  1692 raft_consensus.cc:2889] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:28.568150  1620 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:28.419831  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 639) took 1585 ms. Trace:
I20260709 13:00:28.574783  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 671) took 1052 ms. Trace:
I20260709 13:00:28.159617  1584 leader_election.cc:400] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:28.576872  1584 leader_election.cc:403] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:28.218139  4943 consensus_meta.cc:287] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.727s	user 0.014s	sys 0.000s
I20260709 13:00:28.575443  1613 rpcz_store.cc:276] 0709 13:00:27.517045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.142249 (+625204us) service_pool.cc:224] Handling call
0709 13:00:28.142656 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.549716 (+407060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.568989 (+ 19273us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:28.589495  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.207895  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2451) took 1327 ms. Trace:
I20260709 13:00:28.575929  4906 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:28.134181  4781 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.468860  5039 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.209456  5055 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:28.606007  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.161032  4879 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.568535  5056 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:27.721025  4799 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.573030  1689 rpcz_store.cc:276] 0709 13:00:26.813474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.465286 (+651812us) service_pool.cc:224] Handling call
0709 13:00:27.465646 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:27.815668 (+350022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.815750 (+    82us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:27.816932 (+  1182us) log.cc:844] Serialized 52 byte log entry
0709 13:00:28.122222 (+305290us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:28.122261 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.134818 (+ 12557us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.398518 (+263700us) raft_consensus.cc:1685] finished
0709 13:00:28.398535 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.398734 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264921,"raft.queue_time_us":266474,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":215,"thread_start_us":300783,"threads_started":1,"wal-append.queue_time_us":579103}
I20260709 13:00:28.610316  5016 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.571439  4813 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:28.611330  1613 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:28.612072  5036 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:28.612808  1615 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:28.613081  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 546357us
I20260709 13:00:28.613714  5049 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:28.614208  1585 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.659s (SENT) [suppressed 33 similar messages]
I20260709 13:00:28.614590  4933 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.221931  4660 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.610975  4995 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:28.609807  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 645) took 1788 ms. Trace:
I20260709 13:00:28.507727  5058 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.630863  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 675) took 1098 ms. Trace:
I20260709 13:00:28.633360  1692 rpcz_store.cc:276] 0709 13:00:26.821113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.836522 (+1015409us) service_pool.cc:224] Handling call
0709 13:00:27.837073 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.607197 (+770124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.609755 (+  2558us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:28.614949  4888 consensus_meta.cc:287] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.036s	user 0.003s	sys 0.010s
I20260709 13:00:28.477800  5041 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.612079  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:28.634996  1613 rpcz_store.cc:276] 0709 13:00:27.528555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.610697 (+1082142us) service_pool.cc:224] Handling call
0709 13:00:28.611080 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.626217 (+ 15137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.626422 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.614969  4811 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.660799  4930 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.659744  5027 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.661420  4930 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.591405  1612 rpcz_store.cc:276] 0709 13:00:26.880211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.352127 (+471916us) service_pool.cc:224] Handling call
0709 13:00:27.352435 (+   308us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:27.352816 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.352846 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:27.353501 (+   655us) log.cc:844] Serialized 78 byte log entry
0709 13:00:27.507820 (+154319us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:27.532197 (+ 24377us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.034993 (+502796us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.159412 (+124419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.207348 (+ 47936us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.207431 (+    83us) raft_consensus.cc:1685] finished
0709 13:00:28.207448 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.207674 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39714,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":107,"raft.queue_time_us":85646,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":21242,"thread_start_us":399064,"threads_started":2,"wal-append.queue_time_us":182017}
I20260709 13:00:28.634136  5030 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:28.635907  5055 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.596091  4707 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.667335  4781 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:28.685530  4721 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.689549  1620 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:28.698832  4995 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:28.699754  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 677) took 1163 ms. Trace:
I20260709 13:00:28.699546  4995 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.700192  4951 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.700843  4951 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.701782  4995 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:28.700132  1612 rpcz_store.cc:276] 0709 13:00:27.536598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.686597 (+1149999us) service_pool.cc:224] Handling call
0709 13:00:28.699098 (+ 12501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.699429 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.699459 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.699520 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:28.699554 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.699598 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.699689 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:28.703893  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 50454.8us
I20260709 13:00:28.703974  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:28.695844  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:28.715523  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 673) took 1179 ms. Trace:
I20260709 13:00:28.715977  1620 rpcz_store.cc:276] 0709 13:00:27.517607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.597173 (+1079566us) service_pool.cc:224] Handling call
0709 13:00:28.660334 (+ 63161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.694826 (+ 34492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.696728 (+  1902us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.669520  4888 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.693596  4660 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.667943  4906 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.689234  5030 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:28.742524  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 669) took 1230 ms. Trace:
W20260709 13:00:28.735122  5006 log.cc:927] Time spent T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.643s	user 0.000s	sys 0.002s
I20260709 13:00:28.742264  1620 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:00:28.691246  4879 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.760318  1616 rpcz_store.cc:276] 0709 13:00:27.512175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.136477 (+624302us) service_pool.cc:224] Handling call
0709 13:00:28.136993 (+   516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.137565 (+   572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.137595 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.138122 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.593294 (+455172us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:28.593318 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.593366 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.742309 (+148943us) raft_consensus.cc:1685] finished
0709 13:00:28.742328 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.742458 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1154,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":268,"thread_start_us":454770,"threads_started":1,"wal-append.queue_time_us":601831}
W20260709 13:00:28.732909  5064 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:00:28.736717  5009 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.748s	user 0.000s	sys 0.004s
W20260709 13:00:28.737066  5003 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.824s	user 0.001s	sys 0.001s
I20260709 13:00:28.746083  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:28.732411  4888 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:28.743511  5002 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 1.832s	user 0.005s	sys 0.000s
I20260709 13:00:28.687741  4811 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.670795  5049 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:28.732355  5005 log.cc:927] Time spent T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 1.813s	user 0.000s	sys 0.001s
W20260709 13:00:28.733740  5070 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:00:28.738369  5007 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.749s	user 0.004s	sys 0.006s
I20260709 13:00:28.845299  2276 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.736043  4846 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:28.750142  4660 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:28.735479  5016 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:28.689026  5039 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.743229  5041 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:28.686599  4933 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.732954  5036 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.868815  4707 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:28.730067  5058 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:28.845558  5030 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.745054  5050 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:28.730654  4787 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:28.883108  4817 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:28.738791  4721 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:28.930361  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 451349us
I20260709 13:00:28.910805  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2454) took 1256 ms. Trace:
I20260709 13:00:28.911438  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:28.913486  1614 consensus_meta.cc:287] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.005s
I20260709 13:00:28.931617  1614 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:28.916723  4813 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:28.935899  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 230416us
I20260709 13:00:28.931393  1620 rpcz_store.cc:276] 0709 13:00:27.658438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.725589 (+1067151us) service_pool.cc:224] Handling call
0709 13:00:28.741938 (+ 16349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.829179 (+ 87241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.910736 (+ 81557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.920367  4888 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:28.938277  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2457) took 1272 ms (client timeout 1575 ms). Trace:
I20260709 13:00:28.941540  1613 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:00:28.942521  1614 rpcz_store.cc:269] 0709 13:00:27.659751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.746506 (+ 86755us) service_pool.cc:224] Handling call
0709 13:00:28.932165 (+1185659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.927888  4907 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:28.929311  5050 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:28.946978  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:28.951207  1540 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
W20260709 13:00:28.959264  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.961341  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.955001  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:28.961732  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:28.967939  1541 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:28.943754  4846 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:28.971637  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:28.972394  1543 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:28.973067  5058 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:28.973239  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:28.973928  1543 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.974807  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2436) took 2341 ms. Trace:
I20260709 13:00:28.975155  1611 rpcz_store.cc:276] 0709 13:00:26.575907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.585108 (+  9201us) service_pool.cc:224] Handling call
0709 13:00:26.585337 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.647818 (+ 62481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.647849 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.651931 (+  4082us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.911379 (+259448us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:27.043073 (+131694us) log.cc:844] Serialized 14 byte log entry
0709 13:00:27.043312 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.043393 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.705487 (+1662094us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:28.917366 (+211879us) raft_consensus.cc:1685] finished
0709 13:00:28.917464 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.917611 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36900,"prepare.queue_time_us":48554,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":31171,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":26071,"spinlock_wait_cycles":51310720,"thread_start_us":252095,"threads_started":2,"wal-append.queue_time_us":194106}
I20260709 13:00:28.977279  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:28.977797  2276 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:28.978107  1611 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:28.979030  5075 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:28.980192  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:28.980324  4660 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.980772  4660 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:28.983868  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:28.984519  1614 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:28.985497  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:28.984786  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:28.960597  4888 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:28.986652  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:28.997020  1614 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
W20260709 13:00:28.987766  2272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 875) took 2358 ms (client timeout 1659 ms). Trace:
I20260709 13:00:28.988492  4765 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:28.998973  4906 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:28.999030  4765 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:28.999619  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 672) took 1482 ms. Trace:
I20260709 13:00:29.000185  4765 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.001268  4765 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.001722  4898 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.990103  2268 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:28.998330  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:28.986804  2276 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:29.006901  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:28.998796  2272 rpcz_store.cc:269] 0709 13:00:26.629272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.649485 (+ 20213us) service_pool.cc:224] Handling call
0709 13:00:28.987399 (+2337914us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540046e6d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:28.987579 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805715328}
I20260709 13:00:29.000028  1615 rpcz_store.cc:276] 0709 13:00:27.517361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.147413 (+630052us) service_pool.cc:224] Handling call
0709 13:00:28.147852 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.625888 (+478036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.999366 (+373478us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b540026edd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:28.999550 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23808384}
I20260709 13:00:28.992290  1536 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:28.995368  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 916) took 2050 ms. Trace:
I20260709 13:00:28.988744  4888 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.012054  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 693) took 2170 ms. Trace:
W20260709 13:00:28.998288  4754 consensus_meta.cc:287] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.000s
I20260709 13:00:29.012745  4754 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.012490  1538 rpcz_store.cc:276] 0709 13:00:26.841885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.842222 (+   337us) service_pool.cc:224] Handling call
0709 13:00:26.842495 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.842709 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.842735 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.846986 (+  4251us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.975762 (+128776us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:26.975826 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.975916 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.735675 (+1759759us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:29.002491 (+266816us) raft_consensus.cc:1685] finished
0709 13:00:29.002508 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.011823 (+  9315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137581312,"thread_start_us":107756,"threads_started":1,"wal-append.queue_time_us":137492}
I20260709 13:00:29.015149  4754 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:28.991875  2241 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:29.015867  4916 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:28.970157  4787 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.019254  4787 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:28.991122  5030 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.020007  4787 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:29.012089  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:29.022503  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 662) took 2242 ms. Trace:
I20260709 13:00:29.022894  1619 rpcz_store.cc:276] 0709 13:00:26.780154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.780261 (+   107us) service_pool.cc:224] Handling call
0709 13:00:26.780552 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.780839 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.780866 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.784297 (+  3431us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.915329 (+131032us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:26.915381 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.915469 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.731506 (+1816037us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:29.022091 (+290585us) raft_consensus.cc:1685] finished
0709 13:00:29.022117 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.022357 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3630,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3960,"spinlock_wait_cycles":10698624,"thread_start_us":126214,"threads_started":1,"wal-append.queue_time_us":126559}
I20260709 13:00:29.025307  1619 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:29.014487  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:29.027052  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:28.988377  4846 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.027549  5049 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.029140  4846 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:28.993088  4817 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.032281  1620 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:28.996197  2275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 958) took 1527 ms (client timeout 1701 ms). Trace:
I20260709 13:00:29.019141  5077 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:29.038501  1617 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:29.040823  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 670) took 1528 ms. Trace:
W20260709 13:00:29.035068  2275 rpcz_store.cc:269] 0709 13:00:27.469159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.469295 (+   136us) service_pool.cc:224] Handling call
0709 13:00:28.995996 (+1526701us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54004c8454. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:28.996134 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472076672}
I20260709 13:00:28.976040  5050 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.041234  1617 rpcz_store.cc:276] 0709 13:00:27.512410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.074443 (+562033us) service_pool.cc:224] Handling call
0709 13:00:29.040763 (+966320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.983906  4660 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.010596  2277 rpcz_store.cc:276] 0709 13:00:26.945024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.945193 (+   169us) service_pool.cc:224] Handling call
0709 13:00:26.945447 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.157128 (+1211681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.995129 (+838001us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400586bd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:28.995299 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718786304}
I20260709 13:00:29.048756  1543 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:29.045157  1614 raft_consensus.cc:2410] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 12 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 13:00:28.990134  4933 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:28.989094  4879 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:29.053706  4817 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.044314  4787 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:00:29.055435  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.072528  1536 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:29.056222  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.056824  5018 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.056479  5081 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.058792  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:28.992013  4721 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:28.979702  5075 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:29.062942  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.990445  4808 consensus_queue.cc:1059] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:00:28.993613  4683 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 13:00:29.086088  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 103025us
I20260709 13:00:29.090087  2241 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:29.094900  4855 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:29.095366  5050 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.096114  4808 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:29.096587  4808 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:29.091768  4811 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.095417  4855 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:29.097612  4808 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.098186  4855 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.098737  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.102743  4754 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.103286  4754 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:29.104969  4912 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:29.105553  4912 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.108457  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.109987  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:29.111157  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.111766  1619 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:29.112584  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.112255  5018 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.113399  1619 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:29.114199  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.113862  5081 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.114921  5058 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:29.115532  5058 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.095427  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.117251  1541 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:29.118018  5030 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.118590  5030 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.121806  5036 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.122885  5039 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.123414  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 676) took 1589 ms. Trace:
I20260709 13:00:29.123837  1613 rpcz_store.cc:276] 0709 13:00:27.534575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.670254 (+1135679us) service_pool.cc:224] Handling call
0709 13:00:28.932519 (+262265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.943206 (+ 10687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.123234 (+180028us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540036d150. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:29.123353 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542319872}
I20260709 13:00:29.126261  1538 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:29.082643  5055 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:29.127887  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.128976  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.130159  5079 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.130831  4660 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.130959  5041 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.131475  5041 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.132813  4726 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:29.133072  1510 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:29.134277  4846 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:29.134804  4846 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.134956  4817 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:29.135295  4846 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.135533  4817 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:29.136629  5055 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:29.137250  5055 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.137696  5055 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.131475  4660 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.144225  5079 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.130188  4943 raft_consensus.cc:3055] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:29.146294  4943 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:29.147367  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 57331.7us
I20260709 13:00:29.136732  4817 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.149585  4951 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.150193  4683 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:29.150713  4683 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.151116  4683 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.154145  4879 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:29.130319  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.157220  1617 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:29.091231  1511 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.161556  1619 raft_consensus.cc:2410] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:29.155035  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:29.171487  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.173310  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:29.178354  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 99673us
I20260709 13:00:29.178455  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.154641  4879 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:29.182586  1542 raft_consensus.cc:2393] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:29.180377  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:29.169552  4888 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.184734  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.171996  4781 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:29.179283  4721 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:29.187886  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.194909  1544 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:29.199025  4728 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:29.191416  5030 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.178872  4995 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:29.200570  4995 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.203565  4879 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.205272  4879 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.207710  5058 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.208110  4912 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.189817  4781 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.210146  4781 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.192397  4721 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.211171  4721 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.212517  4930 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:29.214174  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.216209  4813 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.218075  4942 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.218210  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.218531  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.219813  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:29.220682  5056 consensus_meta.cc:287] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.006s
I20260709 13:00:29.199204  4660 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.221056  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.221876  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.199640  4728 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.225636  1614 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:29.187546  4808 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.187690  4655 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:28.654904   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:29.248308  1613 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:00:29.258457  5081 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.258775  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.259477  2270 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:29.260375  5041 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.264307  5018 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.224347  4754 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:29.226411  5039 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:29.273219  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 351) took 10791 ms. Trace:
I20260709 13:00:29.229241  4728 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.275032  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.275569  4995 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.275782  1619 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
W20260709 13:00:29.276147  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 96224.6us
I20260709 13:00:29.276925  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:29.278057  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.218559  4942 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.280810  4942 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.278851  5079 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.282516  5079 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:29.283037  5079 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:29.283484  5079 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.284544  5041 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:29.284972  5041 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.285326  5041 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.286926  5018 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.287521  5018 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.288812  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.289989  5018 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.290053  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.290979  2272 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:29.290853  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.291683  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.291940  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.292280  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.292647  2268 raft_consensus.cc:2376] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9. Re-sending same reply.
I20260709 13:00:29.292910  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.293313  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.293464  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.294101  2274 raft_consensus.cc:2410] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:29.291887  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.278481  1619 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:29.249154  1539 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
W20260709 13:00:29.295887  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.294018  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.294988  2272 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:29.295837  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.282421  4683 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.313154  1620 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:29.306859  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.244006  4655 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.334606  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.335227  2268 raft_consensus.cc:2368] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12.
I20260709 13:00:29.335484  4683 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:29.341424  5055 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.341596  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.356779  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.221112  5056 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.352392  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.356781  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 678) took 1455 ms. Trace:
I20260709 13:00:29.365031  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.351456  4655 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:29.360574  1616 rpcz_store.cc:276] 0709 13:00:27.901578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.827635 (+926057us) service_pool.cc:224] Handling call
0709 13:00:28.910821 (+ 83186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.914481 (+  3660us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:29.009459 (+ 94978us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.356473 (+347014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.356521 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:29.356567 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.356628 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.356727 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":169852,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":27015,"raft.queue_time_us":22771,"thread_start_us":375976,"threads_started":2}
W20260709 13:00:29.370343  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 149610us
W20260709 13:00:29.371155  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 201428us
I20260709 13:00:29.359331  4951 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:29.371907  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.375779  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.352499  4781 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.379781  1617 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:29.355154  4660 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:00:29.381489  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:29.381836  5092 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:00:29.382174  4935 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:00:29.386788  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.389642  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.389918  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.390296  2275 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:29.391204  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.393368  5055 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.368480  4855 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.398571  4754 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:29.412156  1615 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:29.273597  1439 rpcz_store.cc:276] 0709 13:00:18.481569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.481970 (+   401us) service_pool.cc:224] Handling call
0709 13:00:29.272976 (+10791006us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:21.302401 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:21.482991 (+180590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:21.483039 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:00:21.483055 (+    16us) tablet.cc:662] Decoding operations
0709 13:00:21.484065 (+  1010us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:21.484153 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:21.484182 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:00:21.484839 (+   657us) tablet.cc:701] Row locks acquired
0709 13:00:21.484881 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:00:21.485058 (+   177us) write_op.cc:270] Start()
0709 13:00:21.485218 (+   160us) write_op.cc:276] Timestamp: P: 1783602021484996 usec, L: 0
0709 13:00:21.485237 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:00:21.485928 (+   691us) log.cc:844] Serialized 2850 byte log entry
0709 13:00:22.510636 (+1024708us) op_driver.cc:464] REPLICATION: finished
0709 13:00:22.549947 (+ 39311us) write_op.cc:301] APPLY: starting
0709 13:00:22.550086 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:22.550286 (+   200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:22.550418 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:22.564698 (+ 14280us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:22.565016 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:00:22.565067 (+    51us) write_op.cc:312] APPLY: finished
0709 13:00:22.565399 (+   332us) log.cc:844] Serialized 59 byte log entry
0709 13:00:22.565600 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:22.565715 (+   115us) write_op.cc:454] Released schema lock
0709 13:00:22.565797 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:22.566242 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:22.566275 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":492440,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":39017,"apply.run_cpu_time_us":3190,"apply.run_wall_time_us":16263,"num_ops":7,"prepare.queue_time_us":1123006,"prepare.run_cpu_time_us":22264,"prepare.run_wall_time_us":413334,"raft.queue_time_us":106514,"raft.run_cpu_time_us":8233,"raft.run_wall_time_us":23701,"replication_time_us":1025169,"thread_start_us":512401,"threads_started":4,"wal-append.queue_time_us":564050,"wal-append.run_cpu_time_us":50116,"wal-append.run_wall_time_us":1513933}]]}
I20260709 13:00:29.375312  4951 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.387671  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.401196  1585 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:29.390527  2272 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:29.425123  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.426406  1585 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:29.427428  5058 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:29.374708  4906 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:29.425127  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.413614  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:29.407320  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 795287us
I20260709 13:00:29.410115  1612 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:29.413610  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:29.415046  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.430459  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.419977  5074 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.420565  4765 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.423586  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 49338.8us
I20260709 13:00:29.444685  2277 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:29.424099  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.415467  4973 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:29.434046  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.388087  5086 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:29.447106  4765 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.454079  1585 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.454644  4765 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.454854  2270 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:29.455650  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:29.457134  1620 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:29.459038  5019 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:29.459229  5055 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:29.459425  5019 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:29.459678  5055 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.460095  5055 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.460427  5019 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:29.461678  5019 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.462743  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:29.431092  5058 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:29.432530  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:29.463634  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:29.462833  5030 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.464226  1619 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.448346  4973 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.465463  4660 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:29.465878  4660 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.465040  4973 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.467612  4901 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.468046  5013 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.468117  4901 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.468708  5013 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.469933  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2452) took 2589 ms. Trace:
I20260709 13:00:29.470124  5016 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.431277  5074 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.470779  5030 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.470269  1618 rpcz_store.cc:276] 0709 13:00:26.880470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.354442 (+473972us) service_pool.cc:224] Handling call
0709 13:00:27.406471 (+ 52029us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:27.407152 (+   681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.407193 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:27.436199 (+ 29006us) log.cc:844] Serialized 590 byte log entry
0709 13:00:29.121270 (+1685071us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b1800053bc0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb9450d1 00007f29ebd60a0f
0709 13:00:29.371047 (+249777us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:29.384941 (+ 13894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.394984 (+ 10043us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.469514 (+ 74530us) raft_consensus.cc:1685] finished
0709 13:00:29.469538 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.469785 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4311,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4426,"spinlock_wait_cycles":18995072,"thread_start_us":212124,"threads_started":1,"wal-append.queue_time_us":1951945}
I20260709 13:00:29.471485  5030 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.450228  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.456863  1585 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:29.473965  4660 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.428588  4951 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.473357  4906 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.495905  4855 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.496269  4721 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.496585  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:29.497103  2272 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:29.503728  1685 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:29.504457  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:29.505437  5079 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.509866  4655 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.510442  2269 raft_consensus.cc:2410] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:29.510708  4901 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.512421  5041 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.512418  2276 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:29.415066  5043 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:29.519105  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.519105  1619 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:00:29.526867  4765 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.527796  4813 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.527726  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.528301  4683 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:29.528767  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.531214  2243 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.432265  4754 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:29.534492  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 50980.4us
I20260709 13:00:29.514081  4846 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.540117  1690 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:29.474067  5086 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:29.473773  5075 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:29.561121  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 104365us
I20260709 13:00:29.561332  5106 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.561218  5108 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:29.575374  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:29.568624  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 144567us
I20260709 13:00:29.577186  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:29.566632  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.560034  4855 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:29.578380  4855 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.578841  5108 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.579285  5108 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.579623  5108 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.580338  4855 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.526140  4728 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.585235  4655 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.585624  4728 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.585783  5099 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.569872  2275 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:29.586336  5099 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.587821  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.588366  5099 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.588551  1618 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:29.588883  5088 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.589373  5088 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.590090  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.591307  5088 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.591753  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.592145  5056 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:29.592876  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 88550.9us
I20260709 13:00:29.594238  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 700) took 1446 ms. Trace:
I20260709 13:00:29.594611  5079 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.595186  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.595484  5073 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:29.595872  5073 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:29.596542  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:29.596917  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.596731  5073 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.541085  5058 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:29.569202  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:29.559917  4901 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.597880  1685 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.598030  5073 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.574383  1689 raft_consensus.cc:2368] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9.
I20260709 13:00:29.599184  4781 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.599467  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.537021  4787 consensus_queue.cc:1059] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:00:29.529063  4808 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:29.601194  5074 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:29.601442  5058 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.602327  4721 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.602605  5041 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.574162  4813 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.470701  5016 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.597342  1687 raft_consensus.cc:2410] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:29.600709  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.609004  2243 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.560324  5013 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.565558  4765 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.609624  1511 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.577080  5055 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.598246  4901 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.613325  4945 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.613873  1614 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:29.614346  2274 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:29.614573  4846 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.567472  1693 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:29.642449  1690 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:29.594580  1545 rpcz_store.cc:276] 0709 13:00:28.147265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.147508 (+   243us) service_pool.cc:224] Handling call
0709 13:00:28.147914 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.714502 (+566588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.714558 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.727902 (+ 13344us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:28.727959 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.593931 (+865972us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540025d0d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:29.593973 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.594076 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233912192}
I20260709 13:00:29.620662  1685 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:29.621587  1585 leader_election.cc:400] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12.
I20260709 13:00:29.622563  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.643990  1618 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:29.573130  5086 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.623227  1691 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:29.645931  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.623611  4765 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.636759  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:29.637735  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:29.641341  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.632256  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.608624  5087 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:29.608390  5106 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:29.605392  5030 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.644810  1585 leader_election.cc:403] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.644702  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.646981  2243 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.672917  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.673677  2276 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:29.641762  4945 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:29.676597  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 55192.1us
I20260709 13:00:29.678942  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.679105  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.679198  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.679981  2268 raft_consensus.cc:2410] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:29.680096  1538 raft_consensus.cc:2410] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:29.680215  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:29.680740  1539 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.680925  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:29.655207  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.653746  5087 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.666242  1685 raft_consensus.cc:1240] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:29.695974  1510 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:29.666625  5103 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.668083  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.671041  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:29.700702  1618 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:29.572628  5043 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:29.693642  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.678964  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.703410  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:29.704270  1538 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.670949  4942 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.710024  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:29.710798  1543 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.711129  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:29.712590  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:29.707170  1510 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:29.647104  5041 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:29.703925  2268 raft_consensus.cc:2376] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9. Re-sending same reply.
I20260709 13:00:29.718021  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.641640  5108 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:29.675266  5106 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.684448  4945 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.718364  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.675841  4813 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.691628  5030 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12.
I20260709 13:00:29.706223  5056 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.699100  4846 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:29.710177  4942 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.718436  1511 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.722250  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.722827  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:29.700793  5087 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.719471  5049 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:29.746450  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.725392  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:29.698905  4781 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.706532  4879 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:29.734304  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.725914  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.719977  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.738415  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:29.721223  1617 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:29.751050  1544 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:29.751127  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.734932  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.740784  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:29.752434  1541 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:29.721560  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.715255  4707 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:29.747687  1619 raft_consensus.cc:2376] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6. Re-sending same reply.
I20260709 13:00:29.646929  4754 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.757524  2272 raft_consensus.cc:2410] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:29.721688  5081 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:29.705405  4683 consensus_queue.cc:1059] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:29.745985  4942 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.755836  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:29.756349  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 55613.3us
I20260709 13:00:29.738874  5056 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.751834  1542 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:29.756531  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:29.760001  1510 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:29.762923  1585 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:29.756379  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:29.764108  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.767052  1686 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:29.759406  4879 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:29.745994  4846 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.770078  5027 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.770704  1544 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
W20260709 13:00:29.771430  5111 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:00:29.773451  4935 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.773874  5018 consensus_queue.cc:1059] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:29.759235  4781 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.779206  4660 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.745568  5041 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:29.785238  1538 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
W20260709 13:00:29.787384  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.787714  1539 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:29.760707  4707 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.794261  1545 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:29.806011  1543 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:29.806733  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:29.808182  1691 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:29.796314  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:29.809060  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.786654  5056 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.816998  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.788772  4726 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:29.821134  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.807090  5058 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:29.744612  5103 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.808676  5081 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.844343  5049 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.855010  1685 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:29.855391  1685 pending_rounds.cc:85] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 2
I20260709 13:00:29.855675  1685 pending_rounds.cc:107] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:29.855773  5103 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:29.855908  1685 raft_consensus.cc:2889] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:29.855137  4950 raft_consensus.cc:2955] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:29.860540  5058 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:29.861482  5058 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.846851  5055 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:29.863129  4879 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.855219  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.866418  5081 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.866815  5081 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.866866  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.846292  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:29.842190  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 45934.9us
W20260709 13:00:29.867076  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 104206us
I20260709 13:00:29.830448  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.839839  2273 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:29.844708  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:29.857385  2270 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:29.876678  1690 raft_consensus.cc:2410] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:29.835366  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:29.877086  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:29.877789  2273 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.879417  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.827602  4907 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:29.887727  5099 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.883087  5055 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.841964  4707 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.889376  4951 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:29.892383  2270 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:29.896616  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:29.897217  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:29.839021  5075 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:29.836894  4808 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:29.907296  2243 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.907915  2273 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:29.900281  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:29.849108  5019 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:29.930351  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.931811  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.926980  1544 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: [3.6-6.7]
I20260709 13:00:29.923599  1691 raft_consensus.cc:2376] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9. Re-sending same reply.
I20260709 13:00:29.928067  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.928638  1585 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:29.904754  4906 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:29.938138  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:29.905756  5099 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:29.944202  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:29.939291  1539 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:29.920746  4907 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.946561  2276 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:00:30.013511  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.028501  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.029328  1690 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
W20260709 13:00:29.987905  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.011433  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.031658  1691 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
W20260709 13:00:30.031827  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 131600us
I20260709 13:00:30.016597  1540 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:30.030757  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:29.930133  5019 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:29.991775  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.033166  1620 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:29.945005  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:30.043347  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:30.019449  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.044041  1611 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:30.044270  1542 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.034611  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:30.043743  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 99566.6us
I20260709 13:00:30.045513  1544 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:30.045847  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:30.049993  1659 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:29.943118  4754 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.923661  5106 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.944733  5126 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:30.070875  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:30.072065  1659 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:30.024149  5037 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:29.942389  5016 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:30.073537  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.093339  1691 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:29.944852  5030 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:29.988834  5055 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:30.105685  5055 raft_consensus.cc:697] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:30.106196  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.106652  5055 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.107343  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.108004  1691 raft_consensus.cc:2368] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9.
I20260709 13:00:30.108723  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:30.109719  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.110297  1691 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:30.111545  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.113402  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 711) took 1057 ms. Trace:
I20260709 13:00:30.113775  1536 rpcz_store.cc:276] 0709 13:00:29.055817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.099609 (+ 43792us) service_pool.cc:224] Handling call
0709 13:00:29.099882 (+   273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:29.145578 (+ 45696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.145613 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:29.146242 (+   629us) log.cc:844] Serialized 52 byte log entry
0709 13:00:29.313607 (+167365us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.313648 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.313719 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.112316 (+798597us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b2400110408. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8b3e9c4 00007f29e8b3cacb 00007f29e8cf7dc9 00007f29e8cf7a55 00007f29e8cf6fb0 00007f29eb96d488 00007f29eb96dbe8 00007f29eb945398 00007f29eb94076a 00007f29eb93fbb6
0709 13:00:30.113133 (+   817us) raft_consensus.cc:1685] finished
0709 13:00:30.113152 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.113347 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45292,"raft.queue_time_us":45416,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"spinlock_wait_cycles":91785088,"thread_start_us":166965,"threads_started":1,"wal-append.queue_time_us":239247}
W20260709 13:00:30.116078  5117 log.cc:927] Time spent T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:00:30.119781  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:30.120208  4721 raft_consensus.cc:3055] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:30.120692  4721 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:30.121167  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:30.122176  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:30.121670  4721 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:29.944815  4855 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:30.128095  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:30.128377  4855 raft_consensus.cc:697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:30.128840  1611 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:30.076416  5012 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.079608  4728 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:30.132262  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.080225  4918 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:30.081573  4915 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:30.052765  4912 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:30.087325  5027 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:29.939738  4808 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.162807  4912 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:30.163894  4846 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:30.163889  4912 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:30.165429  4808 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:30.090890  1542 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:00:30.041584  5099 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.167244  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:30.167927  1542 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:30.167060  2268 raft_consensus.cc:2955] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:30.173497  5099 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:30.174922  4918 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.175797  2276 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:30.176755  1619 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:30.158457  5027 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:30.178365  5027 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.179543  5027 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.182092  5037 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:30.182229  5103 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.182621  5037 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.182828  4855 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.183005  5103 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.184737  5037 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:30.185212  5037 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.101385  5074 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:30.185488  5103 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:30.185650  5037 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.185961  5074 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:30.169075  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:30.187812  5074 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:30.131804  4721 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.189505  4754 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:30.049326  5108 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:30.102561  1618 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:30.095171  1544 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:30.101109  4916 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:30.123718  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:30.132009  5012 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.124270  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:29.988413  5086 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.208796  1615 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:30.125368  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.046376  5019 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.132679  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.987860  4973 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.073114  5043 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:30.137140  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:30.138180  1536 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:30.148259  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.067597  4683 consensus_queue.cc:1059] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:00:30.158843  5030 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:30.162627  4951 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:30.254977  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 636) took 3281 ms. Trace:
I20260709 13:00:30.097633  5126 raft_consensus.cc:697] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:30.255364  1688 rpcz_store.cc:276] 0709 13:00:26.812430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.052301 (+239871us) service_pool.cc:224] Handling call
0709 13:00:27.083796 (+ 31495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.084050 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:29.852869 (+2768819us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b1800385c00. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ef79d3c7 00007f29ebdaf9a7 00007f29ebdbf0bf
0709 13:00:29.853088 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.033878 (+180790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.049528 (+ 15650us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:30.066336 (+ 16808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.073852 (+  7516us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.093385 (+ 19533us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9445,"prepare.queue_time_us":17050,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":18677,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":15259,"spinlock_wait_cycles":71763712,"thread_start_us":147820,"threads_started":2,"wal-append.queue_time_us":319504}
I20260709 13:00:30.256345  5126 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.257426  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.194631  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:30.258970  1611 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:30.211092  5012 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.259979  1611 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:30.259711  5030 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:30.261026  1611 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:30.261090  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 637) took 3448 ms. Trace:
I20260709 13:00:30.261456  1694 rpcz_store.cc:276] 0709 13:00:26.812666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.391719 (+579053us) service_pool.cc:224] Handling call
0709 13:00:27.465200 (+ 73481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.512784 (+ 47584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.260800 (+2748016us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b5400323cd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:30.260935 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168269056}
I20260709 13:00:30.212623  1691 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:30.258459  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:29.944607  5041 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:30.161960  4915 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:30.208449  4916 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:30.227406  5124 log.cc:927] Time spent T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:00:30.275592  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:30.228739  4973 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:30.229411  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 92309.1us
I20260709 13:00:30.232484  5087 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.235545  4907 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:30.236131  5074 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.239019  1685 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:30.238899  4945 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.241719  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:30.246105  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 48242.5us
I20260709 13:00:30.247592  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.248209  4901 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:30.249626  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:30.250746  1617 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:30.251771  5108 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:30.253926  5086 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:30.254165  4918 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:30.254315  5071 raft_consensus.cc:3055] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:30.221428  4781 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:30.129232  4943 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:30.169049  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:30.195509  5039 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:00:30.264636  1688 raft_consensus.cc:2410] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:30.051189  4906 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:31.051102  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:31.055670  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:31.056344  1692 raft_consensus.cc:2393] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:30.620136  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.059443  1544 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:31.057271  1542 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.057156  4935 consensus_queue.cc:1059] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:30.568672  4799 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.058142  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2013) took 1159 ms. Trace:
I20260709 13:00:31.057947  4951 consensus_queue.cc:1059] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:31.096767  1617 rpcz_store.cc:276] 0709 13:00:29.898791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.250060 (+351269us) service_pool.cc:224] Handling call
0709 13:00:30.250422 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.057915 (+807493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.058092 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.099866  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:31.100502  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2460) took 2374 ms (client timeout 1768 ms). Trace:
I20260709 13:00:31.100790  1544 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:00:31.100914  1612 rpcz_store.cc:269] 0709 13:00:28.694304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.703681 (+  9377us) service_pool.cc:224] Handling call
0709 13:00:31.048829 (+2345148us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54000e0e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:31.069113 (+ 20284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973049600}
I20260709 13:00:31.049283  1616 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:31.058918  1693 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:31.102079  2273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.014s	sys 0.008s
W20260709 13:00:31.103134  2273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.014s	sys 0.008s
W20260709 13:00:30.479574  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.105403  1615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.008s	sys 0.013s
I20260709 13:00:31.059660  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:31.010790  4912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.004s	sys 0.020s
I20260709 13:00:30.639569  4846 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:30.471923  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.106803  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.585903  5121 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:30.408277  1541 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:30.457209  5055 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:30.786507  4942 consensus_meta.cc:287] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.007s	user 0.010s	sys 0.000s
I20260709 13:00:31.062068  2275 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:30.697566  1545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.013s	sys 0.020s
I20260709 13:00:30.276681  4916 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:31.062975  5087 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:30.352522  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.164139  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.063455  5071 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:30.547254  4765 consensus_meta.cc:287] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.864s	user 0.009s	sys 0.001s
I20260709 13:00:30.290182  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:31.048509  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:30.839820  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.058395  1509 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:30.715011  2241 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.026s	sys 0.021s
W20260709 13:00:31.168304  2241 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.026s	sys 0.023s
W20260709 13:00:31.168583  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 1.03451e+06us
W20260709 13:00:31.048898  5030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.010s	sys 0.010s
W20260709 13:00:30.630281  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.171401  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:31.151618  4907 raft_consensus.cc:3055] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:31.107411  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.175078  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.107685  1615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.008s	sys 0.013s
W20260709 13:00:30.869901  2268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.014s	sys 0.033s
W20260709 13:00:31.176117  2268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.014s	sys 0.034s
I20260709 13:00:31.109248  1686 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:31.109330  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.112820  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:31.058249  4945 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:30.406924  5013 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.124639  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:31.156075  1545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.013s	sys 0.028s
I20260709 13:00:31.155884  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:30.408844  4787 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.958264  5027 consensus_meta.cc:287] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.003s
W20260709 13:00:31.009769  5019 consensus_meta.cc:287] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.000s
W20260709 13:00:30.964747  5056 consensus_meta.cc:287] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.112s	user 0.008s	sys 0.000s
W20260709 13:00:30.896638  5130 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 13:00:31.004006  5081 consensus_meta.cc:287] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.101s	user 0.009s	sys 0.001s
W20260709 13:00:30.957295  5129 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:00:31.117655  4846 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:30.966082  4707 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.019s	user 0.009s	sys 0.000s
W20260709 13:00:30.963280  4950 consensus_meta.cc:287] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.103s	user 0.002s	sys 0.009s
I20260709 13:00:30.277938  5105 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.826s
W20260709 13:00:31.232686  5024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.010s	sys 0.022s
W20260709 13:00:31.233107  5024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.010s	sys 0.022s
I20260709 13:00:31.234450  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 713) took 1327 ms. Trace:
I20260709 13:00:30.639604  5058 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:30.290222  4888 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.874s
I20260709 13:00:31.234944  1537 rpcz_store.cc:276] 0709 13:00:29.906558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.917252 (+ 10694us) service_pool.cc:224] Handling call
0709 13:00:29.939027 (+ 21775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.945552 (+  6525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.945594 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.023553 (+ 77959us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.131229 (+107676us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:30.131267 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.131349 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.234250 (+1102901us) raft_consensus.cc:1685] finished
0709 13:00:31.234274 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.234394 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6214,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":65274,"thread_start_us":62139,"threads_started":1,"wal-append.queue_time_us":477635}
I20260709 13:00:30.281944  4817 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.874s
I20260709 13:00:31.102562  4973 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.168191  1690 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
W20260709 13:00:31.170282  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 111923us
I20260709 13:00:31.221647  4728 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:30.760228  5106 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.064563  5084 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:00:31.202042  1542 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:31.221506  1544 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:31.215648  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.222579  1617 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:31.174424  5030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.010s	sys 0.011s
I20260709 13:00:31.187083  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:31.174871  4907 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:31.266001  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.266628  4907 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:31.267867  4907 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.268487  4726 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:31.268883  4726 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.269398  4943 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.225804  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.224931  5019 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:31.272265  5058 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.272919  5019 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.224843  5056 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:31.253223  4973 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.104754  4799 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:31.157416  5121 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.161204  5108 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:31.232950  5105 consensus_queue.cc:1243] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:00:31.283739  5138 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:00:30.990291  5012 consensus_meta.cc:287] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.002s
I20260709 13:00:31.234571  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 913) took 1043 ms. Trace:
I20260709 13:00:31.284742  2273 rpcz_store.cc:276] 0709 13:00:30.191353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.191526 (+   173us) service_pool.cc:224] Handling call
0709 13:00:30.191967 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.192452 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.192491 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.193111 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.103591 (+910480us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:31.103643 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.103730 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.234366 (+130636us) raft_consensus.cc:1685] finished
0709 13:00:31.234381 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.234509 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9307,"raft.queue_time_us":3597,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":678,"thread_start_us":909939,"threads_started":1,"wal-append.queue_time_us":1039263}
I20260709 13:00:31.285735  4879 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:31.109014  4912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.004s	sys 0.022s
I20260709 13:00:31.286118  4879 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:31.286777  1611 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.284750  5012 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.288549  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2484) took 1454 ms. Trace:
I20260709 13:00:31.288885  1616 rpcz_store.cc:276] 0709 13:00:29.834559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.834870 (+   311us) service_pool.cc:224] Handling call
0709 13:00:31.048943 (+1214073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.101966 (+ 53023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.288379 (+186413us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000e0e50. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:31.288493 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2770288512}
I20260709 13:00:31.289497  5012 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.162685  4942 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.290280  4951 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.290535  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2011) took 1392 ms. Trace:
I20260709 13:00:31.290807  4951 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.291818  4942 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.290930  1615 rpcz_store.cc:276] 0709 13:00:29.898254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.242757 (+344503us) service_pool.cc:224] Handling call
0709 13:00:30.243141 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.243632 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:30.244042 (+   410us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.175748 (+931706us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.181768 (+  6020us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.181923 (+   155us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:31.181951 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.182005 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.290356 (+108351us) raft_consensus.cc:1685] finished
0709 13:00:31.290396 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.290492 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":823,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":54958,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":7352,"thread_start_us":931295,"threads_started":1,"wal-append.queue_time_us":1042577}
I20260709 13:00:31.292362  4942 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:31.292835  4942 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.293228  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 698) took 1016 ms. Trace:
I20260709 13:00:31.293594  1615 rpcz_store.cc:276] 0709 13:00:30.276841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.292561 (+1015720us) service_pool.cc:224] Handling call
0709 13:00:31.292821 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.292969 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.292992 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.293026 (+    34us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:31.293058 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.293103 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.293184 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.174499  4915 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:31.237828  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 189383us
I20260709 13:00:30.904904  5037 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.106757  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2444) took 1241 ms. Trace:
I20260709 13:00:31.224686  4901 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:31.228740  5126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.021s	sys 0.040s
I20260709 13:00:31.237056  4707 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.265151  1541 raft_consensus.cc:2410] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:31.265445  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 1715) took 1117 ms. Trace:
I20260709 13:00:31.228883  5081 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.276680  1538 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 12. Ops: [10.7-10.7]
I20260709 13:00:31.174451  4935 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:31.174223  4765 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:31.279006  1612 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:31.279497  1689 raft_consensus.cc:2410] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:00:31.308355  5126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.022s	sys 0.040s
I20260709 13:00:31.281045  1614 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.290298  1693 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:31.290410  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 697) took 1025 ms. Trace:
I20260709 13:00:31.223856  5013 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:31.223953  4787 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.303468  1686 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:31.303761  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:31.301815  1691 rpcz_store.cc:276] 0709 13:00:29.865387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.264228 (+398841us) service_pool.cc:224] Handling call
0709 13:00:30.301707 (+ 37479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.301949 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:30.519593 (+217644us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.106390 (+586797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.106441 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:31.106490 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.106575 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.106708 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":218643,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":16431,"raft.queue_time_us":89,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":39138,"thread_start_us":489871,"threads_started":1,"wal-append.queue_time_us":657896}
I20260709 13:00:31.441363  1616 rpcz_store.cc:276] 0709 13:00:30.265060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.289669 (+1024609us) service_pool.cc:224] Handling call
0709 13:00:31.289939 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.290107 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.290141 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.290183 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:31.290217 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.290267 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.290356 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.173182  5055 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.311031  1542 rpcz_store.cc:276] 0709 13:00:30.136235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.168787 (+ 32552us) service_pool.cc:224] Handling call
0709 13:00:31.253689 (+1084902us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.402766  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 692) took 1689 ms. Trace:
I20260709 13:00:31.454496  1618 rpcz_store.cc:276] 0709 13:00:29.712943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.782157 (+ 69214us) service_pool.cc:224] Handling call
0709 13:00:29.806865 (+ 24708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.197859 (+390994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.402416 (+1204557us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54000e1354. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:31.402687 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679418752}
I20260709 13:00:31.280444  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 695) took 1015 ms. Trace:
I20260709 13:00:31.305167  4942 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.443490  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 700) took 1148 ms. Trace:
I20260709 13:00:31.455826  1617 rpcz_store.cc:276] 0709 13:00:30.264583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.178633 (+914050us) service_pool.cc:224] Handling call
0709 13:00:31.222420 (+ 43787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.276302 (+ 53882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.280372 (+  4070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.277123  4728 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:31.460489  1688 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:31.462818  1616 rpcz_store.cc:276] 0709 13:00:30.294967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.442581 (+1147614us) service_pool.cc:224] Handling call
0709 13:00:31.442930 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.443106 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.443139 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.443185 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:31.443223 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.443285 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.443428 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:31.464639  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1685) took 1261 ms (client timeout 1552 ms). Trace:
W20260709 13:00:31.466709  1509 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.575s (SENT)
I20260709 13:00:31.470980  1509 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:31.311587  4907 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.494067  4907 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:31.494928  5013 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:31.498065  4817 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:31.456050  4901 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:31.498917  4817 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:31.499969  4787 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:31.499615  4817 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:31.500955  5132 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
W20260709 13:00:31.492682  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 191861us
W20260709 13:00:31.502444  5136 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.276s	user 0.000s	sys 0.000s
I20260709 13:00:31.504310  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:31.504850  4765 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:31.493203  5037 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.499014  4901 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.505679  4765 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:31.492298  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.511795  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.512512  1691 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:31.513839  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.514658  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1692) took 1107 ms. Trace:
W20260709 13:00:31.515019  5133 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:00:31.516296  5056 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.517210  5055 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.519372  4728 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.294935  4879 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.522908  4879 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.523943  4915 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:31.525020  4765 raft_consensus.cc:3055] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:31.525372  4765 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:31.525568  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:31.526203  4765 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:31.526801  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:31.527163  4765 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.312753  5058 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.528970  1660 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:31.529853  4918 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:31.530233  4918 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.532500  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2436) took 1669 ms. Trace:
W20260709 13:00:31.471855  1693 rpcz_store.cc:269] 0709 13:00:30.182466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.241484 (+ 59018us) service_pool.cc:224] Handling call
0709 13:00:31.443940 (+1202456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.467177  4951 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.545936  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.530511  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:31.551980  1690 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:31.515053  1691 rpcz_store.cc:276] 0709 13:00:30.407393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.513545 (+1106152us) service_pool.cc:224] Handling call
0709 13:00:31.514590 (+  1045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.239763  5071 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.317919  5108 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.545367  1694 rpcz_store.cc:276] 0709 13:00:29.863070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.262289 (+399219us) service_pool.cc:224] Handling call
0709 13:00:30.262584 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.262924 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.262977 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.263494 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.697153 (+433659us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:30.782439 (+ 85286us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.782698 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.782772 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.532277 (+749505us) raft_consensus.cc:1685] finished
0709 13:00:31.532296 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.532422 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":87678,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":10997,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":20451,"spinlock_wait_cycles":25565568,"thread_start_us":433341,"threads_started":1,"wal-append.queue_time_us":1177573}
I20260709 13:00:31.554033  5012 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:31.596611  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.594758  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.604550  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.605170  1691 raft_consensus.cc:2376] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10. Re-sending same reply.
I20260709 13:00:31.538139  5037 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:31.611522  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 81084.3us
W20260709 13:00:31.613001  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.532704  4846 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.530592  4918 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.556901  5013 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:31.614084  1693 raft_consensus.cc:2393] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:31.540158  4901 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.620168  1536 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.533463  4799 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:31.502473  4817 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.697544  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.698647  1691 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:31.628499  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.543545  5121 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.635573  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 715) took 1727 ms. Trace:
I20260709 13:00:31.619071  4765 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:31.635787  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 168821us
I20260709 13:00:31.666258  1544 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: [3.6-6.7]
I20260709 13:00:31.667843  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:31.719571  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.668785  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.720184  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.688220  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:31.691282  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.718564  1539 rpcz_store.cc:276] 0709 13:00:29.908406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.908520 (+   114us) service_pool.cc:224] Handling call
0709 13:00:29.908862 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.029712 (+120850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.635327 (+1605615us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b5400282654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:31.635514 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69615488}
W20260709 13:00:31.723726  1583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.000s	sys 0.021s
I20260709 13:00:31.530579  4916 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.726152  1509 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:31.727946  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:31.623946  4787 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.719821  1694 raft_consensus.cc:2376] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7. Re-sending same reply.
I20260709 13:00:31.739032  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.663288  5126 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.744300  1690 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:31.740283  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.745090  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:31.724081  1583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.021s
W20260709 13:00:31.740829  4906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.002s
W20260709 13:00:31.742237  2242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.010s	sys 0.004s
I20260709 13:00:31.745820  1693 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:31.746064  2242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.011s	sys 0.004s
W20260709 13:00:31.746893  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.752827  1691 raft_consensus.cc:2410] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:00:31.755859  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.008s	sys 0.005s
I20260709 13:00:31.755640  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:31.757078  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.008s	sys 0.005s
W20260709 13:00:31.755718  2268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.013s
W20260709 13:00:31.757653  2268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.000s	sys 0.013s
I20260709 13:00:31.758024  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:31.760342  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.019s	sys 0.067s
W20260709 13:00:31.760727  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.019s	sys 0.067s
I20260709 13:00:31.760661  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.664261  4945 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:00:31.760636  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 914) took 1564 ms. Trace:
I20260709 13:00:31.762573  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:31.754528  4906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.011s	sys 0.003s
I20260709 13:00:31.764287  1537 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.743628  4817 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:31.761963  2276 rpcz_store.cc:276] 0709 13:00:30.195890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.210513 (+ 14623us) service_pool.cc:224] Handling call
0709 13:00:30.233362 (+ 22849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.271618 (+ 38256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.271645 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.273205 (+1001560us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b1800326740. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c862a6 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a
0709 13:00:31.273593 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.755414 (+481821us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:31.755453 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.755517 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.755557 (+    40us) raft_consensus.cc:1685] finished
0709 13:00:31.755568 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.760586 (+  5018us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37895,"raft.queue_time_us":38227,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":88731,"spinlock_wait_cycles":5352064,"thread_start_us":481485,"threads_started":1,"wal-append.queue_time_us":475078}
I20260709 13:00:31.767061  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.744757  4765 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.769456  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.769917  1691 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:31.753399  5121 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.770911  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2009) took 1873 ms. Trace:
I20260709 13:00:31.775794  1619 rpcz_store.cc:276] 0709 13:00:29.897478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.897595 (+   117us) service_pool.cc:224] Handling call
0709 13:00:29.927237 (+ 29642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.177111 (+249874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.770716 (+1593605us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54001400d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:31.770863 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573360896}
I20260709 13:00:31.773303  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:31.774933  2273 pending_rounds.cc:85] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 6
I20260709 13:00:31.777261  2273 pending_rounds.cc:107] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:00:31.777521  2273 raft_consensus.cc:2889] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:31.779203  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:31.783829  1617 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.785099  1690 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:31.786257  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.787614  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.788272  1690 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:31.789060  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.796870  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.764029  5150 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.818856  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:31.797652  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 71595.3us
I20260709 13:00:31.822419  1509 leader_election.cc:400] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9.
I20260709 13:00:31.822715  1509 leader_election.cc:403] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:31.798573  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.807971  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.770843  4765 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:31.768782  5148 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:31.767316  4817 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:31.756116  5126 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.766975  4726 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:31.827739  5147 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:31.753386  4787 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.778486  5152 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:31.774137  4945 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:31.765969  4906 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:31.868883  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 72527.6us
I20260709 13:00:31.869100  1693 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
W20260709 13:00:31.841084  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.844362  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:31.866173  1691 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
W20260709 13:00:31.839877  2241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.008s	sys 0.033s
I20260709 13:00:31.842988  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:31.843008  5155 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.922711  5154 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.922920  5155 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.923220  5154 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.925132  5155 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.925741  5154 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:31.927498  4787 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:31.881671  5152 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.932693  5152 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:31.933337  2241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.011s	sys 0.035s
I20260709 13:00:31.936313  4942 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:31.937076  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:31.937702  4942 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:31.938213  5154 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:31.840579  5150 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.940855  5071 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.941231  5150 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.844159  4916 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.942299  1619 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:31.943185  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:31.944519  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:31.869477  5075 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9.
W20260709 13:00:31.946945  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 66356.7us
I20260709 13:00:31.946640  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.949514  1691 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:31.876863  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:31.781147  5121 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:31.957340  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.956274  1618 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:31.957208  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:31.954999  1694 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:31.957633  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:31.955942  1617 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:31.960995  5013 consensus_queue.cc:1059] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:31.962934  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 140622us
I20260709 13:00:31.963610  1509 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:31.965011  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:31.842880  5146 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:00:31.839423  4950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.006s	sys 0.031s
W20260709 13:00:31.968295  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.968713  5075 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:31.974494  5012 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.955875  4916 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.979135  5153 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.961915  5037 raft_consensus.cc:3055] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:32.007085  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:31.982076  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.009850  1540 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:32.010848  1691 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:31.869652  4707 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:31.859046  4846 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.868088  4817 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:31.985173  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:31.985317  1660 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:31.879832  4945 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:31.841329  5157 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:31.987934  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:31.978336  4943 consensus_meta.cc:287] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.708s	user 0.005s	sys 0.000s
I20260709 13:00:32.012476  1618 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:32.007947  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 714) took 2101 ms. Trace:
I20260709 13:00:32.016294  1694 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.017910  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:32.014523  1617 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.020062  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:32.022143  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.005182  5150 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:32.026170  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.026635  1691 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:31.881940  5147 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.988762  5012 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.017632  1545 rpcz_store.cc:276] 0709 13:00:29.906872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.916449 (+  9577us) service_pool.cc:224] Handling call
0709 13:00:29.934946 (+ 18497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.066829 (+131883us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:31.220992 (+1154163us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.760117 (+539125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.761956 (+  1839us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:31.762018 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.007712 (+245694us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54001851d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:32.007759 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.007894 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4696,"prepare.queue_time_us":1103075,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":2688,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3486,"spinlock_wait_cycles":302679296,"thread_start_us":1647941,"threads_started":2,"wal-append.queue_time_us":526288}
I20260709 13:00:32.006248  5121 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:32.023523  2243 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:32.033716  1443 catalog_manager.cc:5697] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 4 to 5, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.027652  5150 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.035255  1617 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:32.024434  4906 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.987444  4655 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:00:32.012439  5037 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:31.988010  5073 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:00:32.017187  5161 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:32.038529  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.052814  1691 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:31.984345  4942 consensus_queue.cc:1059] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:00:32.040005  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:32.061551  1618 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.005532  4951 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:32.027940  4799 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.047302  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:32.087755  1617 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:32.028983  4950 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.049297  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.026818  5157 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:31.988472  5148 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:00:32.031097  5153 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:32.024835  5049 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:00:32.018801  4846 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.077364  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.078730  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.090651  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1695) took 1432 ms. Trace:
I20260709 13:00:32.098078  1693 rpcz_store.cc:276] 0709 13:00:30.658416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.042482 (+1384066us) service_pool.cc:224] Handling call
0709 13:00:32.090579 (+ 48097us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.097589  1443 catalog_manager.cc:5697] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 4, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.018055  4916 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:32.053807  5161 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.115612  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:32.115206  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 123303us
I20260709 13:00:32.116262  1617 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:32.089648  5116 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:32.123349  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:32.123569  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:32.089828  4726 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:32.128489  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 87251.1us
I20260709 13:00:32.129987  1617 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:32.130971  5116 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:32.133113  5157 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:32.132792  5116 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.129477  1443 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 8 to 11, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:32.118517  5161 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.138760  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:32.161423  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 112381us
W20260709 13:00:32.162030  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.163134  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:32.129691  4721 raft_consensus.cc:3055] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:32.091382  4799 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.100390  5037 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:32.128353  5153 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:32.167526  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 118356us
I20260709 13:00:32.134876  5126 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:32.172873  1509 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:32.186304  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:32.088265  4945 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:32.187242  1620 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:32.189673  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:32.186005  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2424) took 2669 ms (client timeout 1693 ms). Trace:
W20260709 13:00:32.193651  1692 rpcz_store.cc:269] 0709 13:00:29.498002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.575133 (+ 77131us) service_pool.cc:224] Handling call
0709 13:00:32.167147 (+2592014us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400109fd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:32.167264 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3403659520}
I20260709 13:00:32.190266  2271 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:32.198429  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.198910  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:32.199671  1617 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:32.185987  1443 catalog_manager.cc:5697] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.167680  4721 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:32.202831  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:32.203397  1620 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:32.203101  4721 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.204368  1620 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:32.204814  4721 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.206288  1620 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:32.207150  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.207825  1692 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:32.208778  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:32.209805  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:32.195003  5165 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:32.214711  4660 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:32.214916  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:32.216445  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2022) took 2167 ms. Trace:
I20260709 13:00:32.216873  1614 rpcz_store.cc:276] 0709 13:00:30.049555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.263366 (+213811us) service_pool.cc:224] Handling call
0709 13:00:30.263647 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.441007 (+1177360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.216256 (+775249us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001126d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:32.216397 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2339160832}
I20260709 13:00:32.219539  1614 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:32.220696  1614 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:00:32.223740  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 85064.2us
I20260709 13:00:32.224709  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:32.165782  1584 connection.cc:256] RPC call timeout handler was delayed by -1.67067275200003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 13:00:32.262941  1584 connection.cc:256] RPC call timeout handler was delayed by -1.6111434050000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 13:00:32.263499  1584 connection.cc:256] RPC call timeout handler was delayed by -1.5917824339999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 13:00:32.264071  1584 connection.cc:256] RPC call timeout handler was delayed by -1.58990600300001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:00:32.265570  1443 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 7 to 8, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.200151  4707 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:32.231570  5037 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.339262  4846 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:32.343082  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.343911  2271 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:32.345080  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.351874  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2018) took 2426 ms. Trace:
I20260709 13:00:32.352413  1611 rpcz_store.cc:276] 0709 13:00:29.925060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.261739 (+336679us) service_pool.cc:224] Handling call
0709 13:00:30.261983 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.287155 (+1025172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.351563 (+1064408us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000569d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:32.351803 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2356103552}
W20260709 13:00:32.353746  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.276124  1545 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:32.277205  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.277951  4811 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:32.370896  4811 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:32.278549  1539 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:00:32.278419  5165 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:32.279350  1443 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 5 to 10, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:32.372766  1443 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 6 to 8, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:32.283387  1618 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:32.284157  5150 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:32.291558  4916 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:32.292548  4918 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.002s
W20260709 13:00:32.293237  1584 connection.cc:256] RPC call timeout handler was delayed by -1.3055824339999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
W20260709 13:00:32.294356  5164 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:00:32.167611  4942 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
W20260709 13:00:32.307458  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.307219  5153 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.309576  5086 raft_consensus.cc:3055] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:32.357637  1544 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:32.392264  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.314371  5161 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:32.346455  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.394781  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.374425  1690 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:32.380509  1443 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 8 to 9, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.395509  1539 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:32.396204  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.381624  1694 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:32.390357  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.398859  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:32.382108  4811 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.397960  1545 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:32.400056  1544 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:32.400575  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.384634  4918 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:32.406978  1693 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:32.407039  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.407951  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:32.410290  1617 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:32.405784  1443 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.414036  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:32.414851  2271 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.416903  2277 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:32.417279  2277 pending_rounds.cc:85] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 6
I20260709 13:00:32.417482  2277 pending_rounds.cc:107] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:32.417706  2277 raft_consensus.cc:2889] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:32.418406  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:32.419778  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:32.420202  1620 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.391398  5086 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:32.423341  4811 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.426046  5147 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:32.434080  1620 raft_consensus.cc:2410] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:00:32.435321  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 233898us
I20260709 13:00:32.455503  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:32.455832  2241 leader_election.cc:336] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 2.118s (SENT)
W20260709 13:00:32.457001  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 232321us
I20260709 13:00:32.412520  1443 catalog_manager.cc:5697] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:00:32.440095  1694 raft_consensus.cc:2410] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:32.440239  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:32.429482  4765 consensus_meta.cc:287] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.000s
I20260709 13:00:32.450219  1617 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:32.457589  1615 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:32.460238  2273 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.461292  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:32.469440  1617 raft_consensus.cc:2376] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7. Re-sending same reply.
I20260709 13:00:32.469674  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1701) took 1502 ms. Trace:
I20260709 13:00:32.462037  1443 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 7 to 8, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.470180  1694 rpcz_store.cc:276] 0709 13:00:30.967802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.406837 (+1439035us) service_pool.cc:224] Handling call
0709 13:00:32.469614 (+ 62777us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.492362  1694 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:32.499181  4907 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:32.500761  2273 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:32.501514  5168 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:32.439539  5012 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.505697  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:32.461074  4916 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:32.505805  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1690) took 2219 ms. Trace:
I20260709 13:00:32.511732  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:32.511551  1694 rpcz_store.cc:276] 0709 13:00:30.273202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.491641 (+2218439us) service_pool.cc:224] Handling call
0709 13:00:32.491955 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.492812 (+   857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.493029 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.512694  1658 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:32.423309  5086 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:32.502650  2241 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:32.527475  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:32.528589  2273 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:32.531631  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:32.532249  1617 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:32.532437  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:32.533483  1692 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:32.463685  4765 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.509532  4907 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.515111  4916 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:32.507156  4918 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:32.541664  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:32.537004  1443 catalog_manager.cc:5697] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 4, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.562031  1443 catalog_manager.cc:5697] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 4, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.563999  1443 catalog_manager.cc:5697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 3, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:32.565620  1443 catalog_manager.cc:5697] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:32.514533  4655 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:32.567448  4655 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:32.568485  4655 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.561331  1620 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:32.571301  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:32.572781  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:32.577822  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.583449  4906 raft_consensus.cc:2764] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:00:32.582515  2273 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:32.585340  1443 catalog_manager.cc:5697] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 6, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.586469  1510 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:32.514068  4942 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:00:32.539135  5086 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.586938  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:32.589150  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 86562.4us
I20260709 13:00:32.589752  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.559113  5165 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.587805  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.591280  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:32.575232  4916 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.604866  1443 catalog_manager.cc:5697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.600798  1618 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:32.606868  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:32.561293  5172 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:32.609061  1443 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:32.584616  4855 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:32.535254  5084 consensus_queue.cc:1059] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:00:32.619786  1443 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 5, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.593402  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.594388  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:32.598078  4906 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:32.576278  4907 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.622079  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:32.612399  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:32.593799  4707 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:32.610693  4817 consensus_meta.cc:287] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 13:00:32.613185  1658 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:32.604955  4918 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:32.640539  2270 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.607926  5161 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:32.675489  5071 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:32.675894  5071 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.676222  5071 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.660961  5150 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.677000  5150 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:32.677438  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 52102.3us
I20260709 13:00:32.679392  4707 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:32.686609  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.610337  5172 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:32.613145  4855 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:32.713274  5187 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:00:32.713475  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:32.716557  5180 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 13:00:32.718039  5176 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:00:32.631554  4879 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:32.661526  5147 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:32.681641  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 88266.7us
W20260709 13:00:32.680676  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 67554.5us
I20260709 13:00:32.733290  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:32.734107  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.734309  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.681727  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.735754  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.737121  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.738164  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:32.742964  5181 log.cc:927] Time spent T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:00:32.743957  5182 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:32.742892  5150 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:32.720979  4855 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:32.706871  5172 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.722705  5161 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:32.680044  4817 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:32.732501  4879 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:32.755779  4879 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:32.758363  4787 raft_consensus.cc:3055] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:32.758688  4787 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:32.759485  4787 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.760494  4787 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.741518  5084 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:32.741384  5108 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:32.763527  5108 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:32.763859  5108 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.765933  1658 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.766906  5084 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:32.767541  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.770777  5116 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.771013  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.771441  5079 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:32.771251  5116 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.771927  5079 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:32.772787  5178 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:00:32.773635  5116 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:32.774144  5116 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.773994  4707 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.775775  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:32.776731  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.778791  4811 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.748970  5147 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:32.779307  4811 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.740118  4906 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.780165  5147 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.781152  4811 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:32.782696  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.783776  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:32.784700  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.785835  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 915) took 1736 ms. Trace:
I20260709 13:00:32.786161  2277 rpcz_store.cc:276] 0709 13:00:31.049117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.049270 (+   153us) service_pool.cc:224] Handling call
0709 13:00:31.049628 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.418089 (+1368461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.785639 (+367550us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400203854. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:32.785783 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3140947840}
W20260709 13:00:32.787741  2275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 969) took 3179 ms (client timeout 1897 ms). Trace:
W20260709 13:00:32.788062  2275 rpcz_store.cc:269] 0709 13:00:29.608247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.610713 (+  2466us) service_pool.cc:224] Handling call
0709 13:00:32.787586 (+3176873us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400881dd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:32.787689 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3240252160}
W20260709 13:00:32.792912  5127 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 2.657s	user 0.007s	sys 0.027s
I20260709 13:00:32.793223  4817 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:32.794289  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1686) took 2611 ms (client timeout 1872 ms). Trace:
W20260709 13:00:32.794703  1689 rpcz_store.cc:269] 0709 13:00:30.194795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.249402 (+ 54607us) service_pool.cc:224] Handling call
0709 13:00:32.794029 (+2544627us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400305054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:32.794172 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497363840}
I20260709 13:00:32.795794  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.796304  1689 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:32.797583  5152 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:32.798030  5152 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.754104  5151 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:32.799060  5151 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:32.799487  4907 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:32.799741  5152 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:32.754973  5012 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:32.794416  5186 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:00:32.800485  5183 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:32.800155  5151 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.793298  4901 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:32.803542  1544 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:32.804939  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:32.805038  5079 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:32.805713  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.806322  1544 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:32.797065  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:32.806907  5058 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:32.807209  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:32.807232  4901 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:32.807869  4901 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.808209  4901 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.811960  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 647) took 1315 ms. Trace:
I20260709 13:00:32.753459  1584 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:32.813069  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 59699.1us
I20260709 13:00:32.813973  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.739065  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.816324  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.817093  2274 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:32.817396  1658 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:32.786389  2271 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:32.818305  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:32.819110  2270 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:32.817320  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:32.808226  5012 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:32.822278  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.823917  1545 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:32.824375  1658 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:32.826849  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:32.825979  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:32.828142  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:32.828809  1545 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:32.826272  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:32.829488  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.830744  1544 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:32.832826  4907 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:32.833078  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.833261  4907 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.833658  4907 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.834246  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.836416  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.835541  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.835471  1689 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:32.839773  1545 raft_consensus.cc:2410] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:32.822044  4846 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:32.840916  1544 raft_consensus.cc:2410] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:32.822885  5058 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:32.842512  1659 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:32.840227  5084 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:32.839283  5152 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:32.830394  5161 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:32.830276  5037 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.843227  5108 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.824851  5012 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:32.847424  5012 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:32.849318  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:32.850412  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:32.851919  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.852005  1658 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.855510  1659 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:32.814752  5116 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:32.814777  1694 rpcz_store.cc:276] 0709 13:00:31.496185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.512832 (+1016647us) service_pool.cc:224] Handling call
0709 13:00:32.513142 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.531410 (+ 18268us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:32.592430 (+ 61020us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.811428 (+218998us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.811494 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:32.811557 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.811641 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.811783 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39639,"prepare.queue_time_us":123349,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":91428,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":159494,"threads_started":3,"wal-append.queue_time_us":160539}
I20260709 13:00:32.862823  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:32.871912  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:32.994714  2274 raft_consensus.cc:2368] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10.
I20260709 13:00:32.995136  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:32.995249  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.015519  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:33.015717  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 155575us
I20260709 13:00:33.016377  1694 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 4.
I20260709 13:00:33.017484  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:32.999558  1689 raft_consensus.cc:2376] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10. Re-sending same reply.
I20260709 13:00:33.019412  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:33.023908  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 205624us
I20260709 13:00:32.842618  5058 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:33.025560  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:33.024961  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 153128us
I20260709 13:00:33.049947  1658 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:33.026377  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:32.856411  5108 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:33.049113  5187 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:32.997051  5084 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:33.013118  5161 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:33.051663  5152 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:33.052793  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:33.054003  5152 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:33.054862  5028 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.055790  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:33.057003  5152 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:33.057428  5152 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:33.058320  5152 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.063120  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:33.067723  2273 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:32.994433  5121 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.025640  1659 leader_election.cc:400] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10.
I20260709 13:00:33.075201  1659 leader_election.cc:403] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:00:33.051106  5058 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.081828  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:33.083119  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:33.090399  5099 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:33.049536  1689 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:33.092911  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.093839  1689 raft_consensus.cc:2410] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:33.070120  4846 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.074286  5084 raft_consensus.cc:697] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:33.098569  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:33.101373  1544 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:33.105008  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.086572  4942 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:33.096285  5073 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:33.111668  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.106285  4918 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.075991  5121 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.084240  5191 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:33.120380  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.100302  5028 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.115285  4721 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:33.103273  5041 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:33.132148  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.103122  4660 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.106609  5086 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.097107  5193 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:33.099385  4817 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:33.128973  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.086084  5108 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:00:33.148983  4817 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:33.143317  4916 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:00:33.151692  4817 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.152068  4916 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.154120  4916 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.144826  4660 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.156633  4660 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.131875  4721 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.157413  4721 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.145911  5041 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:33.142056  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.119920  5073 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:00:33.181584  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 113909us
W20260709 13:00:33.191164  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 57451.1us
W20260709 13:00:33.193092  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.194540  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 721) took 3182 ms. Trace:
I20260709 13:00:33.195019  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.127877  4942 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:33.190618  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:33.148442  4907 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.200013  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:33.195045  1540 rpcz_store.cc:276] 0709 13:00:30.012560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.076730 (+ 64170us) service_pool.cc:224] Handling call
0709 13:00:30.091070 (+ 14340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.014977 (+1923907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.194247 (+1179270us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b540009f954. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:33.194469 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4411941632}
I20260709 13:00:33.202482  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.207787  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:33.207398  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 108878us
W20260709 13:00:33.209640  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.212021  4907 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.212134  4973 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.213286  1540 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:33.189038  5161 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:33.218189  1660 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:33.223037  5150 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:33.224431  5071 consensus_meta.cc:287] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.003s
I20260709 13:00:33.234930  1660 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:33.234745  5071 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.236369  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:33.237008  4916 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.133999  5028 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.237625  4916 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.237553  4973 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.238085  4916 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.237133  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:33.238819  5028 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.238492  4916 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.239706  5071 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:33.240181  5028 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.240607  5028 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:33.240974  5028 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.243016  5147 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.243552  5147 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:33.243981  5147 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.227439  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:33.194149  5073 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.268062  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.269336  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.250907  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.271447  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.272612  2276 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:33.272872  5171 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.890s	user 0.002s	sys 0.001s
I20260709 13:00:33.250627  5084 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.278111  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.276491  4942 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.282239  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.283004  1691 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:33.283516  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 56133.8us
I20260709 13:00:33.284276  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:33.284960  5203 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.285328  5203 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.285650  5203 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:33.287643  5141 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 2.019s	user 0.004s	sys 0.017s
I20260709 13:00:33.291359  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:33.253813  5150 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.291549  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2423) took 3793 ms. Trace:
I20260709 13:00:33.292526  5150 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:33.293413  5150 raft_consensus.cc:697] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:33.294799  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 949) took 3419 ms. Trace:
I20260709 13:00:33.294493  5150 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:33.295300  2268 rpcz_store.cc:276] 0709 13:00:29.875839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.876033 (+   194us) service_pool.cc:224] Handling call
0709 13:00:29.882293 (+  6260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.166931 (+284638us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:30.217260 (+ 50329us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.757892 (+1540632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.757940 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:31.757975 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.294513 (+1536538us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54006720d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:33.294569 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.294715 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1043,"raft.queue_time_us":109085,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":653934336,"thread_start_us":1539211,"threads_started":2,"wal-append.queue_time_us":947789,"wal-append.run_cpu_time_us":1699,"wal-append.run_wall_time_us":1116622}
I20260709 13:00:33.299662  5079 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:33.299896  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1697) took 2516 ms (client timeout 1508 ms). Trace:
I20260709 13:00:33.300189  5079 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:33.300441  1688 rpcz_store.cc:269] 0709 13:00:30.783271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.225609 (+442338us) service_pool.cc:224] Handling call
0709 13:00:33.299659 (+2074050us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54001ab8d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:33.299816 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419795840}
I20260709 13:00:33.301455  5073 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.301738  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.302250  5079 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.266376  5012 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:33.175944  5086 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.253649  5172 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.255738  5041 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.256390  5116 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:33.256466  4855 consensus_meta.cc:287] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.001s
W20260709 13:00:33.260802  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2441) took 3396 ms (client timeout 2845 ms). Trace:
I20260709 13:00:33.261627  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1978) took 2693 ms. Trace:
I20260709 13:00:33.349370  1538 rpcz_store.cc:276] 0709 13:00:30.568382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.223109 (+654727us) service_pool.cc:224] Handling call
0709 13:00:31.231565 (+  8456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.312547 (+ 80982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.261393 (+1948846us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b5400283054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:33.261572 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103177472}
I20260709 13:00:33.264355  5165 raft_consensus.cc:3055] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.250890  4916 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.291247  4846 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:33.250747  4973 consensus_queue.cc:1059] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:00:33.360584  2276 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:33.255081  4901 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.302649  1688 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:33.363828  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:33.334946  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 43663.6us
I20260709 13:00:33.305414  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:33.306676  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2456) took 1349 ms. Trace:
I20260709 13:00:33.365513  1693 rpcz_store.cc:276] 0709 13:00:31.957119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.098875 (+141756us) service_pool.cc:224] Handling call
0709 13:00:33.306471 (+1207596us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400021f54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:33.306612 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650261760}
I20260709 13:00:33.307626  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 662) took 1460 ms. Trace:
I20260709 13:00:33.366799  1692 rpcz_store.cc:276] 0709 13:00:31.847327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.209600 (+362273us) service_pool.cc:224] Handling call
0709 13:00:33.307427 (+1097827us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54002e54d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:33.307565 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742545792}
I20260709 13:00:33.368098  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.369428  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.370060  1692 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.292006  1687 rpcz_store.cc:276] 0709 13:00:29.497695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.624371 (+126676us) service_pool.cc:224] Handling call
0709 13:00:29.646142 (+ 21771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.746083 (+ 99941us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:29.926252 (+180169us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.215761 (+289509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.215811 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:30.215859 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.201894 (+1986035us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b180034b0a0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c862a6 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419
0709 13:00:33.291280 (+1089386us) spinlock_profiling.cc:243] Waited 98 ms on lock 0x7b540011add4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:33.291347 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.291485 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":111563,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":91,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":16307,"spinlock_wait_cycles":234408960,"thread_start_us":350586,"threads_started":2,"wal-append.queue_time_us":623136,"wal-append.run_cpu_time_us":9252,"wal-append.run_wall_time_us":1676472}
I20260709 13:00:33.338575  2273 raft_consensus.cc:2410] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:33.341882  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:33.372781  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 347254us
I20260709 13:00:33.367730  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:33.375720  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:33.353336  5165 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:33.377756  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.252332  4879 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.357157  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:33.303949  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 699) took 3022 ms. Trace:
I20260709 13:00:33.378873  1688 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:33.348734  1685 rpcz_store.cc:269] 0709 13:00:29.864548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.125080 (+260532us) service_pool.cc:224] Handling call
0709 13:00:33.260578 (+3135498us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5400400e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:33.260728 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64551168}
I20260709 13:00:33.388808  1615 rpcz_store.cc:276] 0709 13:00:30.281169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.294380 (+1013211us) service_pool.cc:224] Handling call
0709 13:00:31.294653 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.460483 (+1165830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.303689 (+843206us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540026f2d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:33.303888 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651433216}
I20260709 13:00:33.389308  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.389935  1694 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:33.309320  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:33.330075  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 78337.9us
I20260709 13:00:33.390477  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.381261  1538 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:33.326858  2277 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.303244  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1981) took 2560 ms. Trace:
I20260709 13:00:33.392807  1536 rpcz_store.cc:276] 0709 13:00:30.743258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.224768 (+481510us) service_pool.cc:224] Handling call
0709 13:00:31.232661 (+  7893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.667651 (+434990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.302994 (+1635343us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400281c54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:33.303180 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878252288}
I20260709 13:00:33.381706  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.389933  1685 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:33.389647  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.394564  1693 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:33.393935  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:33.395562  2274 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:33.352591  4906 consensus_meta.cc:287] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 13:00:33.396684  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.390630  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 729) took 1158 ms. Trace:
I20260709 13:00:33.400653  2273 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:33.398533  1541 rpcz_store.cc:276] 0709 13:00:32.231967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.309015 (+1077048us) service_pool.cc:224] Handling call
0709 13:00:33.390573 (+ 81558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:33.400173  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:33.408974  1691 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:33.376986  5079 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:33.323856  4935 raft_consensus.cc:3055] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:33.411278  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:33.308209  5012 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:33.413268  1542 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:33.429054  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.413749  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.415300  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.416489  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.430373  1617 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:33.417268  2275 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:33.356877  4855 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.324100  5126 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:33.432926  1541 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:33.422073  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.433579  1685 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:33.434360  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.435318  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.435935  1685 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:33.436946  2268 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:33.422735  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:33.438550  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.439468  1618 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:33.440328  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.408233  4906 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:33.356483  5204 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:33.386472  4655 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:33.303606  5161 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.427129  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.430649  2273 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:33.394138  4846 consensus_queue.cc:1059] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:00:33.425674  4660 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.428332  5121 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:33.460577  1536 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.441569  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.432709  1616 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:33.436545  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.442559  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:33.444224  4721 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.427027  5151 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:33.442183  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.444875  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.465420  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.465884  1693 raft_consensus.cc:2368] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11.
I20260709 13:00:33.466168  1685 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:33.448372  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:33.397540  4918 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10.
I20260709 13:00:33.453357  1542 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:33.449100  4655 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:33.441159  1619 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:33.426196  4935 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:33.458804  2272 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:33.412817  5193 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:00:33.423923  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.475752  1691 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:33.443392  5126 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:33.466907  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.467262  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:33.470659  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.476603  1685 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.477073  1620 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.428237  4973 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:33.449484  5073 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:33.475068  4707 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.465467  4787 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.479650  4855 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:33.480283  5081 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:33.481053  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1696) took 2782 ms (client timeout 1554 ms). Trace:
I20260709 13:00:33.483489  5084 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:33.524015  5084 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:33.524847  5084 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.525452  1614 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:33.459750  5108 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:00:33.525655  1685 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:33.487403  5172 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:33.487614  4935 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.490986  5193 consensus_queue.cc:1243] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:33.508781  4787 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:33.527046  4935 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.478988  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.527679  1619 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.502123  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.528683  1691 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.526432  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.529790  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:33.530375  2276 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.532680  5147 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.534677  5147 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:33.505108  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.538698  1693 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
W20260709 13:00:33.507215  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 696) took 3242 ms (client timeout 2142 ms). Trace:
I20260709 13:00:33.509845  1584 leader_election.cc:400] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11.
I20260709 13:00:33.539489  1584 leader_election.cc:403] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:33.515969  4765 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.544044  4721 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:33.463616  5165 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.544494  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.545249  5165 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.545692  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:33.546119  1584 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:42041 timed out after 1.516s (SENT) [suppressed 45 similar messages]
I20260709 13:00:33.547854  4846 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11.
I20260709 13:00:33.548079  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.548650  1687 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:33.549394  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.549948  5028 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.550702  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.551288  1614 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:33.552120  5028 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:33.552898  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.555050  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.518651  4879 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:33.519228  4916 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:33.519806  4655 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.490600  5058 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.508088  4906 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.508280  5086 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:33.508247  1686 rpcz_store.cc:269] 0709 13:00:30.698657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.176722 (+478065us) service_pool.cc:224] Handling call
0709 13:00:33.480907 (+2304185us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b5400373554. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:33.480993 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113504640}
I20260709 13:00:33.535135  5203 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:33.539407  1612 rpcz_store.cc:269] 0709 13:00:30.264808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.112525 (+847717us) service_pool.cc:224] Handling call
0709 13:00:33.507055 (+2394530us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400216bd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:33.507160 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229997824}
I20260709 13:00:33.527347  4787 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.589310  1691 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:33.538375  5108 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:00:33.490892  5151 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.556941  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:33.561853  1545 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:33.562074  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.562824  1688 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:33.562718  2243 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:33.503942  1692 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
W20260709 13:00:33.598839  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.598515  1619 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:33.574039  1620 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
W20260709 13:00:33.576014  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 648) took 2079 ms (client timeout 2118 ms). Trace:
I20260709 13:00:33.599721  1692 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:00:33.599881  1690 rpcz_store.cc:269] 0709 13:00:31.496404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.807676 (+311272us) service_pool.cc:224] Handling call
0709 13:00:33.575792 (+1768116us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54003a9b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:33.575921 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828299520}
I20260709 13:00:33.600283  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.600402  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 650) took 2103 ms. Trace:
I20260709 13:00:33.600806  1692 rpcz_store.cc:276] 0709 13:00:31.496885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.598167 (+2101282us) service_pool.cc:224] Handling call
0709 13:00:33.598448 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.600129 (+  1681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.600319 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:33.490303  5126 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.601504  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:33.601761  5126 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.601989  1692 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 7. Ops: []
I20260709 13:00:33.602602  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2460) took 1644 ms. Trace:
I20260709 13:00:33.526530  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.603498  1685 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.588296  1510 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:33.542348  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:33.609786  5081 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:33.610430  4907 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.611218  5081 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:33.610190  1693 raft_consensus.cc:2376] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7. Re-sending same reply.
I20260709 13:00:33.612298  5081 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.613044  4907 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:33.613552  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.614256  1539 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:33.615116  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:33.615696  1538 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.616459  5041 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:33.591187  2276 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:33.596030  1691 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:33.623721  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 649) took 2127 ms. Trace:
I20260709 13:00:33.624161  1691 rpcz_store.cc:276] 0709 13:00:31.496663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.595610 (+2098947us) service_pool.cc:224] Handling call
0709 13:00:33.595878 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.623430 (+ 27552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.623654 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:33.596710  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:33.626194  1686 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.597187  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:33.627871  1615 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:33.628333  1687 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:33.517864  2274 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:33.602902  1692 rpcz_store.cc:276] 0709 13:00:31.958101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.601639 (+1643538us) service_pool.cc:224] Handling call
0709 13:00:33.601855 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.602387 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.602534 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:33.629002  1659 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:33.643162  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46029.3us
I20260709 13:00:33.643447  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.650890  1538 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:33.616734  5086 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.616539  4846 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:33.627189  4879 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.660383  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.663290  1612 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:33.664239  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.664526  1511 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:33.664750  1685 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:33.665237  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.665587  4655 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:33.665949  4655 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:33.666276  4655 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.653049  2243 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:33.662298  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 1982) took 2876 ms. Trace:
I20260709 13:00:33.671746  1537 rpcz_store.cc:276] 0709 13:00:30.786064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.254937 (+468873us) service_pool.cc:224] Handling call
0709 13:00:31.287074 (+ 32137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.766486 (+479412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.662019 (+1895533us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54000b0ed4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:33.662229 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096965888}
I20260709 13:00:33.666252  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.676625  1692 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:33.655179  4721 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:33.646440  1611 raft_consensus.cc:2955] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:33.657799  5013 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:33.659955  5086 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:33.686872  1687 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:33.687801  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.658205  4846 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:33.663120  4879 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:33.690923  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.694013  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:33.677994  5073 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:33.689296  1537 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:33.694629  1538 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.691694  1690 raft_consensus.cc:2955] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:33.701030  1538 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:33.689229  5204 consensus_queue.cc:1243] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:33.662878  5172 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:00:33.687852  4765 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.720268  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.720597  1692 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:33.686256  4721 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:33.690861  5086 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.722863  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:33.695550  4879 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.726872  4799 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.728132  4721 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.736537  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:33.736886  1686 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:33.738231  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.695195  5013 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:33.720965  5073 raft_consensus.cc:697] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:33.766057  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.767030  1612 raft_consensus.cc:2410] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:33.768525  1538 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:33.768723  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:33.767617  1687 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:33.770144  1692 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:33.770576  1687 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:33.771919  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.772533  1612 raft_consensus.cc:2376] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10. Re-sending same reply.
I20260709 13:00:33.748977  5126 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.773865  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.779549  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:33.780387  1612 raft_consensus.cc:2410] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 13 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
W20260709 13:00:33.782003  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.787712  1686 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:33.790046  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.791100  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:33.792603  1658 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:33.795373  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 1998) took 1044 ms. Trace:
I20260709 13:00:33.799057  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:33.799757  1538 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.802428  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:33.803714  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 672) took 1042 ms. Trace:
I20260709 13:00:33.785131  2243 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:33.804445  1689 rpcz_store.cc:276] 0709 13:00:32.761438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.104805 (+343367us) service_pool.cc:224] Handling call
0709 13:00:33.787329 (+682524us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400116cd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:33.803648 (+ 16319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107670784}
I20260709 13:00:33.795881  1544 rpcz_store.cc:276] 0709 13:00:32.750924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.851707 (+100783us) service_pool.cc:224] Handling call
0709 13:00:33.795176 (+943469us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54001b7454. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:33.795305 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572007808}
I20260709 13:00:33.812206  1689 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:00:33.813223  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:33.813881  5116 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:33.814999  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:33.815611  1612 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:33.746848  4765 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.815564  2269 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:33.834347  1538 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:33.750900  5013 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.838402  4916 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:33.844838  1612 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:33.812286  5161 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:33.847433  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.848400  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.848949  1539 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:33.852082  1612 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:33.852746  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:33.827939  4915 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.855319  1612 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:33.836203  5121 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.858194  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:33.865278  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 51048.5us
I20260709 13:00:33.866997  2241 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:33.878961  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.868211  2241 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:33.856642  5151 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:33.880247  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.844568  4799 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:00:33.856968  5217 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:00:33.897243  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 689) took 4200 ms. Trace:
I20260709 13:00:33.903817  1612 raft_consensus.cc:1217] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Deduplicated request from leader. Original: 5.4->[7.5-8.6]   Dedup: 8.6->[]
I20260709 13:00:33.904515  1612 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 13:00:33.870756  4811 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:33.897758  1613 rpcz_store.cc:276] 0709 13:00:29.697254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.697426 (+   172us) service_pool.cc:224] Handling call
0709 13:00:29.716615 (+ 19189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.820604 (+103989us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:29.837210 (+ 16606us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.030150 (+192940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.030192 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:30.030236 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.838795 (+2808559us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b18002dcca0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c862a6 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419
0709 13:00:33.896937 (+1058142us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400140ad4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:33.896998 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.897150 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18395,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":12196,"raft.queue_time_us":795,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":16529,"spinlock_wait_cycles":246461440,"thread_start_us":192653,"threads_started":1,"wal-append.queue_time_us":255665,"wal-append.run_cpu_time_us":1830,"wal-append.run_wall_time_us":1262255}
I20260709 13:00:33.907444  5205 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:33.972306  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 135198us
I20260709 13:00:33.972865  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.974681  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:33.976114  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.981916  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.983006  1537 raft_consensus.cc:2393] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 5: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:33.943063  4811 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:33.964375  5081 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.870819  5073 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.964354  5099 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:33.988299  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.989800  1658 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:33.997721  5229 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:00:33.999385  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 669) took 1238 ms. Trace:
I20260709 13:00:33.999581  5172 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.000115  5172 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:33.999797  1693 rpcz_store.cc:276] 0709 13:00:32.760838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.612302 (+851464us) service_pool.cc:224] Handling call
0709 13:00:33.612658 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:33.640365 (+ 27707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.640407 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:33.645938 (+  5531us) log.cc:844] Serialized 52 byte log entry
0709 13:00:33.747699 (+101761us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:33.747737 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.747797 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.999077 (+251280us) raft_consensus.cc:1685] finished
0709 13:00:33.999122 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.999315 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27311,"raft.queue_time_us":28366,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9032,"thread_start_us":63467,"threads_started":1,"wal-append.queue_time_us":178254}
W20260709 13:00:34.003132  5231 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:00:34.003675  4943 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:34.004221  4943 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:34.005406  4915 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.005138  4943 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:34.007089  5226 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
W20260709 13:00:34.008267  5224 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:00:34.008834  4879 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.009630  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2458) took 2052 ms. Trace:
I20260709 13:00:34.009964  1690 rpcz_store.cc:276] 0709 13:00:31.957628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.600771 (+1643143us) service_pool.cc:224] Handling call
0709 13:00:33.601289 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.601614 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.601638 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.602530 (+   892us) log.cc:844] Serialized 564 byte log entry
0709 13:00:33.691581 (+ 89051us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:33.833508 (+141927us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.843334 (+  9826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.843412 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.009452 (+166040us) raft_consensus.cc:1685] finished
0709 13:00:34.009467 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.009582 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8985,"raft.queue_time_us":19532,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4092,"thread_start_us":88698,"threads_started":1,"wal-append.queue_time_us":173747}
I20260709 13:00:34.011693  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 670) took 1250 ms. Trace:
I20260709 13:00:34.012090  1691 rpcz_store.cc:276] 0709 13:00:32.761038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.625139 (+864101us) service_pool.cc:224] Handling call
0709 13:00:33.625508 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.640983 (+ 15475us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:33.688140 (+ 47157us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.864521 (+176381us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.868790 (+  4269us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.868925 (+   135us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:33.878479 (+  9554us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.881380 (+  2901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.881477 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.011508 (+130031us) raft_consensus.cc:1685] finished
0709 13:00:34.011526 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.011637 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20370,"prepare.queue_time_us":124057,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":22644,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":27773,"spinlock_wait_cycles":7197056,"thread_start_us":165338,"threads_started":2,"wal-append.queue_time_us":226167}
I20260709 13:00:34.013401  5084 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.017663  4787 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.023209  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 991) took 1165 ms. Trace:
I20260709 13:00:34.023531  2275 rpcz_store.cc:276] 0709 13:00:32.857936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.858032 (+    96us) service_pool.cc:224] Handling call
0709 13:00:33.023944 (+165912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.430904 (+406960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.022991 (+592087us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54006f6dd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:34.023160 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889655552}
I20260709 13:00:34.025297  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2486) took 1641 ms. Trace:
I20260709 13:00:33.991649  5206 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:34.026245  5206 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:33.979786  5235 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:00:34.025665  1611 rpcz_store.cc:276] 0709 13:00:32.384361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.384476 (+   115us) service_pool.cc:224] Handling call
0709 13:00:33.507206 (+1122730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.507388 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:33.527157 (+ 19769us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.936115 (+408958us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.936378 (+   263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.936438 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:33.936504 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.936595 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.025141 (+ 88546us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400216bd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:34.025239 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1136,"prepare.queue_time_us":20002,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":1351,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":27157,"spinlock_wait_cycles":2579433856,"thread_start_us":117667,"threads_started":1,"wal-append.queue_time_us":73359}
I20260709 13:00:33.982702  5205 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:33.994005  5204 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:33.995952  5099 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:33.992901  5081 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.028584  5205 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.045030  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:34.045445  5081 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:34.046403  1537 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:34.047158  1613 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:34.039805  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:34.039813  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:34.049109  1538 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.048980  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:33.986438  4811 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.036165  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:34.051602  1543 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:34.038985  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:34.043371  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:34.055685  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 1717) took 1838 ms. Trace:
I20260709 13:00:34.056043  1543 rpcz_store.cc:276] 0709 13:00:32.217196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.035912 (+1818716us) service_pool.cc:224] Handling call
0709 13:00:34.055630 (+ 19718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:34.061232  1538 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:33.992658  4707 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.067258  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:34.031534  5204 consensus_queue.cc:1243] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:34.023046  5086 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.041404  5126 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.038244  4901 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.035735  5041 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.041190  5121 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.041425  5172 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.010509  4879 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.036445  4935 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.163997  4935 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.166218  4935 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:34.034487  5099 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:34.167639  5037 raft_consensus.cc:3055] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:34.168040  5037 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:34.168781  5037 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.169859  5037 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.027384  5206 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:34.175442  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:34.176847  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:34.179132  1544 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: [5.7-8.8]
I20260709 13:00:34.180227  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:34.181250  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:34.007109  4765 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.157722  1692 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:34.160902  5041 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.175185  4721 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.183202  1542 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:34.177935  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:34.218189  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 147166us
I20260709 13:00:34.185093  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.220172  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:34.145606  1539 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:34.195132  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:34.221169  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.051995  5116 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:34.200456  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:34.202270  1545 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:34.208674  1541 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:34.211253  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.233847  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.224143  5217 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:34.224604  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.226420  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.229584  1689 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:34.230026  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 743) took 1137 ms. Trace:
W20260709 13:00:34.239524  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.239569  1690 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:34.239748  1540 rpcz_store.cc:276] 0709 13:00:33.092816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.202168 (+109352us) service_pool.cc:224] Handling call
0709 13:00:34.229873 (+1027705us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b540009f954. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:34.229977 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22947072}
W20260709 13:00:34.231315  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.026664  4655 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.234989  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.241756  1691 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:34.243105  2273 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:34.247099  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.247762  1691 raft_consensus.cc:2376] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10. Re-sending same reply.
I20260709 13:00:34.248780  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.249432  1691 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:34.246353  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.251492  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.252120  1689 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:34.252825  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.253858  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.254496  1689 raft_consensus.cc:2376] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11. Re-sending same reply.
I20260709 13:00:34.255581  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.256067  1689 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:34.256579  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.257853  1689 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:00:34.258323  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.260958  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.241575  5217 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:34.261600  1690 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:34.262509  5116 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.263924  1690 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:34.264382  4655 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:34.266192  5223 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.539s	user 0.002s	sys 0.006s
I20260709 13:00:34.266788  5086 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:34.269129  1688 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:34.270236  1688 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:34.271389  4787 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:34.273315  4721 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.277990  1611 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:34.278877  1688 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:34.278489  1611 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:34.277011  5227 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.549s	user 0.002s	sys 0.004s
I20260709 13:00:34.289146  1611 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.294085  1611 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.300711  1691 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:34.262193  5217 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:34.308800  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 98550us
I20260709 13:00:34.312662  1611 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:00:34.313063  1611 pending_rounds.cc:85] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 9
I20260709 13:00:34.313300  1611 pending_rounds.cc:107] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:00:34.313522  1611 raft_consensus.cc:2889] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:34.316116  4846 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.317056  4846 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:34.317456  1509 connection.cc:256] RPC call timeout handler was delayed by -1.067374846000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:00:34.317859  1509 connection.cc:256] RPC call timeout handler was delayed by -1.0165755990000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
I20260709 13:00:34.320061  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:34.322297  2243 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.323092  1509 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:34.325865  2243 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:34.324580  1658 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:34.330749  1509 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:34.331509  4655 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.333544  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:34.334232  4655 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:34.334599  4655 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.334770  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.335064  4655 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.335811  1509 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:34.342348  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:34.340859  5116 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.340651  5086 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:34.341394  4901 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:34.340580  5081 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:34.344537  5099 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:34.341778  5215 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.343442  4907 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.341895  5243 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.356374  1660 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.357156  5242 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:34.357805  2268 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:34.373306  5099 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.377713  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:34.379022  5099 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:34.358510  2275 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.380645  2275 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:34.373059  5215 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:34.355635  4901 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.383518  5215 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.383617  4901 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.365224  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 923) took 1145 ms. Trace:
I20260709 13:00:34.366407  1510 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:34.386821  2277 rpcz_store.cc:276] 0709 13:00:33.219390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.219515 (+   125us) service_pool.cc:224] Handling call
0709 13:00:33.219725 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.392580 (+172855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.365026 (+972446us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54006185d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:34.365173 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245955968}
I20260709 13:00:34.371333  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:34.388564  1611 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:34.374147  2270 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:34.389209  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.377241  2268 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.344599  4787 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:00:34.382216  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:34.363541  5086 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:34.394915  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:34.395202  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:34.398424  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.402127  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:34.360473  5081 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:34.404358  1660 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:34.408401  5081 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.415962  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:34.410486  5254 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.396173  5206 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.401119  5013 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.414126  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.395630  5086 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.415324  4855 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:00:34.408166  5204 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:34.435550  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 93242.1us
I20260709 13:00:34.433277  1660 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.436316  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:34.430423  5084 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:34.401767  5151 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:00:34.439857  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:34.406883  5099 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:00:34.430859  5086 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.423008  5236 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:34.423234  5254 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:34.441020  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 52778.7us
I20260709 13:00:34.442339  4707 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:34.439975  5258 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.440550  5084 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.446866  5254 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.456045  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:34.451308  5236 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:34.523094  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 83305.4us
I20260709 13:00:34.454954  5168 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.449852  5217 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.6, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:00:34.510147  5151 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:34.508988  5253 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.510226  5242 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.454404  5013 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:00:34.525391  5206 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.557185  1614 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:00:34.560413  5152 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:00:34.560972  5236 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:34.562561  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1718) took 1800 ms (client timeout 1815 ms). Trace:
W20260709 13:00:34.562943  1694 rpcz_store.cc:269] 0709 13:00:32.762075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.017210 (+255135us) service_pool.cc:224] Handling call
0709 13:00:34.562412 (+1545202us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400304154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:34.562514 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854784384}
I20260709 13:00:34.568930  5041 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:34.571030  1693 raft_consensus.cc:2410] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:34.530923  5193 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:00:34.571631  5205 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:34.572364  5205 consensus_queue.cc:1243] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:34.514156  4655 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.574383  4655 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:34.549465  4660 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:34.576412  4660 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:34.577404  4660 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.577816  5081 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.582666  1694 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:34.584218  1616 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:34.591208  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.607434  1619 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:34.609535  1614 pending_rounds.cc:85] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 5
I20260709 13:00:34.609891  1614 pending_rounds.cc:107] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:34.610145  1614 raft_consensus.cc:2889] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:34.549350  5217 consensus_queue.cc:1243] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:34.514987  5258 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:00:34.552937  5242 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:34.571645  4811 consensus_meta.cc:287] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
I20260709 13:00:34.540134  5168 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.640715  4660 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.647773  4811 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.664129  5155 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.667064  2276 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:34.667976  4811 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.663489  4901 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.667884  5155 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.673045  5205 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:00:34.664973  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 45477.9us
I20260709 13:00:34.675704  5081 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:34.676963  2241 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.678028  4721 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.681128  4901 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.683051  5155 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:34.686206  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:34.657886  5041 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:34.701308  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.703841  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:34.705426  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:34.707118  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.613003  4787 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:00:34.728363  4811 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:34.653514  5242 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.729324  5168 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.730003  5168 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:34.546773  5151 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:34.732265  5151 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.713790  5155 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.725023  1687 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.735419  1685 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:34.735852  1685 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:34.735891  1687 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.736734  1685 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.738029  1685 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.738796  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:34.725152  4721 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:34.739341  4721 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:34.739701  4721 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.739355  1619 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:34.713770  5205 raft_consensus.cc:2764] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:00:34.747485  4918 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:00:34.748027  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1725) took 1984 ms. Trace:
I20260709 13:00:34.747828  5215 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.748441  1687 rpcz_store.cc:276] 0709 13:00:32.763722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.693262 (+929540us) service_pool.cc:224] Handling call
0709 13:00:33.767507 (+ 74245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.698796 (+931289us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54000d82a0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd2306f 00007f29ebd9bf60 00007f29ebd9d7de 00007f29ebda7b49 00007f29ebda8416 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62
0709 13:00:34.747221 (+ 48425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.747249 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.747282 (+    33us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:34.747314 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.747876 (+   562us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.747979 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":856,"raft.queue_time_us":929,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":62,"spinlock_wait_cycles":24767872}
W20260709 13:00:34.750294  5012 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:00:34.607173  5206 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.752004  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1723) took 1988 ms. Trace:
I20260709 13:00:34.753387  5206 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.753089  1685 rpcz_store.cc:276] 0709 13:00:32.763135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.665623 (+902488us) service_pool.cc:224] Handling call
0709 13:00:33.665953 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.735330 (+1069377us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b54000f1ca0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd1cdc0 00007f29ebda71c0 00007f29ebda8231 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c
0709 13:00:34.750026 (+ 14696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.750054 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.750087 (+    33us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:34.750121 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.751436 (+  1315us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.751566 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1012,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":126064000}
I20260709 13:00:34.758903  5153 consensus_queue.cc:1059] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:00:34.760360  5116 raft_consensus.cc:3055] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:34.760798  5116 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:34.761770  5116 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.768507  5254 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.777228  5203 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:34.778028  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 254078us
W20260709 13:00:34.786649  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.787204  1509 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.750268  5215 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:34.788792  5041 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:00:34.806416  5086 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.808472  5086 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:34.809234  5254 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:34.790597  5081 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:34.815080  5081 raft_consensus.cc:697] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:34.815986  5081 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.787732  4660 consensus_queue.cc:1059] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:34.819451  5254 raft_consensus.cc:3055] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:34.819511  5116 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.823294  5254 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:34.823338  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:34.824685  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.825469  1694 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:34.825853  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.826311  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.826841  1694 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.827020  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.827508  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.827595  1693 raft_consensus.cc:2376] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10. Re-sending same reply.
I20260709 13:00:34.830138  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:34.826347  1685 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.808149  5242 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.836759  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.838403  1691 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:34.845973  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.845234  1687 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:34.835987  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.847872  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:34.824276  5254 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.850214  1694 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:34.848228  1687 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.855338  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:34.855588  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.856273  1686 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:34.856215  1685 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:34.813361  4721 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:34.789744  5258 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:00:34.866303  1691 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:34.858512  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:34.833489  4655 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.868839  5261 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:34.871326  5261 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:34.849149  4660 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.854929  5215 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:34.876788  5261 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.883699  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:34.884478  1540 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
I20260709 13:00:34.882797  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:34.887295  1545 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.885958  1658 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:34.890798  1537 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.850277  5148 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:00:34.897469  1542 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:34.904052  1545 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:34.878374  4655 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:34.878993  5254 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.908277  1540 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:34.873144  5253 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:00:34.887399  5215 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:34.895229  5161 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:34.914762  4973 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:34.956655  4973 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:34.956964  4973 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:34.957350  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:34.957661  4973 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:34.915220  5058 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:34.918897  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.958572  5215 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.905882  4945 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.965073  5148 raft_consensus.cc:3055] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:34.921937  1615 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:34.965615  5148 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:34.966720  5148 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:34.968143  5148 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.975000  5242 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:34.920826  2243 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:34.936789  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:34.976544  1541 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
W20260709 13:00:34.977581  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 56806.4us
I20260709 13:00:34.938501  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.979532  5258 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:34.939055  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:34.941336  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 975) took 1201 ms. Trace:
I20260709 13:00:34.982026  2273 rpcz_store.cc:276] 0709 13:00:33.740197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.740335 (+   138us) service_pool.cc:224] Handling call
0709 13:00:33.740596 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.250180 (+509584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.941072 (+690892us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54004790d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:34.941270 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155065600}
I20260709 13:00:34.943166  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:34.944036  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:34.945251  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.983768  1538 raft_consensus.cc:2376] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7. Re-sending same reply.
W20260709 13:00:34.949222  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 240270us
I20260709 13:00:34.949483  1539 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:34.949811  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.011s	sys 0.017s
W20260709 13:00:34.940618  5251 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.022s	sys 0.027s
W20260709 13:00:34.987272  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.011s	sys 0.017s
W20260709 13:00:34.998221  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 603642us
I20260709 13:00:35.000924  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:35.001155  1615 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.985495  1658 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:35.006289  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:35.054965  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:35.055605  1617 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 4.
I20260709 13:00:35.003649  1536 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:35.052469  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 47905.6us
W20260709 13:00:35.064940  1584 connection.cc:256] RPC call timeout handler was delayed by -1.1157153230000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 13:00:35.065986  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:35.067355  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.004s	sys 0.028s
I20260709 13:00:35.067813  1694 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:35.071543  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.004s	sys 0.028s
W20260709 13:00:35.071869  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 625892us
I20260709 13:00:35.072438  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:35.068353  1538 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.069020  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:34.955092  5161 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.077947  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:35.078611  1620 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.079342  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:35.080627  1616 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:00:34.997639  5251 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.022s	sys 0.027s
I20260709 13:00:35.075580  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:34.959427  4655 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:34.961194  4973 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.091020  1619 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.981628  5253 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:34.995398  5154 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:35.114210  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:35.130151  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:35.135370  2269 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.050800  4721 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:35.065186  4901 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:35.139647  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 64182us
I20260709 13:00:35.061482  4846 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:35.147782  2276 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:35.090543  5161 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.077339  4811 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:35.169379  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:35.178459  2268 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.169492  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:35.157205  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 83976.2us
W20260709 13:00:35.179502  1584 connection.cc:256] RPC call timeout handler was delayed by -1.108515323000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 13:00:35.153509  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:35.003273  5028 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.136s
I20260709 13:00:35.065328  5155 consensus_queue.cc:1059] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:00:35.064446  5188 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:00:35.136852  5154 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.188026  1620 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:35.189428  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:35.207875  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:35.113749  5081 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:00:35.149863  5013 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:35.182873  4846 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.133086  5037 consensus_queue.cc:1059] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:00:35.243949  5037 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.244405  5037 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.158447  5205 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:00:35.169065  5261 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:00:35.243181  5275 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:35.193966  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1737) took 1791 ms. Trace:
I20260709 13:00:35.189163  4721 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:35.147923  5268 consensus_queue.cc:1059] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:00:35.251681  1692 rpcz_store.cc:276] 0709 13:00:33.402805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.771937 (+369132us) service_pool.cc:224] Handling call
0709 13:00:33.809281 (+ 37344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.201220 (+391939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.188403 (+987183us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400323cd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:35.193916 (+  5513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800790400}
W20260709 13:00:35.255879  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 77652.3us
I20260709 13:00:35.280898  5275 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:35.297399  5275 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.301177  4846 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:35.211055  4765 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:35.257579  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 68217us
I20260709 13:00:35.278519  5037 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:35.305668  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:35.311549  1536 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:35.245698  5165 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.234431  1619 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:00:35.326747  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.214089  5154 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:35.303119  5243 raft_consensus.cc:3055] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:35.303958  5028 raft_consensus.cc:3055] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:35.309090  5152 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:35.242138  5270 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:00:35.327497  4901 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:35.310552  5261 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:35.314355  5275 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.346172  1584 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:35.335108  5099 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.336604  5037 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.251351  5013 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:35.406766  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.314684  4765 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.342165  4846 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:35.351214  5205 raft_consensus.cc:3055] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:35.327433  5272 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:00:35.304442  4655 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.385869  5255 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:00:35.416131  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 70051.5us
I20260709 13:00:35.352583  5283 raft_consensus.cc:3055] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:35.339205  5165 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:35.385572  5188 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:35.344771  5116 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.345067  5028 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:35.352733  4945 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:35.423199  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:35.396910  5267 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:35.431258  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:35.407373  4935 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.328814  4811 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.412006  4846 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:35.457194  1690 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:00:35.457603  1690 pending_rounds.cc:85] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 5
I20260709 13:00:35.457911  1690 pending_rounds.cc:107] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 8.6
W20260709 13:00:35.443768  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.419346  5205 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:35.407778  5099 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:35.454314  2271 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.407259  5261 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:35.458644  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 155106us
I20260709 13:00:35.345606  5243 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:35.434778  5283 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:35.458266  1690 raft_consensus.cc:2889] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.439877  5285 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:35.453156  5236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.011s	sys 0.003s
I20260709 13:00:35.480234  4918 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:35.481552  4855 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.435243  5037 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.456923  5188 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:35.460911  4846 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.463971  5287 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:35.489902  5271 log.cc:927] Time spent T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 13:00:35.498230  4918 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.509835  4918 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:35.488812  5285 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:35.503484  5287 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.504118  5161 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:35.462643  4935 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:00:35.505910  5282 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:35.461001  4945 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.463727  5267 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.507319  5290 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:35.436869  5255 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:35.462867  4901 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:35.514298  4765 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:35.499423  5028 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.515563  5013 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:35.519745  5268 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:00:35.510878  4918 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:00:35.515717  5205 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.517345  5261 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:35.653258  2271 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:35.518097  5188 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:35.499790  5236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.013s	sys 0.004s
I20260709 13:00:35.520151  5283 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.464948  5289 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:35.510494  5276 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:00:35.551082  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:35.600514  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.607932  2274 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:00:35.660555  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 229464us
I20260709 13:00:35.673838  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:35.674479  5028 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:35.677016  5301 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:00:35.677242  4935 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:35.677486  5203 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.677940  5203 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:35.679796  5203 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:35.681244  5255 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:35.609098  5243 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.659543  5305 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.725436  5305 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.697707  5037 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:35.727680  5305 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:35.699929  5161 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:35.718547  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:35.731393  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:35.734345  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:35.720451  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 249554us
I20260709 13:00:35.697801  4945 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:35.722579  5148 consensus_meta.cc:287] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.000s
I20260709 13:00:35.723263  5302 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.682719  5288 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:00:35.677973  5270 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.736593  5203 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.738945  5161 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:00:35.740609  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:35.753705  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:35.753753  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:35.759449  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:35.759588  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:35.760807  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 269708us
W20260709 13:00:35.737176  5242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.007s	sys 0.015s
I20260709 13:00:35.761610  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:35.733491  5289 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:35.738152  5168 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.765954  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.770480  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:35.737370  5307 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:35.775571  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.802899  1538 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.797705  1584 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:35.803445  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:35.672822  5285 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.811195  1536 raft_consensus.cc:2410] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:35.809126  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:35.809346  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:35.808795  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:35.814442  1688 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.814973  1542 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
W20260709 13:00:35.812952  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.012s	sys 0.008s
W20260709 13:00:35.815506  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.012s	sys 0.008s
I20260709 13:00:35.815605  1539 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:35.805805  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:35.759999  5309 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.816232  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:35.824416  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:35.757929  5203 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:35.826645  1692 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:35.764498  5242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.007s	sys 0.015s
I20260709 13:00:35.829305  1538 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:35.763984  4721 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:35.767058  5270 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.809118  5161 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.803822  5311 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.832476  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:35.759322  5302 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.844784  2272 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:35.866462  1694 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:35.868710  1692 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:35.830034  4811 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.874756  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:35.877936  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:35.875558  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:35.808965  5168 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.830463  5305 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:35.839994  4945 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:35.830322  5037 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:35.804334  5289 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:35.831427  5154 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.983997  5165 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:35.984702  5293 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:35.873678  5311 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:35.879940  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:36.002449  1694 raft_consensus.cc:2393] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:35.844230  5285 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.905026  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:35.830655  4655 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:35.845203  5309 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:35.906958  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:35.987874  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 110151us
I20260709 13:00:35.963690  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:35.874066  5203 raft_consensus.cc:2764] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:00:35.991453  1613 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:35.938583  5291 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.938241  2271 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:35.993394  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:35.993626  5152 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.993976  4935 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:35.979888  4721 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.996855  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 734) took 1536 ms. Trace:
I20260709 13:00:35.878270  4811 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.019474  1611 rpcz_store.cc:276] 0709 13:00:34.460018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.507797 (+ 47779us) service_pool.cc:224] Handling call
0709 13:00:34.525479 (+ 17682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.525677 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:34.840399 (+314722us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.995876 (+1155477us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18003cbe00. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ebd9d060 00007f29ebdaf716 00007f29ebdc0287
0709 13:00:35.996260 (+   384us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.996457 (+   197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.996510 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:35.996576 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.996657 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.996788 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16690,"prepare.queue_time_us":427535,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":58625,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6088,"spinlock_wait_cycles":40277760,"thread_start_us":603441,"threads_started":3,"wal-append.queue_time_us":375133}
I20260709 13:00:35.937508  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:35.837792  5317 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 13:00:35.851241  5308 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.873555  4901 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 13:00:35.878819  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:36.028092  1617 raft_consensus.cc:2393] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:36.005426  1616 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:36.008057  5316 log.cc:927] Time spent T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 13:00:36.013948  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.973626  4855 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:35.872257  5161 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.988286  5270 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:00:36.029559  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:36.035748  1692 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:36.015727  4655 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:36.005170  5305 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.005879  5309 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:35.989130  5037 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:35.999496  4945 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.045665  1616 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
W20260709 13:00:36.084173  5275 consensus_meta.cc:287] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.677s	user 0.008s	sys 0.002s
I20260709 13:00:36.043198  5270 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:36.008723  5293 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.034255  5308 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.099830  5258 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:36.100242  5258 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:36.101029  5258 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.101662  5293 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:36.102174  5258 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.102232  4945 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:36.107769  4846 consensus_meta.cc:287] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.002s
I20260709 13:00:36.085613  4811 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:36.052371  5302 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:36.108680  5308 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.109244  4655 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.108510  4846 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.052886  5268 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:36.113216  5305 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:36.088248  5309 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.113888  5270 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:36.115521  5289 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:36.116425  4846 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:36.113116  5268 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:36.110323  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:36.119604  2270 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:36.040788  5311 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:36.118201  5268 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.097993  5168 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:36.138654  5154 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:36.199438  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:36.214864  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 221504us
W20260709 13:00:36.219323  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.223392  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:36.020522  5291 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.216986  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:36.115258  5270 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.152772  5292 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:36.108698  5037 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.244405  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:36.136201  5303 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:00:36.206799  5151 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:36.213966  5268 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:36.135439  5161 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.215893  5165 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.214545  5267 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.251552  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:36.251658  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:36.252480  2275 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
W20260709 13:00:36.250280  5260 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.725s	user 0.011s	sys 0.000s
I20260709 13:00:36.246016  4901 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.246196  5308 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:36.246811  5292 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:36.248373  5013 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.253592  5161 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.259900  4945 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:36.253473  5165 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.252190  5273 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:36.264689  5291 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:36.266016  5267 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:36.277421  5013 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:36.355633  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.280807  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2473) took 2088 ms. Trace:
I20260709 13:00:36.356504  1691 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:36.297518  5285 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:36.386327  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.383635  1690 rpcz_store.cc:276] 0709 13:00:34.192613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.264603 (+ 71990us) service_pool.cc:224] Handling call
0709 13:00:34.264832 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.490230 (+1225398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.280550 (+790320us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003246d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:36.280728 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741202304}
I20260709 13:00:36.275190  5332 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:36.275619  5308 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.377985  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:36.275683  4901 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.372713  4707 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.389415  4765 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:36.376176  5154 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.374979  4655 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.382793  5273 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:36.405683  5273 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.401386  5325 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:36.407694  5165 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.401607  4707 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.382584  5289 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:36.388904  5313 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.415304  1538 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:36.357667  5161 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.416672  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:36.417512  1544 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:36.404179  4901 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.411000  4655 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.415868  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:36.434460  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:36.434960  1538 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.378832  4945 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.391619  5203 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:36.392226  5267 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:36.386837  5335 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:36.431268  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:36.445416  1542 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:36.439134  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:36.439474  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 74092.3us
W20260709 13:00:36.439740  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44846.5us
I20260709 13:00:36.446532  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:36.447515  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:36.444207  1538 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:36.404229  5013 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.452025  1541 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:36.430446  5313 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:36.453128  5333 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:36.384465  5309 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.469453  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:36.469542  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:36.470063  1687 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:36.410847  5154 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.423915  5275 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.429637  4660 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.402650  4765 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.491117  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:36.492007  1538 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:00:36.486310  1614 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:00:36.487727  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:36.493209  1614 pending_rounds.cc:85] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 6
I20260709 13:00:36.493484  1614 pending_rounds.cc:107] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:00:36.493693  1614 raft_consensus.cc:2889] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.469766  4707 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:36.467453  5308 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:36.479717  5116 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:36.509624  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.510067  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:36.509938  5344 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:36.510281  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:36.511761  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:36.513201  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:36.513916  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:36.540696  2270 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:36.482704  5275 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.514973  5291 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:36.516595  4765 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:36.518975  5338 log.cc:927] Time spent T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:00:36.536458  4935 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:36.565968  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:36.467278  5289 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.566286  5206 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.566552  1613 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.523541  1538 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:36.524267  1541 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:36.524078  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:36.525732  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:36.568176  1542 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.526250  5168 consensus_queue.cc:1059] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:36.527139  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:36.527937  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:36.481415  4846 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:36.467425  5203 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.537119  1614 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:36.484326  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:36.508388  4787 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:36.482412  4660 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.546187  1540 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:36.565740  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:36.600260  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.577273  2273 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:36.537626  5332 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:36.578914  1617 raft_consensus.cc:2393] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:36.525012  1544 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:36.542692  5116 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.568697  5270 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.611394  5168 consensus_queue.cc:1243] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:36.613986  4945 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:36.542441  5255 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:00:36.596825  5302 consensus_queue.cc:1059] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:00:36.604095  4787 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:36.615128  5339 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:00:36.622792  4660 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:36.624593  5343 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:00:36.624850  1615 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:36.545231  4707 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:00:36.625921  4707 raft_consensus.cc:3055] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:36.626253  4707 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:36.627153  4707 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.628484  4707 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.629594  4787 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:36.632022  5275 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.635483  5161 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.636917  4655 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.578225  4721 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:36.545138  5344 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.641213  5344 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.643278  5116 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:36.642987  5332 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.644922  5309 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:36.576174  5267 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.647922  5313 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:36.640823  5270 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.617161  5302 consensus_queue.cc:1243] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:36.615437  1542 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:36.597074  5206 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.740185  5353 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.203s
I20260709 13:00:36.815331  1693 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:36.816143  5289 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.816871  4945 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.816756  5289 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:36.566295  4935 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:36.813500  4846 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:37.065896  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.018s	sys 0.041s
W20260709 13:00:37.260231  1613 consensus_meta.cc:287] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.002s
I20260709 13:00:37.260915  1613 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
W20260709 13:00:37.257546  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.262696  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.256650  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.066149  5188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.015s	sys 0.044s
W20260709 13:00:37.178403  5350 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:00:36.893031  4765 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.867233  5116 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:36.817353  4945 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 13:00:37.260320  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.021s	sys 0.048s
W20260709 13:00:37.266258  5188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.017s	sys 0.051s
W20260709 13:00:37.268221  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.260154  5206 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:37.255679  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 771374us
I20260709 13:00:36.823514  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:36.920850  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.283126  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:37.283725  1694 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:37.284248  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:37.292599  1543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.012s	sys 0.012s
I20260709 13:00:37.271837  4765 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:37.294814  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 309782us
I20260709 13:00:37.277892  5289 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:37.292948  1543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.012s	sys 0.012s
I20260709 13:00:37.275821  5116 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.288038  5309 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:37.299141  5273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.003s	sys 0.023s
W20260709 13:00:37.314270  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.008s	sys 0.026s
W20260709 13:00:37.315150  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.008s	sys 0.026s
W20260709 13:00:37.314297  2241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.030s	sys 0.021s
W20260709 13:00:37.315762  2241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.030s	sys 0.021s
W20260709 13:00:37.315577  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 773783us
I20260709 13:00:37.302228  5289 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:37.307385  5332 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.316181  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 739208us
W20260709 13:00:37.314968  5273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.003s	sys 0.023s
I20260709 13:00:37.321069  2241 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:37.313859  5206 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.324112  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2500) took 2364 ms. Trace:
I20260709 13:00:37.326894  1685 rpcz_store.cc:276] 0709 13:00:34.959547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.959709 (+   162us) service_pool.cc:224] Handling call
0709 13:00:34.959973 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.960320 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:36.219428 (+1259108us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b180046bd60. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ef79d3c7 00007f29ebdaf9a7 00007f29ebdbf0bf 00007f29ebdbf038
0709 13:00:36.291199 (+ 71771us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.479582 (+188383us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.491520 (+ 11938us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.491646 (+   126us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:36.495920 (+  4274us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.507984 (+ 12064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.508077 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.323628 (+815551us) raft_consensus.cc:1685] finished
0709 13:00:37.323877 (+   249us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.324033 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25908,"prepare.queue_time_us":1127701,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":25585,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":10560,"spinlock_wait_cycles":34230016,"thread_start_us":148107,"threads_started":2,"wal-append.queue_time_us":230973}
I20260709 13:00:37.319734  4935 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:37.324378  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:37.315186  5259 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:37.332552  5257 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 2.662s	user 0.000s	sys 0.035s
I20260709 13:00:37.330348  5273 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:37.334091  5259 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:37.341495  4765 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:37.341168  5259 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.341605  5116 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:37.341991  4765 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:37.342303  5259 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.342386  5116 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:37.323961  5332 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.339666  4945 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:37.330737  5206 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.343744  5099 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:37.353343  5273 raft_consensus.cc:697] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:37.443410  1658 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:37.443439  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 728) took 3075 ms. Trace:
I20260709 13:00:37.444265  1618 rpcz_store.cc:276] 0709 13:00:34.367932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.368107 (+   175us) service_pool.cc:224] Handling call
0709 13:00:34.368470 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.374881 (+  6411us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:34.374908 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.384472 (+  9564us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.454700 (+ 70228us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:34.454754 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.454842 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.331905 (+2877063us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:37.382914 (+ 51009us) raft_consensus.cc:1685] finished
0709 13:00:37.382942 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.443361 (+ 60419us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4093,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"spinlock_wait_cycles":65812736,"thread_start_us":69821,"threads_started":1,"wal-append.queue_time_us":233030}
I20260709 13:00:37.342449  4765 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:37.478076  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 193863us
I20260709 13:00:37.418396  5116 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:37.498791  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.498903  1537 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:37.442693  4945 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.508056  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.507437  1538 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:00:37.571596  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.572209  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:37.573233  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:37.573796  1538 raft_consensus.cc:2368] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 13:00:37.574352  1541 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:37.576805  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.577525  1542 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
W20260709 13:00:37.577029  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.578903  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.579660  1541 raft_consensus.cc:2410] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:37.579867  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:37.583155  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.584076  1542 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
W20260709 13:00:37.536507  5358 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:00:37.596124  1538 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:00:37.603535  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 160195us
I20260709 13:00:37.575057  5099 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:37.604321  5366 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:37.611601  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 325651us
I20260709 13:00:37.591066  5267 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.582065  5073 raft_consensus.cc:3055] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:37.591399  5289 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:37.576239  5116 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.610016  5367 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.585219  4945 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:37.630376  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.634163  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1748) took 2566 ms. Trace:
I20260709 13:00:37.635000  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.636121  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.636852  4907 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.637117  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.608336  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:37.637329  4907 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:37.637930  1538 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:37.638463  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.638801  5385 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:37.639328  5385 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:37.638898  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.640219  1658 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:37.640429  1538 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:37.641348  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.641855  1538 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:37.642120  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.639104  1542 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:37.634544  1688 rpcz_store.cc:276] 0709 13:00:35.067384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.077402 (+ 10018us) service_pool.cc:224] Handling call
0709 13:00:35.077654 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.815265 (+737611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.633866 (+1818601us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54000b13d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:37.634078 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693850368}
I20260709 13:00:37.642204  4907 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:37.610692  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 294149us
I20260709 13:00:37.648255  1510 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:37.620062  5073 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:37.632256  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.657713  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.664047  1542 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:37.612802  5099 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.670003  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 758) took 1256 ms. Trace:
I20260709 13:00:37.670446  1545 rpcz_store.cc:276] 0709 13:00:36.413507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.413613 (+   106us) service_pool.cc:224] Handling call
0709 13:00:36.414011 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:36.414379 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.414411 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:36.430794 (+ 16383us) log.cc:844] Serialized 52 byte log entry
0709 13:00:37.272727 (+841933us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:37.272806 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.272894 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.669767 (+396873us) raft_consensus.cc:1685] finished
0709 13:00:37.669788 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.669946 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8454,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":10483,"thread_start_us":793236,"threads_started":1,"wal-append.queue_time_us":858517}
I20260709 13:00:37.626556  5376 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:37.672688  5376 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.642123  5012 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:37.674921  5385 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.675035  5012 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:37.676060  5012 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:37.627053  5377 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.615691  5366 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.665659  5369 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.659144  5370 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:37.621136  5267 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.628922  5289 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.690755  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.696105  1545 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:37.712921  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:37.713689  2269 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:37.715890  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:37.716575  2269 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:37.680725  5377 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:37.719527  1510 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:37.691310  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 51151.3us
W20260709 13:00:37.688097  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 96830us
I20260709 13:00:37.720942  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.665189  5309 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:37.616223  5273 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.726118  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:37.726269  1688 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:37.726704  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:37.692859  5372 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.727782  1690 raft_consensus.cc:2410] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:37.723407  2269 raft_consensus.cc:3055] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:37.723905  1618 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:37.728883  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:37.730249  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:37.731977  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:37.732513  1688 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:37.732661  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:37.728289  2269 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:37.733356  1510 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:37.733675  1690 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:37.735551  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:37.735652  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:37.736891  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.737411  1694 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:37.741469  1545 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:37.715382  5332 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:37.743441  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:37.732926  5359 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:00:37.734335  2269 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.720885  5377 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.722960  5380 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:37.652807  5367 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.738569  4846 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:37.739302  5376 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:37.759306  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:37.746884  5361 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:00:37.723784  5073 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.731560  5309 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:37.696599  5370 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.694278  5369 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:37.819427  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.975953  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:37.981312  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.788932  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:37.798874  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 77317.3us
W20260709 13:00:37.760005  5368 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:00:37.761157  5206 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:38.008744  5382 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:00:38.008590  5206 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:38.010119  5367 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.011524  1540 raft_consensus.cc:2410] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:37.989450  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:37.994060  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.017277  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.788354  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:37.789424  5380 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:37.752995  5332 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:37.998896  2269 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:38.039330  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.999626  5394 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.003082  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:37.788787  5362 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:00:38.004858  5370 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.005021  5309 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:37.843803  4907 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.997920  4945 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:37.752251  5373 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:37.982722  5386 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.007169  5371 consensus_queue.cc:1059] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:00:37.823738  4707 consensus_meta.cc:287] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.195s	user 0.014s	sys 0.000s
I20260709 13:00:37.820269  5388 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.188s
I20260709 13:00:38.007789  5383 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:00:37.830379  5364 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
W20260709 13:00:37.959123  5188 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.002s	sys 0.007s
I20260709 13:00:37.984536  4765 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:37.856778  5384 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:38.039283  5073 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:38.092868  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.054437  5099 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.086266  5373 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.085691  4907 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:38.013679  5392 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
W20260709 13:00:38.110976  5188 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.003s	sys 0.008s
I20260709 13:00:38.113894  5373 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.111188  5309 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.124742  5309 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.126660  5309 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.128126  5380 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.128309  4907 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:38.131147  5389 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:00:38.109259  5388 consensus_queue.cc:1243] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer e2a2b76c98ee44ff95e6508c34da0e3d log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:38.109391  5384 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.138695  5384 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.139139  5373 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:38.137089  5397 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:00:38.100775  5386 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:38.138171  5259 consensus_meta.cc:287] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.000s
I20260709 13:00:38.139906  5369 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.041076  5332 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.054088  5394 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:38.145905  5289 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.117012  5366 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.151188  5377 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.153508  5377 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.154315  5243 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.154937  5205 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.163587  5332 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.165112  5363 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.165170  5324 raft_consensus.cc:3055] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:38.167088  5324 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:38.168689  5292 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.169844  5292 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.171218  5324 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:38.171820  5372 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:38.172518  5324 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.174917  5293 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:38.175213  5293 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:38.175575  5385 consensus_meta.cc:287] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.002s
I20260709 13:00:38.175855  5293 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.176023  5385 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.176623  5293 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.178143  5385 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.165824  5363 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.181001  5270 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.183943  5287 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.184412  5376 raft_consensus.cc:3055] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:38.184762  5283 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.184768  5376 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:38.186862  5376 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.187927  5376 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.190186  5274 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.190925  5373 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.191936  5384 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.193593  5384 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.190719  5274 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.037427  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.226800  1541 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:38.041662  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:38.227492  1511 connection.cc:256] RPC call timeout handler was delayed by -1.7278304049999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:00:38.228224  1511 connection.cc:256] RPC call timeout handler was delayed by -1.6175286919999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:00:38.232784  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.233037  2268 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:37.996006  1615 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:38.227514  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.012979  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:38.228629  1511 connection.cc:256] RPC call timeout handler was delayed by -1.5878764430000274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
I20260709 13:00:38.227232  1542 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
W20260709 13:00:38.241073  1511 connection.cc:256] RPC call timeout handler was delayed by -1.364652977999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 13:00:38.241669  2277 raft_consensus.cc:2410] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:00:38.241726  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3415061449999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:00:38.245054  1511 connection.cc:256] RPC call timeout handler was delayed by -1.2263872709999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 13:00:38.246675  1511 connection.cc:256] RPC call timeout handler was delayed by -1.1277072509999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260709 13:00:38.250597  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.251592  1544 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:38.256414  5394 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.230273  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.265395  1545 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:38.267475  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:38.268337  1615 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:38.274284  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2502) took 2430 ms. Trace:
I20260709 13:00:38.274744  1689 rpcz_store.cc:276] 0709 13:00:35.843521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.843646 (+   125us) service_pool.cc:224] Handling call
0709 13:00:35.843913 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.096177 (+252264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.096214 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.096251 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:36.096288 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.273770 (+2177482us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540010a4d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:38.273827 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.274049 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579513728}
I20260709 13:00:38.275880  5386 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.277047  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2504) took 2409 ms. Trace:
W20260709 13:00:38.280315  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 55939.1us
I20260709 13:00:38.277475  1692 rpcz_store.cc:276] 0709 13:00:35.867730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.036532 (+168802us) service_pool.cc:224] Handling call
0709 13:00:36.088329 (+ 51797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.112495 (+ 24166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.112538 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.112617 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:36.112686 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.276539 (+2163853us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5400125554. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:38.276628 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.276887 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54096128}
I20260709 13:00:38.285202  5394 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:38.258149  5188 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.288801  5188 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.287971  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2516) took 1650 ms. Trace:
W20260709 13:00:38.297284  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.290961  1693 rpcz_store.cc:276] 0709 13:00:36.637554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.637748 (+   194us) service_pool.cc:224] Handling call
0709 13:00:36.638099 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.815779 (+177680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.287156 (+1471377us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54001ac7d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:38.287484 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406424960}
I20260709 13:00:38.310952  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.311721  1613 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
W20260709 13:00:38.312321  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1002) took 2762 ms (client timeout 1672 ms). Trace:
I20260709 13:00:38.312649  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:38.312722  2268 rpcz_store.cc:269] 0709 13:00:35.549502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.550795 (+  1293us) service_pool.cc:224] Handling call
0709 13:00:38.312045 (+2761250us) spinlock_profiling.cc:243] Waited 2.56 s on lock 0x7b54005875d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:38.312183 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5886365056}
I20260709 13:00:38.314114  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.306486  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:38.318940  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.323073  5203 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.331960  5273 consensus_queue.cc:1059] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:00:38.332334  5376 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:38.328223  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2526) took 2350 ms. Trace:
I20260709 13:00:38.334600  5293 raft_consensus.cc:3055] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:38.337323  5154 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.339699  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:38.336392  5293 raft_consensus.cc:740] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:38.343052  5415 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:38.344465  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:38.345240  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.345530  5116 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:38.345721  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.346777  5188 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:38.346877  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 368292us
I20260709 13:00:38.348217  1658 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.349431  5386 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.349895  5386 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.335119  1611 rpcz_store.cc:276] 0709 13:00:35.977649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.021946 (+ 44297us) service_pool.cc:224] Handling call
0709 13:00:38.326810 (+2304864us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:00:38.327153 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.327596 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.327628 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:38.327722 (+    94us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:38.327782 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.327853 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.327995 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5589760}
I20260709 13:00:38.346477  1614 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:38.350342  5386 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.352722  2269 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:38.355373  5073 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.356205  5073 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.343075  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:38.342077  5293 consensus_queue.cc:260] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:38.362797  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 56517.1us
I20260709 13:00:38.365202  5086 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:38.365777  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.365213  5318 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:00:38.365831  5293 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.375049  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.375265  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.376210  2269 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:38.376693  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.377492  1611 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:38.378816  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.381331  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2514) took 1833 ms. Trace:
I20260709 13:00:38.387173  1619 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:38.390280  5363 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.390959  5073 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.391885  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:38.392495  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 2068) took 1885 ms (client timeout 1911 ms). Trace:
I20260709 13:00:38.393798  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1007) took 2632 ms. Trace:
I20260709 13:00:38.394685  1618 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:38.397106  1613 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:38.398872  5283 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:38.400625  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.403249  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:38.404230  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:38.404448  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.411307  5086 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:38.407047  1687 rpcz_store.cc:276] 0709 13:00:36.548064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.548263 (+   199us) service_pool.cc:224] Handling call
0709 13:00:36.548559 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.650958 (+102399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.650998 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.651047 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:36.651088 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.380819 (+1729731us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400161054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:38.380904 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.381127 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234974592}
I20260709 13:00:38.408336  2277 rpcz_store.cc:276] 0709 13:00:35.761276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.761392 (+   116us) service_pool.cc:224] Handling call
0709 13:00:38.393549 (+2632157us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b540071dc54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:38.393715 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5678218112}
I20260709 13:00:38.413861  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 757) took 2000 ms. Trace:
I20260709 13:00:38.414947  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2515) took 2540 ms. Trace:
I20260709 13:00:38.414840  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.403867  2243 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:38.413887  5267 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.413890  5386 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.418251  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.419027  1615 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:00:38.416000  1620 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:00:38.408221  1617 rpcz_store.cc:269] 0709 13:00:36.507054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.510071 (+  3017us) service_pool.cc:224] Handling call
0709 13:00:38.392055 (+1881984us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b5400140ad4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:38.392255 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88114944}
I20260709 13:00:38.427865  1619 rpcz_store.cc:276] 0709 13:00:35.874036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.874159 (+   123us) service_pool.cc:224] Handling call
0709 13:00:38.385969 (+2511810us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:00:38.386427 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.407492 (+ 21065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.414867 (+  7375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16343936}
I20260709 13:00:38.434728  2275 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.433434  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2527) took 2440 ms. Trace:
I20260709 13:00:38.439927  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:38.440270  5360 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:38.440774  1509 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.440966  5360 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.443148  2276 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.427362  5283 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:38.447661  5283 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.454991  5363 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.455240  2269 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:38.455443  5363 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.455718  5360 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.455895  5363 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.456322  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.456856  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1003) took 2754 ms. Trace:
I20260709 13:00:38.457443  1619 raft_consensus.cc:2410] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:38.457299  2271 rpcz_store.cc:276] 0709 13:00:35.702244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.702384 (+   140us) service_pool.cc:224] Handling call
0709 13:00:35.727119 (+ 24735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.016059 (+288940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.456364 (+2440305us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54002b0554. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:38.456661 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484751616}
I20260709 13:00:38.458715  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.458941  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:38.459461  1611 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
W20260709 13:00:38.459846  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2521) took 2578 ms (client timeout 1786 ms). Trace:
I20260709 13:00:38.460352  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.460554  4935 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.460812  1509 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.461036  4935 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.461401  4935 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.461549  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.462746  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.463666  1613 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:00:38.427515  1543 rpcz_store.cc:276] 0709 13:00:36.413222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.416334 (+  3112us) service_pool.cc:224] Handling call
0709 13:00:36.425582 (+  9248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.425749 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:36.534172 (+108423us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.370218 (+1836046us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b1800066160. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ebd9d060 00007f29ebdaf716 00007f29ebdc0287
0709 13:00:38.384823 (+ 14605us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.413263 (+ 28440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:38.413342 (+    79us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:38.413457 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.413554 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.413694 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41038,"prepare.queue_time_us":409106,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":360920,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":12765,"spinlock_wait_cycles":8499968,"thread_start_us":1221823,"threads_started":3,"wal-append.queue_time_us":831994}
I20260709 13:00:38.465039  1618 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:00:38.465446  1618 pending_rounds.cc:85] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 9
I20260709 13:00:38.465667  1618 pending_rounds.cc:107] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:00:38.465874  5386 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.465953  1618 raft_consensus.cc:2889] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.435923  1620 rpcz_store.cc:276] 0709 13:00:35.993126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.023586 (+ 30460us) service_pool.cc:224] Handling call
0709 13:00:38.415054 (+2391468us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:00:38.415394 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.430273 (+ 14879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.433384 (+  3111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6228352}
I20260709 13:00:38.466742  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.458528  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.458992  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.474228  1614 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
W20260709 13:00:38.460206  1612 rpcz_store.cc:269] 0709 13:00:35.880957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.963928 (+ 82971us) service_pool.cc:224] Handling call
0709 13:00:38.446724 (+2482796us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:38.459763 (+ 13039us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16709504}
I20260709 13:00:38.467996  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.479236  5373 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:00:38.480700  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.483752  5307 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:38.483870  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.484522  5307 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.485152  1618 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:38.485636  1618 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:38.486804  5394 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.486619  1618 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:38.486894  2243 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:38.487352  2272 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEARNER]: Advancing to term 7
I20260709 13:00:38.487690  1618 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.488170  5259 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:38.488749  5259 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.489167  5188 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:38.489550  5188 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:38.489918  5188 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.485080  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.490947  4855 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:38.491581  4855 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:38.478088  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 115726us
I20260709 13:00:38.492762  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.479314  5258 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:38.495846  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.498301  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.498924  1585 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:38.500614  5384 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.500974  5324 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.501091  5384 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:38.501705  5384 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.501786  5324 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.503511  1615 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:38.500877  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.504243  1511 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:38.499356  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.487423  5394 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:38.528954  5307 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.529781  5307 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.530278  5307 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:38.530623  1617 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:38.530843  5307 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.521734  5386 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.534022  5386 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.534451  5386 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:38.537202  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.538766  1620 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:38.539741  4935 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:38.543202  1613 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:38.516338  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:38.545333  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 51937us
I20260709 13:00:38.545884  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.546109  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.546546  2271 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:38.547147  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.551167  1614 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:38.551486  5363 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.552750  2269 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:38.553391  5394 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.554817  4855 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.561604  2275 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:38.570263  5363 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.516502  5259 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.582890  1618 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:00:38.583148  5324 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.583405  1618 pending_rounds.cc:85] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 5
I20260709 13:00:38.583809  1618 pending_rounds.cc:107] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:00:38.584167  1618 raft_consensus.cc:2889] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:38.591233  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 99646.3us
W20260709 13:00:38.593511  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.591272  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 92497.4us
I20260709 13:00:38.594983  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.548084  5283 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.597554  1616 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:38.600214  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.601634  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 53243us
I20260709 13:00:38.601890  5287 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:38.602314  5287 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.602666  5287 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.602785  4945 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:38.602727  5416 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.604943  5416 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.605269  5416 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.608397  2276 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:38.626318  1658 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.627090  2272 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:38.627852  5274 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.628221  4935 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.598290  5307 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.630537  5307 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.633093  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2509) took 2412 ms. Trace:
I20260709 13:00:38.633527  1686 rpcz_store.cc:276] 0709 13:00:36.220405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.221568 (+  1163us) service_pool.cc:224] Handling call
0709 13:00:36.221825 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.239801 (+ 17976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.239846 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.383204 (+2143358us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b2c0009d728. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 13:00:38.383948 (+   744us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.507913 (+123965us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:38.507975 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.524969 (+ 16994us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:38.632590 (+107621us) raft_consensus.cc:1685] finished
0709 13:00:38.632618 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.632875 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20618,"raft.queue_time_us":21217,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":2508,"spinlock_wait_cycles":2925312,"thread_start_us":123472,"threads_started":1,"wal-append.queue_time_us":247021}
I20260709 13:00:38.626998  5415 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:38.651053  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 152161us
I20260709 13:00:38.663870  1694 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:00:38.680260  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 87986.6us
I20260709 13:00:38.680824  2270 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:38.684696  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.677228  4945 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:38.692195  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 65972.9us
I20260709 13:00:38.692656  5334 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:38.695150  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 264664us
I20260709 13:00:38.695536  5402 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.699273  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:36.083021   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:38.699926  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 2.183s (SENT) [suppressed 22 similar messages]
I20260709 13:00:38.688692  5086 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.700634  5086 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.701107  5404 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.701654  5404 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.695716  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:38.703549  5086 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.695353  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:38.707505  1686 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:38.704720  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.710019  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:38.710160  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:38.711308  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.710366  5283 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.711459  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.693368  1658 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.693779  5385 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.734783  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:38.720399  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 211422us
I20260709 13:00:38.714582  4765 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:38.698995  5415 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.706926  4945 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:38.725260  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:38.727346  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.728686  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:38.739318  1686 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:38.694415  4707 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.730904  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:38.734862  5385 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.741578  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.678491  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53120c1adf947fd992e5950edf26301"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55460
I20260709 13:00:38.742969  1617 raft_consensus.cc:606] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:38.736545  1509 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.738798  1615 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.736745  1510 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:38.736579  4935 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:00:38.740504  2277 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:38.743348  1617 raft_consensus.cc:614] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:38.747221  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 53981us
I20260709 13:00:38.748662  4707 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.749697  5206 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:38.750175  5206 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.750604  5206 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.750916  4707 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.745518  5385 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.753015  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:38.753667  1693 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:38.755656  4945 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:38.746718  5073 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:00:38.738637  4765 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:38.758828  5360 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:38.759196  5360 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.759310  4765 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:38.759572  5360 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.760874  5415 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.763001  5378 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.763625  5378 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.765790  5378 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.750839  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:38.748920  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.772920  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.773619  1613 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:00:38.762286  5415 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:38.775465  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.775939  1615 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:38.779096  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.776399  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.778053  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1760) took 1044 ms. Trace:
I20260709 13:00:38.715833  5384 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:38.781265  1694 rpcz_store.cc:276] 0709 13:00:37.730431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.744647 (+ 14216us) service_pool.cc:224] Handling call
0709 13:00:38.658270 (+913623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.664413 (+  6143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.770738 (+106325us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400372b50. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:38.774441 (+  3703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047342976}
I20260709 13:00:38.785254  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.741371  5404 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.784512  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:38.787783  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 51153us
I20260709 13:00:38.789438  1510 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:38.790571  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:38.792627  2269 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:38.793915  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.796470  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.796861  1686 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:38.797734  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.801566  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:38.796878  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.798273  1543 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:38.775013  4935 consensus_queue.cc:1243] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:38.807147  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:38.807518  1618 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:00:38.811601  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.775300  5188 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.813936  1620 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:00:38.815119  1620 pending_rounds.cc:85] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 3
I20260709 13:00:38.815346  1620 pending_rounds.cc:107] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:00:38.815568  1620 raft_consensus.cc:2889] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.813895  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.816880  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:38.818450  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.820566  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.805627  4707 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.821446  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.809840  5373 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:38.809684  5258 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:38.786715  5386 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:38.832414  5386 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:38.833572  5384 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.782694  5287 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.822986  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:38.825691  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.827145  2274 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:38.792268  5073 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:00:38.824971  1540 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:38.807945  4765 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:38.829957  5373 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:38.830039  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.830550  5258 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:38.832340  2243 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:38.844415  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:38.845520  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 45825.3us
I20260709 13:00:38.846122  5378 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:38.852303  1537 raft_consensus.cc:2393] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:38.857898  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.823607  4707 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:38.863260  1536 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:38.863895  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.818172  5283 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:00:38.866004  1687 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:38.843297  4765 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.867005  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:38.866932  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.865983  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:38.878352  1541 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.872702  1617 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:38.826647  5404 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:38.888868  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:38.891006  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.860100  5081 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:38.896178  1536 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
W20260709 13:00:38.896632  5421 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:00:38.897611  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:38.898358  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.893996  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:38.865489  4707 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.903041  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.904434  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.907052  5416 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.909358  1543 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:38.873728  4765 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:38.917738  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.918367  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.864034  5415 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:00:38.919565  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:38.920302  1536 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:38.918572  1538 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:38.921126  5287 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:38.922355  5188 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.923686  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.923250  5258 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:38.913897  5360 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:38.928783  5360 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:38.930335  1511 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:38.878430  5300 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.931030  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.931303  5300 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.936342  1617 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:38.936581  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.937129  1614 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:38.938060  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.938822  1614 raft_consensus.cc:2410] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:38.892868  5404 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:38.961532  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:38.963124  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.964293  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.964349  2243 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:38.965081  1614 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:38.940776  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 240965us
I20260709 13:00:38.931810  5300 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.968104  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:38.968945  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.968065  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.994941  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:38.995709  1694 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:38.997994  1689 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:38.998344  1692 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:38.999377  1687 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:39.001600  1686 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:00:38.960568  5206 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:39.003026  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:38.967111  5404 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.009516  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:39.004520  5206 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:38.953629  5081 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:39.010346  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:38.979287  2243 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:39.005012  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:39.004444  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.032438  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:39.016996  1618 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 5.
W20260709 13:00:39.031587  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 134050us
I20260709 13:00:39.033267  1615 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:38.989893  5318 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.037274  1691 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:38.989225  5287 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.040867  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 61686.8us
I20260709 13:00:39.042148  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:39.045559  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:39.054273  1619 raft_consensus.cc:2410] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:00:39.055008  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:39.051223  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:39.058013  1686 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:39.060686  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:39.062906  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.063854  2270 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:38.960899  5376 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:00:39.065243  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:39.066356  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:38.993186  5188 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:00:39.071575  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:39.072580  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:39.073797  2269 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:38.989769  5274 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:00:39.040477  5073 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:39.069370  1688 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:39.072677  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:39.101466  2276 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.078789  1617 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
W20260709 13:00:39.078969  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 148765us
I20260709 13:00:39.079355  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:39.079017  5081 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:39.066470  5373 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.080070  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.058390  5293 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:39.083984  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.032034  5402 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.067139  5287 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.086920  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.087795  5385 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.088411  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:39.088744  2268 raft_consensus.cc:2393] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:39.092321  1585 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:39.037384  5318 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:39.072046  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.090435  1686 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:39.105506  5307 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.106001  1538 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:39.100225  5073 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:39.079079  1693 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:39.116168  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:39.149746  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.122012  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:39.123562  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:39.141106  1690 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:39.125223  1536 raft_consensus.cc:2376] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8. Re-sending same reply.
I20260709 13:00:39.097500  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:39.145048  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 52797.2us
W20260709 13:00:39.146284  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 105525us
I20260709 13:00:39.119532  1659 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:39.147560  1541 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:39.069038  5206 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:00:39.155579  1688 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:39.151137  1543 raft_consensus.cc:2376] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9. Re-sending same reply.
I20260709 13:00:39.163064  1694 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:00:39.144232  5318 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.172123  1544 raft_consensus.cc:2393] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:00:39.172137  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 52716.6us
I20260709 13:00:39.173010  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.175086  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.174927  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.177614  1686 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:39.154392  5073 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.154183  5259 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:39.185124  1584 leader_election.cc:400] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 13:00:39.185535  1584 leader_election.cc:403] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.190984  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.178403  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:39.194958  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:39.196520  1540 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:39.196648  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:39.191735  1688 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:39.184809  1690 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:39.169428  5405 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:39.205016  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:39.207443  1693 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:00:39.216053  1536 raft_consensus.cc:2376] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8. Re-sending same reply.
I20260709 13:00:39.217708  5255 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.218467  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:39.194267  5259 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:39.213922  5420 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:00:39.234082  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:39.256636  1686 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:39.257586  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:39.258323  1540 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:39.247143  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.233328  1687 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:39.254268  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:39.202039  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:39.172864  5402 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:00:39.264034  1545 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:39.228693  5259 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.270742  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.273623  1685 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:39.260792  1544 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:39.278697  2276 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
W20260709 13:00:39.280771  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 108115us
I20260709 13:00:39.283221  5385 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:39.286762  5311 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:39.292550  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:39.293286  1694 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:39.298781  5307 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:39.300135  5405 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:39.300709  5405 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.307020  5283 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6.
I20260709 13:00:39.312167  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:39.312914  1686 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.314949  5215 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:39.317327  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.318077  1687 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:39.275398  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.320892  1536 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
W20260709 13:00:39.325793  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 319069us
I20260709 13:00:39.313972  4707 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:39.232470  4765 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:39.339342  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.272630  5376 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.340389  1692 raft_consensus.cc:2410] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:39.340996  1540 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:39.337350  1693 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 4.
W20260709 13:00:39.347261  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 291138us
I20260709 13:00:39.350333  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.351078  1687 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
W20260709 13:00:39.354436  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.359064  1545 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:39.327744  5311 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:39.373384  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 99819.5us
W20260709 13:00:39.379396  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.383105  5423 log.cc:927] Time spent T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.112s	user 0.002s	sys 0.001s
I20260709 13:00:39.383754  5404 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.385455  1691 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:39.386157  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:39.386929  2268 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:39.387216  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.382961  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:39.387749  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:39.455097  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:39.460556  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 83549.8us
I20260709 13:00:39.463531  1687 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 13:00:39.465394  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:39.467262  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:39.468221  2269 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:39.469969  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 70697.4us
W20260709 13:00:39.392448  5378 consensus_meta.cc:287] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 13:00:39.466223  2274 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:39.348907  5376 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.472503  2273 pending_rounds.cc:85] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 9
I20260709 13:00:39.408455  5293 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:39.393291  5287 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:39.484606  2273 pending_rounds.cc:107] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:00:39.480645  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:39.463933  5258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.021s	sys 0.069s
I20260709 13:00:39.489451  2273 raft_consensus.cc:2889] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.386077  5311 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.478058  5378 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:39.474291  5386 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:39.528613  1687 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:00:39.532203  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 345838us
W20260709 13:00:39.539597  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 77507.4us
I20260709 13:00:39.540434  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:39.555910  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 385080us
W20260709 13:00:39.557636  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 394974us
I20260709 13:00:39.594421  1687 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:39.597934  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 43523us
I20260709 13:00:39.537007  5360 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:39.602169  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 64983.9us
W20260709 13:00:39.591948  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 206055us
I20260709 13:00:39.597949  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:39.607148  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 66798.7us
I20260709 13:00:39.583786  5416 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:39.609390  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.588595  5378 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.611567  1585 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:39.590041  5188 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:39.610774  1659 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:39.537647  5386 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.601958  5360 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.635506  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:39.644958  1686 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:39.646358  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:39.646962  1692 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:39.647233  1540 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:39.678665  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.682205  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:39.682981  1541 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:39.684489  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 67050us
I20260709 13:00:39.679852  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:39.633060  5360 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.631517  5283 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:39.686147  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:39.695078  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:39.692289  1691 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:39.641671  5385 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:39.701018  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 65588us
I20260709 13:00:39.642792  5404 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:39.700376  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 85126.5us
W20260709 13:00:39.707316  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 95812.6us
I20260709 13:00:39.712905  1585 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:39.695482  4765 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:39.631696  5188 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.723975  5440 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:39.618798  5293 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.698642  5283 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:39.724514  5440 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.706838  5439 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:39.774694  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 122553us
W20260709 13:00:39.779592  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 71971.5us
I20260709 13:00:39.762462  5283 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.787021  1659 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:39.785363  5376 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:39.811976  1541 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
W20260709 13:00:39.813728  5426 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.546s	user 0.007s	sys 0.003s
I20260709 13:00:39.813875  5441 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:39.814513  5441 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:39.817780  5300 consensus_meta.cc:287] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.817s	user 0.011s	sys 0.000s
I20260709 13:00:39.818197  5300 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.818858  5432 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:00:39.820319  5450 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:39.820878  5440 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:39.818850  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 92988.7us
I20260709 13:00:39.824774  1509 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:39.799759  5416 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:39.801324  5299 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:39.843355  1510 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:39.845129  1510 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:39.847168  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:39.847710  1614 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.851101  1660 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:39.868841  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44123.7us
W20260709 13:00:39.871227  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 84350.5us
I20260709 13:00:39.810444  5311 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:39.823874  5386 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:39.887010  1611 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:39.859580  5373 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:39.851259  5255 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.859956  5432 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:39.896639  5464 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:39.897882  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46878.1us
I20260709 13:00:39.883188  5404 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:39.899376  1658 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:39.900300  1659 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:39.900884  5386 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:39.903195  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:39.907975  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.957892  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 47197.1us
I20260709 13:00:39.904655  5373 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:39.981611  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.904858  5432 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:39.984689  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 226797us
I20260709 13:00:39.869105  5450 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:00:39.991050  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 91711us
W20260709 13:00:39.986948  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 83831.9us
W20260709 13:00:39.996742  5458 log.cc:927] Time spent T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.277s	user 0.002s	sys 0.000s
W20260709 13:00:39.999002  5073 consensus_meta.cc:287] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.798s	user 0.008s	sys 0.003s
I20260709 13:00:39.999374  5073 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:40.000311  5405 consensus_meta.cc:287] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.000s
I20260709 13:00:40.000648  5405 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:40.002405  5405 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:39.982031  5311 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.002784  4707 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:40.003353  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:40.025470  1541 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.004184  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:40.004496  5450 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:40.004895  5378 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.005052  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:40.006369  5443 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 13:00:40.037055  5449 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:00:40.039086  5444 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
I20260709 13:00:40.039462  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2061) took 1122 ms. Trace:
W20260709 13:00:40.040920  5436 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 13:00:40.042244  5450 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:39.986474  5432 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:40.044107  5318 consensus_meta.cc:287] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.849s	user 0.010s	sys 0.001s
I20260709 13:00:40.044521  5318 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.045038  5450 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:40.046986  5259 consensus_meta.cc:287] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.002s
I20260709 13:00:40.047345  5259 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.047813  5274 raft_consensus.cc:3055] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:40.048245  5274 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:40.049319  5259 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:40.049093  5274 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.024817  5311 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.050143  5274 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.050340  5311 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:40.008445  5427 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.546s	user 0.000s	sys 0.003s
I20260709 13:00:40.052111  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2059) took 1150 ms. Trace:
I20260709 13:00:40.053650  1541 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:40.052479  1542 rpcz_store.cc:276] 0709 13:00:38.901231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.901362 (+   131us) service_pool.cc:224] Handling call
0709 13:00:38.917407 (+ 16045us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.961593 (+ 44186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.961619 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.011781 (+ 50162us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.509632 (+497851us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:39.509681 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.509763 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.040317 (+530554us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:40.051801 (+ 11484us) raft_consensus.cc:1685] finished
0709 13:00:40.051822 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.052042 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36193,"raft.queue_time_us":47639,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":15698,"spinlock_wait_cycles":632756608,"thread_start_us":414012,"threads_started":1,"wal-append.queue_time_us":568052}
W20260709 13:00:40.008467  5445 log.cc:927] Time spent T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.284s	user 0.000s	sys 0.002s
I20260709 13:00:40.046657  5360 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:40.056213  2270 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:40.009806  5428 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.485s	user 0.001s	sys 0.001s
I20260709 13:00:39.910718  5464 raft_consensus.cc:697] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:40.059418  5073 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:40.059298  5464 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.024086  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:40.062263  4765 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:40.062738  4765 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:40.063476  4765 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.027868  1614 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:39.987624  5373 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.986238  5404 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:40.015879  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:40.029958  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.031204  5448 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.273s	user 0.002s	sys 0.000s
I20260709 13:00:40.031278  1540 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:40.035399  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:40.039844  1537 rpcz_store.cc:276] 0709 13:00:38.917410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.922835 (+  5425us) service_pool.cc:224] Handling call
0709 13:00:38.923163 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.280912 (+357749us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b48002a00d8. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f0cceaa1 00007f29f0cc5b37 00007f29f0cc59ca 00007f29f0dbd26f 00007f29f0dbcf37 00007f29f0dd155c 00007f29f0dd1508 00007f29f0dd1488 00007f29f0dd1443 00007f29f0dd06ec 00007f29efcfaa96
0709 13:00:39.322452 (+ 41540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.322496 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.353371 (+ 30875us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.765008 (+411637us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:39.765441 (+   433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.766219 (+   778us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.039211 (+272992us) raft_consensus.cc:1685] finished
0709 13:00:40.039227 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.039404 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83305,"raft.queue_time_us":76710,"raft.run_cpu_time_us":2038,"raft.run_wall_time_us":280844,"spinlock_wait_cycles":11001728,"thread_start_us":619994,"threads_started":2,"wal-append.queue_time_us":598557}
W20260709 13:00:40.079205  1539 consensus_meta.cc:287] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
W20260709 13:00:40.085038  5429 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.455s	user 0.001s	sys 0.002s
W20260709 13:00:40.088164  5431 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 13:00:40.103592  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.985438  5299 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:40.110143  1539 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
W20260709 13:00:40.121588  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.140622  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 105316us
I20260709 13:00:40.026619  5441 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:40.138181  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:40.144212  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 243935us
I20260709 13:00:40.144950  1544 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:40.146828  5385 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:40.146900  1440 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 3 to 4, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:40.149375  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 785) took 1059 ms. Trace:
I20260709 13:00:40.150857  4945 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.153481  1658 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:40.153120  1543 rpcz_store.cc:276] 0709 13:00:39.089550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.236913 (+147363us) service_pool.cc:224] Handling call
0709 13:00:39.266033 (+ 29120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.342343 (+ 76310us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:39.342386 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.349311 (+  6925us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.591425 (+242114us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:39.591778 (+   353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.592154 (+   376us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.010525 (+418371us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:40.149104 (+138579us) raft_consensus.cc:1685] finished
0709 13:00:40.149124 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.149323 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21428,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4513,"spinlock_wait_cycles":210582400,"thread_start_us":198135,"threads_started":1,"wal-append.queue_time_us":311900}
W20260709 13:00:40.114531  5457 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:00:40.145337  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:40.152804  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:40.107837  5259 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:40.107122  5404 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:40.158283  5425 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.890s	user 0.004s	sys 0.006s
I20260709 13:00:40.158838  5440 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.169909  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:40.159708  5318 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:40.157317  5283 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:40.172326  1659 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:40.173364  5283 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:40.169204  5441 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.174652  5440 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.174968  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 784) took 1085 ms. Trace:
I20260709 13:00:40.176486  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:40.175539  1538 rpcz_store.cc:276] 0709 13:00:39.089269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.234829 (+145560us) service_pool.cc:224] Handling call
0709 13:00:39.268986 (+ 34157us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:39.274903 (+  5917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.274944 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:39.296270 (+ 21326us) log.cc:844] Serialized 78 byte log entry
0709 13:00:39.610283 (+314013us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:39.610318 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.610393 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.038443 (+428050us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:40.162950 (+124507us) raft_consensus.cc:1685] finished
0709 13:00:40.162980 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.174897 (+ 11917us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11174,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"spinlock_wait_cycles":257384320,"thread_start_us":313582,"threads_started":1,"wal-append.queue_time_us":476245}
I20260709 13:00:40.177554  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:40.178083  5441 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:40.178395  5441 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:40.178819  5441 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:40.175009  5440 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.181330  4945 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.182154  4945 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.182552  4945 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:40.183001  4945 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.178849  5450 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.183655  1440 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 6 to 7, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.185578  1440 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:40.187111  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 171327us
I20260709 13:00:40.187772  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:40.189011  1660 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:40.178462  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:40.191316  2241 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:40.192008  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:40.200394  4846 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:40.201146  5307 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.206110  5450 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:40.169010  5404 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:40.169579  5416 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:40.258003  5439 raft_consensus.cc:697] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:40.259771  2241 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:40.269599  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 58927.8us
I20260709 13:00:40.270426  2241 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:40.274289  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:40.274811  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 342) took 16417 ms (client timeout 15000 ms). Trace:
I20260709 13:00:40.274873  5293 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:40.275537  5293 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:40.276502  5293 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.276502  5439 consensus_queue.cc:237] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.277419  4945 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.279014  5451 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:40.279408  5318 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.279662  5451 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:40.192965  5259 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:40.280805  5451 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.281847  5259 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:40.282586  5454 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.459s	user 0.001s	sys 0.009s
I20260709 13:00:40.282851  5363 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:40.283919  5299 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.284228  5363 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:40.284710  5363 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:40.285245  5307 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.285845  5363 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.287521  5386 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:40.288000  5386 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.287849  5441 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.288447  5386 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:40.289670  5441 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:40.267980  5416 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:40.290959  5416 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.219157  5446 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.284685  5299 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:40.279821  5318 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.266482  1440 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 4 to 5, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:40.275486  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:40.309834  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:40.310746  1544 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:40.311177  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:40.298345  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 144879us
I20260709 13:00:40.304926  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2087) took 1359 ms. Trace:
I20260709 13:00:40.313861  1544 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:00:40.322659  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:40.323397  1617 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:40.331133  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:40.331835  1614 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:40.333490  1538 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 13:00:40.336210  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:40.336585  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:40.337519  1543 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.337810  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:40.336156  1440 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 5 to 8, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.314528  1620 rpcz_store.cc:276] 0709 13:00:38.935900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.937275 (+  1375us) service_pool.cc:224] Handling call
0709 13:00:38.937628 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.937947 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:38.937969 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.938419 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.409338 (+470919us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:39.409391 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.409475 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.084478 (+675003us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:40.294856 (+210378us) raft_consensus.cc:1685] finished
0709 13:00:40.294878 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.295059 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505781120,"thread_start_us":470497,"threads_started":1,"wal-append.queue_time_us":665050}
I20260709 13:00:40.336930  1687 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:40.308161  5283 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.336094  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:40.298830  5385 raft_consensus.cc:697] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:40.361737  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:40.338343  1611 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:40.356258  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:40.362582  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:40.360872  1614 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:40.319617  5318 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.361816  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:40.284129  5440 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.363340  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:40.365738  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:40.367901  1542 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:40.368752  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:40.368317  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:40.369812  1685 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:40.371232  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:40.373165  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:40.373695  1544 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.374297  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:40.378198  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:40.363977  5484 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.368098  5307 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:40.386716  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.389416  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:40.389725  1440 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 8 to 9, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.391182  1440 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 6 to 8, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:40.393673  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 204691us
I20260709 13:00:40.394419  1660 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:40.396754  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:40.398854  1544 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:40.322757  5373 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.368443  5441 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.400527  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:40.401716  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:40.402493  1687 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:40.372556  5363 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:40.323909  5432 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.396310  5307 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.416329  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:40.425688  1542 raft_consensus.cc:2393] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:40.426576  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:40.362183  5073 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:00:40.427300  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:40.427726  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:40.428435  2277 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:40.429204  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:40.429061  1440 catalog_manager.cc:5697] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:00:40.419970  1584 connection.cc:256] RPC call timeout handler was delayed by -1.0679427630000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260709 13:00:40.417387  5442 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.416684  5437 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.417795  5452 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.415866  5434 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:00:40.422775  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:40.427089  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:40.441536  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:40.439656  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:40.442801  1440 catalog_manager.cc:5697] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 2 to 4, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.403846  5081 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:40.447822  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 53493.5us
I20260709 13:00:40.393021  5484 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:40.407701  5334 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:40.448897  1542 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.525000  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:40.455451  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 785) took 1102 ms. Trace:
I20260709 13:00:40.522636  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:40.602885  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
W20260709 13:00:41.041956  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.042111  1545 raft_consensus.cc:606] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.042594  1545 raft_consensus.cc:614] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:40.275321  1443 rpcz_store.cc:269] 0709 13:00:23.802738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.803042 (+   304us) service_pool.cc:224] Handling call
0709 13:00:40.215567 (+16412525us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:33.531405 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:33.532051 (+   646us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:33.532104 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:00:33.532142 (+    38us) tablet.cc:662] Decoding operations
0709 13:00:33.533797 (+  1655us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:33.533907 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:33.533936 (+    29us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:00:33.555458 (+ 21522us) tablet.cc:701] Row locks acquired
0709 13:00:33.555498 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:00:33.555677 (+   179us) write_op.cc:270] Start()
0709 13:00:33.555811 (+   134us) write_op.cc:276] Timestamp: P: 1783602033555601 usec, L: 0
0709 13:00:33.555832 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:33.575254 (+ 19422us) log.cc:844] Serialized 7569 byte log entry
0709 13:00:34.225978 (+650724us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda0e28 00007f29ef7db581 00007f29ef7dad58 00007f29ef7df9f1 00007f29ef7df9a9 00007f29ef7df939 00007f29ef7df901 00007f29ef7deb2d 000000000038f354 000000000038f199
0709 13:00:34.275082 (+ 49104us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:34.373959 (+ 98877us) op_driver.cc:464] REPLICATION: finished
0709 13:00:34.572727 (+198768us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29e8c9b0ac 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29ef7dbef0
0709 13:00:35.279264 (+706537us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b18003c36a0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:35.279442 (+   178us) write_op.cc:301] APPLY: starting
0709 13:00:35.279528 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:35.279962 (+   434us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:35.279998 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:35.298166 (+ 18168us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:35.298525 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:00:35.298582 (+    57us) write_op.cc:312] APPLY: finished
0709 13:00:35.437233 (+138651us) log.cc:844] Serialized 132 byte log entry
0709 13:00:35.653885 (+216652us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:35.724539 (+ 70654us) write_op.cc:454] Released schema lock
0709 13:00:35.724638 (+    99us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:35.725072 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:35.725110 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3327800,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":757483,"apply.run_cpu_time_us":26328,"apply.run_wall_time_us":445583,"num_ops":19,"prepare.queue_time_us":397932,"prepare.run_cpu_time_us":25495,"prepare.run_wall_time_us":694799,"raft.queue_time_us":54556,"raft.run_cpu_time_us":57966,"raft.run_wall_time_us":768715,"replication_time_us":817944,"spinlock_wait_cycles":77393664,"thread_start_us":1256756,"threads_started":5,"wal-append.queue_time_us":409921,"wal-append.run_cpu_time_us":24770,"wal-append.run_wall_time_us":2696865}]]}
I20260709 13:00:40.550590  5432 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:40.550282  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:40.551021  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 111435us
I20260709 13:00:40.729069  5484 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:40.527329  1618 rpcz_store.cc:276] 0709 13:00:39.352916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.353107 (+   191us) service_pool.cc:224] Handling call
0709 13:00:39.372395 (+ 19288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.978612 (+606217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.978640 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.021978 (+ 43338us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.299086 (+277108us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:40.299139 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.299234 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.455261 (+156027us) raft_consensus.cc:1685] finished
0709 13:00:40.455284 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.455404 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79639,"raft.queue_time_us":204773,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5887,"thread_start_us":583570,"threads_started":2,"wal-append.queue_time_us":334439}
I20260709 13:00:40.449858  2275 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:00:40.706192  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.041982  1614 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:40.692749  2269 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:40.550511  2270 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:40.452993  5476 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 13:00:40.735093  5274 consensus_meta.cc:287] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.684s	user 0.008s	sys 0.005s
W20260709 13:00:40.469596  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.077708  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:41.050594  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:41.078979  2275 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:41.079618  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:40.740042  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.080549  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:41.080332  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.441498  5437 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.441609  5452 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:40.733016  5478 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 13:00:41.081964  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.728402  5455 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.884s	user 0.000s	sys 0.004s
I20260709 13:00:41.017949  5440 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:40.735471  5311 consensus_meta.cc:287] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.000s
W20260709 13:00:41.049418  5215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.005s	sys 0.005s
W20260709 13:00:41.101351  5215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.008s	sys 0.008s
I20260709 13:00:41.069485  5334 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:41.102967  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 775) took 2040 ms (client timeout 1521 ms). Trace:
W20260709 13:00:41.103480  5318 consensus_meta.cc:287] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.003s
W20260709 13:00:41.103332  1539 rpcz_store.cc:269] 0709 13:00:39.062974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.067943 (+  4969us) service_pool.cc:224] Handling call
0709 13:00:41.102769 (+2034826us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b540025d0d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:41.102880 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010518272}
I20260709 13:00:41.104044  5318 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.104441  5334 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.104816  5300 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:41.105639  2268 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:41.106218  5318 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.080597  1616 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
W20260709 13:00:40.730786  5482 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:41.093887  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:40.946738  5473 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.452953  4945 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:41.046574  5498 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:41.096825  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:41.117228  1618 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.092772  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:40.450313  5464 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.121493  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:41.099560  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:41.122295  2270 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:41.100513  5311 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:40.727875  5485 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.651s
I20260709 13:00:41.064829  5307 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:40.453678  5188 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:40.602866  5453 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.588s
W20260709 13:00:41.110710  1440 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.020s	sys 0.023s
I20260709 13:00:40.430239  5441 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.113524  2275 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:40.602557  5487 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:41.138417  5487 raft_consensus.cc:697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:41.139355  5487 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.097087  5452 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:41.145789  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 405736us
I20260709 13:00:41.083914  1660 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:40.455333  5481 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.733587  5404 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:40.737224  5386 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:41.109166  5293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.008s	sys 0.012s
W20260709 13:00:41.127391  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 73393.4us
I20260709 13:00:41.196406  2243 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:41.099138  5437 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.201143  5318 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:41.135883  1440 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.020s	sys 0.023s
I20260709 13:00:41.112007  5469 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:41.108160  5274 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:41.137660  5259 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:41.172603  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.174834  5434 consensus_queue.cc:1059] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:41.177857  5363 consensus_meta.cc:287] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.754s	user 0.008s	sys 0.000s
I20260709 13:00:41.179391  5441 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:41.182964  5188 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:41.184108  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:41.184250  5404 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:40.696233  5385 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.218305  2277 raft_consensus.cc:2410] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:41.182981  5386 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:41.186161  5311 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:41.098150  5081 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.134202  5473 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.188057  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.132076  5464 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.189661  5435 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:41.191150  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:41.200870  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 116951us
I20260709 13:00:41.242215  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:41.246338  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:41.248306  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 781) took 1898 ms. Trace:
I20260709 13:00:41.256588  5464 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.266598  1616 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:40.451751  5442 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.206810  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:41.267827  2270 raft_consensus.cc:2410] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:41.208102  1618 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:41.208909  5469 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.204831  5259 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.201699  5485 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:41.211401  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:41.285400  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:41.286123  1620 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:41.238258  5441 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.290093  1614 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:00:41.283213  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.293619  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:41.294240  1614 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:41.251557  1619 rpcz_store.cc:276] 0709 13:00:39.350130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.350530 (+   400us) service_pool.cc:224] Handling call
0709 13:00:39.379549 (+ 29019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.475090 (+ 95541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.475148 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.479872 (+  4724us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.635698 (+155826us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:39.635732 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.635794 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.418307 (+782513us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:41.242921 (+824614us) raft_consensus.cc:1685] finished
0709 13:00:41.242946 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.248231 (+  5285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73057,"raft.queue_time_us":163803,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5330,"spinlock_wait_cycles":95300480,"thread_start_us":111052,"threads_started":1,"wal-append.queue_time_us":286320}
I20260709 13:00:41.338557  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:41.339092  1660 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:41.342581  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:41.347227  1614 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:00:41.265592  5311 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.349866  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:41.355594  1616 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.359033  1618 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:41.371977  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 125923us
I20260709 13:00:41.354326  5402 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:41.377485  5402 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.354492  5432 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:41.373202  1660 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:41.376858  5259 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:41.386149  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 670087us
I20260709 13:00:41.381331  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:41.362063  5485 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:41.338474  5469 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:41.365027  5505 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.365613  5188 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:41.414743  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 242153us
I20260709 13:00:41.379125  5215 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.434541  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 61424.2us
I20260709 13:00:41.435487  1660 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:41.386500  5318 raft_consensus.cc:697] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:41.388689  5081 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:41.420960  5259 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:41.433069  5451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.015s	sys 0.024s
W20260709 13:00:41.449337  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 251680us
I20260709 13:00:41.417624  5506 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:41.388442  5432 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.452793  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:41.446861  5259 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:41.438737  5508 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.460353  5473 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:41.460752  2274 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:41.461009  5402 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.460647  5508 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.462708  5508 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:41.463688  5283 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:41.464119  5283 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.438692  5441 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:41.449616  5451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.015s	sys 0.025s
I20260709 13:00:41.426270  5215 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.457484  5509 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:41.467376  5509 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.467710  5509 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.468418  5215 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:41.460179  5259 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:41.472543  5487 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:41.471956  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 90708.9us
I20260709 13:00:41.481005  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:41.482894  5442 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.432137  5437 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.489485  5437 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.456045  5506 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:41.490338  5506 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.491967  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:41.451924  5505 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:41.492720  2273 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:41.495308  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:41.496105  1616 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:41.505198  2275 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:41.506515  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:41.507524  2275 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:41.511456  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.512145  5215 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:41.514793  5318 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.515337  5215 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.517093  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.513671  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2530) took 2366 ms. Trace:
I20260709 13:00:41.522222  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.527890  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2547) took 1004 ms. Trace:
I20260709 13:00:41.531142  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:41.527221  5483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.009s	sys 0.011s
I20260709 13:00:41.529407  1619 rpcz_store.cc:276] 0709 13:00:40.523665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.373904 (+850239us) service_pool.cc:224] Handling call
0709 13:00:41.418885 (+ 44981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.423928 (+  5043us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:41.444503 (+ 20575us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.527584 (+ 83081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.527631 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:41.527675 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.527737 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.527840 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":311,"prepare.queue_time_us":11804,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":3047,"raft.queue_time_us":539,"thread_start_us":52775,"threads_started":1}
I20260709 13:00:41.512564  5441 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:41.536868  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:41.552466  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1033) took 1123 ms. Trace:
I20260709 13:00:41.548801  2241 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:41.554958  2277 rpcz_store.cc:276] 0709 13:00:40.422605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.428993 (+  6388us) service_pool.cc:224] Handling call
0709 13:00:41.534933 (+1105940us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54006702d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:41.546489 (+ 11556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812720512}
W20260709 13:00:41.552834  1509 leader_election.cc:336] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.648s (SENT)
I20260709 13:00:41.551527  5500 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:41.527769  4945 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:41.544950  5483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.009s	sys 0.011s
I20260709 13:00:41.564649  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.554889  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:41.532349  5439 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:41.524039  5452 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.566591  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:41.527460  5437 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.518251  1689 rpcz_store.cc:276] 0709 13:00:39.147169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.205663 (+ 58494us) service_pool.cc:224] Handling call
0709 13:00:39.222478 (+ 16815us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:39.228974 (+  6496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.229023 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:39.325345 (+ 96322us) log.cc:844] Serialized 52 byte log entry
0709 13:00:39.591842 (+266497us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:40.007846 (+416004us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:41.487030 (+1479184us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b180038f8c0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ef79d3c7 00007f29ebdaf9a7 00007f29ebdbf0bf
0709 13:00:41.487160 (+   130us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.513193 (+ 26033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.513344 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.513422 (+    78us) raft_consensus.cc:1685] finished
0709 13:00:41.513460 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.513606 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9236,"prepare.queue_time_us":125896,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":9652,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":395843072,"thread_start_us":438100,"threads_started":3,"wal-append.queue_time_us":382051,"wal-append.run_cpu_time_us":4011,"wal-append.run_wall_time_us":1331853}
I20260709 13:00:41.546789  5441 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:41.552110  5307 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:00:41.572753  5215 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.572270  5469 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:41.577417  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:41.577785  1660 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:41.568750  5435 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:41.579945  2269 raft_consensus.cc:2368] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:41.557454  5512 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.561604  5500 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:41.509763  5505 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.576442  5498 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:41.578634  5441 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:41.547049  5467 consensus_queue.cc:1059] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:00:41.573084  5464 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:00:41.587141  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.580641  5440 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.595563  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:41.585438  5500 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:41.596187  1691 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:41.592911  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:41.582419  5435 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:41.568892  5451 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:00:41.581991  5523 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:41.604476  5435 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.605867  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:41.615964  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:41.616683  1685 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:41.617726  1685 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:41.618932  1694 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:41.595937  5529 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:41.589063  5469 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:41.620543  5529 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.606118  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:41.622229  1690 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:41.623268  5467 raft_consensus.cc:3055] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:41.623647  5467 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:41.624398  5467 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:41.625742  5467 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.624814  5506 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.609932  5259 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.629957  5506 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:41.588711  5299 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.586177  5517 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:00:41.630748  5509 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.629994  5259 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.620999  5469 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.631850  5469 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.632710  5509 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:41.634261  5505 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.607983  5452 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.635301  5464 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:41.635646  5283 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:41.636498  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 49425.6us
I20260709 13:00:41.637706  5283 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:41.638943  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:41.605876  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:41.636265  5435 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.641746  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:41.588248  5498 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:41.647475  1689 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:41.647881  1689 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:41.645495  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:41.648837  1691 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:41.591738  5485 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.665954  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:41.655159  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.667264  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:41.667932  1693 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.645160  5385 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:41.671044  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.668149  1689 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.673424  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:41.647291  5523 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:41.675654  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:41.650619  5498 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.602988  5442 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:00:41.669732  5527 log.cc:927] Time spent T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:00:41.683669  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:41.684386  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:41.687579  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:41.687776  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:41.686502  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:41.667850  5283 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:41.689327  1540 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.691186  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:41.691530  1689 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.669206  5386 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.650918  5464 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:41.669373  5404 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.693037  1511 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:41.674268  5432 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.675487  5505 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.688359  5439 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.688612  5360 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.666395  5441 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:41.702592  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:41.689917  5311 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:41.645984  5500 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.703457  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:41.691133  4945 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:41.690999  5402 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.692557  5283 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:41.676388  5485 consensus_queue.cc:1059] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:41.713645  1537 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:41.698926  5487 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:41.717270  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:41.698817  5484 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:41.719274  5432 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:41.719756  1686 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:41.719810  5500 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:41.682842  5299 consensus_queue.cc:1059] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:00:41.730952  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:41.739042  1690 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:41.701231  5215 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.740414  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:41.718638  5430 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 2.110s	user 0.007s	sys 0.018s
I20260709 13:00:41.712594  1692 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
W20260709 13:00:41.742213  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.688057  5469 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.741200  1542 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:41.712604  5311 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:41.771631  5311 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:41.731499  5283 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.711331  5532 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:41.778900  5532 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:41.779860  5532 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.714774  5439 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.702935  5473 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:00:41.715857  5529 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:41.757897  5373 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:41.759321  5525 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:00:41.760869  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2090) took 2824 ms. Trace:
I20260709 13:00:41.947767  1692 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:41.763338  5435 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:41.763957  5432 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:41.769169  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2551) took 1072 ms. Trace:
I20260709 13:00:41.732249  4945 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:41.806318  1540 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:41.820977  1689 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
W20260709 13:00:41.970813  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.975255  1689 pending_rounds.cc:85] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 6
I20260709 13:00:41.975492  1689 pending_rounds.cc:107] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:00:41.944892  5215 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:41.971742  1616 rpcz_store.cc:276] 0709 13:00:40.697025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.497490 (+800465us) service_pool.cc:224] Handling call
0709 13:00:41.497874 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.526627 (+ 28753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.526695 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.545033 (+ 18338us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.683111 (+138078us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:41.696051 (+ 12940us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.698242 (+  2191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.698308 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.768921 (+ 70613us) raft_consensus.cc:1685] finished
0709 13:00:41.768947 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.769113 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2620,"prepare.queue_time_us":12736,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":14986,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":4309,"thread_start_us":121543,"threads_started":1,"wal-append.queue_time_us":205768}
I20260709 13:00:41.946066  1613 rpcz_store.cc:276] 0709 13:00:38.936815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.953584 (+ 16769us) service_pool.cc:224] Handling call
0709 13:00:38.965742 (+ 12158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.995027 (+ 29285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.995055 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.995472 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.331041 (+335569us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:39.331097 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.331168 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.695575 (+2364407us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:41.760526 (+ 64951us) raft_consensus.cc:1685] finished
0709 13:00:41.760551 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.760792 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6056,"raft.queue_time_us":10507,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5618,"spinlock_wait_cycles":556573952,"thread_start_us":335148,"threads_started":1,"wal-append.queue_time_us":537770}
I20260709 13:00:41.975734  1689 raft_consensus.cc:2889] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:42.009090  1537 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:41.997997  4945 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.031524  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.039335  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.003613  5473 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:42.055208  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.056190  1616 raft_consensus.cc:2393] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:41.782660  5523 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:41.887825  1693 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:42.120453  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.121706  1616 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:42.004094  5215 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:42.110144  5498 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:42.086862  5473 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:42.254019  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.255224  5506 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:42.255908  5506 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.256211  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:42.258452  5506 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:42.259609  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.260767  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.261533  1693 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 15: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:42.262102  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.262763  1616 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:42.263322  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.264453  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.265202  1613 raft_consensus.cc:2393] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:42.258921  5532 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:42.258900  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1039) took 1516 ms (client timeout 1880 ms). Trace:
I20260709 13:00:42.280789  1691 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:42.282001  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:42.283176  1542 raft_consensus.cc:2410] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:00:42.100361  5432 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.289935  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.290906  1693 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:42.291929  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:42.280032  2269 rpcz_store.cc:269] 0709 13:00:40.742908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.079323 (+336415us) service_pool.cc:224] Handling call
0709 13:00:42.258603 (+1179280us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54004c95d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:42.258831 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147349888}
W20260709 13:00:42.300598  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 470537us
W20260709 13:00:42.301337  1694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.012s	sys 0.026s
I20260709 13:00:42.301184  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:42.301628  1694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.012s	sys 0.026s
I20260709 13:00:42.287577  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.287559  5402 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.302762  5467 consensus_meta.cc:287] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.000s
I20260709 13:00:42.284591  5442 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.309006  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:42.297149  5441 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:42.327183  1616 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:42.323036  2275 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:42.325451  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:42.330092  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 480324us
I20260709 13:00:42.332721  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.333375  1613 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:42.333918  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:42.334493  1537 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:42.317598  5529 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:42.330441  5469 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:42.347383  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:42.348909  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.337707  5439 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:42.354596  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:42.355253  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:42.326457  5402 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.356566  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.358592  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:42.329901  5442 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.359567  1537 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:00:42.367272  5215 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:42.367964  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:42.368153  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2542) took 1920 ms. Trace:
I20260709 13:00:42.368487  1620 rpcz_store.cc:276] 0709 13:00:40.448230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.299255 (+851025us) service_pool.cc:224] Handling call
0709 13:00:41.299611 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.355598 (+ 55987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.355629 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.355668 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:41.355697 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.367946 (+1012249us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b54003a1454. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:42.367988 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.368095 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115238784}
I20260709 13:00:42.359270  1613 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:42.361238  5402 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:42.370453  5498 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:42.370579  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2553) took 1632 ms. Trace:
W20260709 13:00:42.375670  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.376729  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:42.376286  1619 rpcz_store.cc:276] 0709 13:00:40.737815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.545894 (+808079us) service_pool.cc:224] Handling call
0709 13:00:41.566042 (+ 20148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.572514 (+  6472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.572538 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.572967 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.943968 (+371001us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:41.944019 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.944100 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.370389 (+426289us) raft_consensus.cc:1685] finished
0709 13:00:42.370412 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.370528 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18284,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":2299,"thread_start_us":357426,"threads_started":1,"wal-append.queue_time_us":747634}
I20260709 13:00:42.377422  1537 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:42.378856  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.380714  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.344350  5529 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.382064  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.382141  2275 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:42.370438  5447 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 2.647s	user 0.010s	sys 0.035s
I20260709 13:00:42.382556  1620 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.383764  1611 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:42.386353  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.387043  1619 raft_consensus.cc:2393] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:42.387785  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.390702  1619 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:42.392525  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.378691  5487 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:42.393527  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.395112  1611 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:42.397531  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.403569  1537 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:42.413982  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.414520  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.415148  1611 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:42.419394  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.419620  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.422156  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2534) took 3138 ms. Trace:
I20260709 13:00:42.423475  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.426939  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.414542  5402 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:00:42.427685  1611 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:42.397166  5487 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:42.431638  5311 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.660s	user 0.004s	sys 0.004s
I20260709 13:00:42.432001  5311 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.422636  1688 rpcz_store.cc:276] 0709 13:00:39.283880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.325065 (+ 41185us) service_pool.cc:224] Handling call
0709 13:00:39.344461 (+ 19396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.388491 (+ 44030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.388519 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.455178 (+ 66659us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.592399 (+137221us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:39.592586 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.592887 (+   301us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.336244 (+2743357us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:42.421801 (+ 85557us) raft_consensus.cc:1685] finished
0709 13:00:42.421833 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.422084 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14341,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5992,"spinlock_wait_cycles":429490944,"thread_start_us":136323,"threads_started":1,"wal-append.queue_time_us":267976}
I20260709 13:00:42.431053  5360 consensus_queue.cc:1059] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:42.433881  5311 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:42.413591  5258 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:00:42.434147  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.434893  1619 raft_consensus.cc:2410] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:00:42.435087  5536 log.cc:927] Time spent T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:42.435499  5258 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:42.435799  1619 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:42.418316  5473 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:42.436511  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2556) took 1698 ms. Trace:
I20260709 13:00:42.439625  1619 rpcz_store.cc:276] 0709 13:00:40.738568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.435380 (+1696812us) service_pool.cc:224] Handling call
0709 13:00:42.435657 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.436255 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.436447 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.437932  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.435843  5258 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:42.436064  5442 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:42.417943  5373 consensus_queue.cc:1059] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:00:42.438956  5537 log.cc:927] Time spent T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:00:42.441174  1692 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:42.445372  1619 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:42.448472  5473 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:42.448366  5258 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:42.448874  5473 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:42.449421  5258 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:42.449734  5473 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:42.450918  5473 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:42.451994  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:42.452346  5529 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:42.453794  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.454819  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:42.455139  5386 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:42.455276  1687 raft_consensus.cc:2376] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12. Re-sending same reply.
I20260709 13:00:42.455513  5386 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:42.456085  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.456245  5386 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.457055  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.457356  5386 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.458101  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.458973  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:42.459352  5283 consensus_meta.cc:287] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.001s
I20260709 13:00:42.452693  1685 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:42.459883  5283 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.462345  5283 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:42.463690  5215 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.464072  5402 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.468200  5487 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:42.469732  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:42.470575  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:42.477402  1687 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:42.477700  1537 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:42.479954  1620 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:00:42.480195  2243 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:42.478881  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.486877  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:42.487754  1539 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:42.488696  1692 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:42.441742  4945 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.493743  1619 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:42.498718  1619 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:42.491987  5300 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:42.491897  5435 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:42.503000  1690 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:42.503840  1692 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:42.506300  1613 raft_consensus.cc:2410] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:00:42.486835  5402 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.484961  5215 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.511672  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:42.503043  5544 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:00:42.514261  5487 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:42.522948  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:42.523319  1542 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:42.523789  1538 raft_consensus.cc:2410] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:42.524185  5215 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:42.518638  5487 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:42.554816  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 69729.5us
I20260709 13:00:42.555769  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:42.576788  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.579751  1545 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:42.560098  5300 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:42.721485  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.673029  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2112) took 1075 ms. Trace:
W20260709 13:00:42.799582  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.799487  1620 rpcz_store.cc:276] 0709 13:00:41.597902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.480665 (+882763us) service_pool.cc:224] Handling call
0709 13:00:42.480904 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.481298 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.481339 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.486383 (+  5044us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.553194 (+ 66811us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:42.553257 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.553359 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.672820 (+119461us) raft_consensus.cc:1685] finished
0709 13:00:42.672839 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.672977 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3622,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10286,"thread_start_us":47567,"threads_started":1,"wal-append.queue_time_us":139378}
I20260709 13:00:42.801071  1585 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:42.688973  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:42.674263  1612 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:42.680757  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:42.656503  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1036) took 2160 ms (client timeout 2092 ms). Trace:
I20260709 13:00:42.804018  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2540) took 2356 ms. Trace:
I20260709 13:00:42.804304  1691 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:42.647150  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:42.805043  1612 rpcz_store.cc:276] 0709 13:00:40.447630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.449396 (+  1766us) service_pool.cc:224] Handling call
0709 13:00:42.673920 (+2224524us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80f8c 00007f29e8c80ef6 0000000000375939 00007f29f0cf41e0 00007f29f0dbd0c4 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:00:42.674044 (+   124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.803753 (+129709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.803948 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201031808}
I20260709 13:00:42.806380  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:42.697217  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:42.578658  5546 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:00:42.804924  2268 rpcz_store.cc:269] 0709 13:00:40.496596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.496748 (+   152us) service_pool.cc:224] Handling call
0709 13:00:42.656203 (+2159455us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b54006f6dd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:42.656398 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134170752}
I20260709 13:00:42.811368  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:42.811720  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:42.818218  2272 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:42.827874  2276 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:00:42.674660  5550 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 13:00:42.662941  5501 log.cc:927] Time spent T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.617s	user 0.015s	sys 0.000s
I20260709 13:00:42.827427  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:42.828917  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 257818us
I20260709 13:00:42.830498  2271 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:42.675995  5510 log.cc:927] Time spent T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.186s	user 0.006s	sys 0.022s
W20260709 13:00:42.671219  5551 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:00:42.690730  5334 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:42.817137  5484 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:42.838367  2243 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:42.839062  1620 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:42.839885  1612 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:42.841490  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:42.674206  5402 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:42.849994  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:42.848570  2276 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:00:42.848528  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 151386us
I20260709 13:00:42.852414  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2113) took 1065 ms. Trace:
I20260709 13:00:42.851275  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:42.852764  1612 rpcz_store.cc:276] 0709 13:00:41.786887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.823075 (+1036188us) service_pool.cc:224] Handling call
0709 13:00:42.839682 (+ 16607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.852203 (+ 12521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.852367 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.853185  2272 raft_consensus.cc:2368] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
I20260709 13:00:42.849606  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 801) took 1185 ms. Trace:
I20260709 13:00:42.853996  1620 rpcz_store.cc:276] 0709 13:00:41.663966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.816137 (+1152171us) service_pool.cc:224] Handling call
0709 13:00:42.838845 (+ 22708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.849269 (+ 10424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.849541 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.865099  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:42.866113  2271 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:42.845041  5469 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:42.875183  2241 connection.cc:256] RPC call timeout handler was delayed by -1.0356232099999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260709 13:00:42.834244  5283 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:00:42.845566  5334 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:42.838846  5439 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:00:42.898191  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 800) took 1234 ms. Trace:
I20260709 13:00:42.886907  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:42.899096  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:42.682790  5487 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:42.898434  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.886924  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.899150  1617 rpcz_store.cc:276] 0709 13:00:41.663770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.518278 (+854508us) service_pool.cc:224] Handling call
0709 13:00:42.524965 (+  6687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.525181 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:42.831855 (+306674us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.897035 (+ 65180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.897090 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:42.897884 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.897975 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.898125 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":361437,"threads_started":2}
W20260709 13:00:42.893100  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.902299  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1792) took 1147 ms. Trace:
I20260709 13:00:42.902623  1693 rpcz_store.cc:276] 0709 13:00:41.754651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.291549 (+536898us) service_pool.cc:224] Handling call
0709 13:00:42.310648 (+ 19099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.428371 (+117723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.428400 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.437258 (+  8858us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.494485 (+ 57227us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:42.494506 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.494547 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.902076 (+407529us) raft_consensus.cc:1685] finished
0709 13:00:42.902102 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.902251 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38385,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":1289,"thread_start_us":167499,"threads_started":2,"wal-append.queue_time_us":63239}
I20260709 13:00:42.908627  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.915241  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:42.916116  1620 raft_consensus.cc:2393] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:42.915094  5334 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.923565  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:42.870846  5300 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.923663  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.945858  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:42.986529  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 797) took 2507 ms. Trace:
I20260709 13:00:43.003522  1618 rpcz_store.cc:276] 0709 13:00:40.478927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.369050 (+890123us) service_pool.cc:224] Handling call
0709 13:00:41.369334 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.432156 (+ 62822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.432199 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.432254 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:41.432314 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.986222 (+1553908us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54002170d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:42.986279 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.986453 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143919872}
I20260709 13:00:43.004395  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:42.924111  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:42.990898  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:43.008276  1617 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:42.926378  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2554) took 2188 ms. Trace:
W20260709 13:00:43.025656  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 102150us
I20260709 13:00:43.027849  1692 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:43.008801  1611 rpcz_store.cc:276] 0709 13:00:40.738067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.437278 (+1699211us) service_pool.cc:224] Handling call
0709 13:00:42.440949 (+  3671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.444341 (+  3392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.444383 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.484892 (+ 40509us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.835563 (+350671us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:42.835608 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.835680 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.926129 (+ 90449us) raft_consensus.cc:1685] finished
0709 13:00:42.926153 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.926315 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1202,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":1473,"thread_start_us":333325,"threads_started":1,"wal-append.queue_time_us":401050}
W20260709 13:00:42.990144  5561 log.cc:927] Time spent T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:00:42.996145  5543 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.601s	user 0.002s	sys 0.002s
I20260709 13:00:42.905390  5544 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.925648  5562 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:42.923593  5334 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.955911  5523 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.977874  5442 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:43.037914  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 138870us
I20260709 13:00:43.030450  5283 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.047299  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:42.901587  5469 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:43.049126  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:43.000168  5503 consensus_queue.cc:1059] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:00:43.049332  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:43.063778  1693 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:43.047055  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43396 (request call id 13) took 2301 ms. Trace:
I20260709 13:00:43.065539  1617 rpcz_store.cc:276] 0709 13:00:40.739404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.029455 (+2290051us) service_pool.cc:224] Handling call
0709 13:00:43.040641 (+ 11186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:43.068753  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:43.065991  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 230568us
I20260709 13:00:43.042187  5562 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.075153  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:43.075875  1615 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
W20260709 13:00:43.076591  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2539) took 2629 ms (client timeout 1880 ms). Trace:
I20260709 13:00:43.048496  5442 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:43.075924  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:43.076989  1615 rpcz_store.cc:269] 0709 13:00:40.447311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.482274 (+ 34963us) service_pool.cc:224] Handling call
0709 13:00:43.074982 (+2592708us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:43.076513 (+  1531us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11702016}
I20260709 13:00:43.084298  1693 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:43.064558  5568 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.065938  5416 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:43.085613  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:43.068624  5532 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.070890  5557 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.046816  5544 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:43.065812  5575 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:43.099925  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 799) took 1436 ms. Trace:
I20260709 13:00:43.064214  5484 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:43.065263  5283 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.093005  5416 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:43.094031  5578 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:43.071610  5562 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.071751  5503 consensus_queue.cc:1243] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:43.097594  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:43.100312  1619 rpcz_store.cc:276] 0709 13:00:41.663493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.508711 (+845218us) service_pool.cc:224] Handling call
0709 13:00:42.515540 (+  6829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.517555 (+  2015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.517581 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.551712 (+ 34131us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.794267 (+242555us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:42.794323 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.794416 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.099739 (+305323us) raft_consensus.cc:1685] finished
0709 13:00:43.099758 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.099874 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":917,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5063,"thread_start_us":212999,"threads_started":1,"wal-append.queue_time_us":280433}
I20260709 13:00:43.086971  5442 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.067273  5576 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:00:43.104424  5583 consensus_queue.cc:1059] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:43.106689  1691 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:43.110244  5568 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:43.130295  5568 raft_consensus.cc:697] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:43.131510  5568 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.117244  5283 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:43.118134  5469 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:43.118935  1685 raft_consensus.cc:2393] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:43.121206  5481 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:00:43.094899  5557 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:43.123989  5544 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:43.124207  5504 raft_consensus.cc:3055] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:43.140223  5504 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:43.141037  5504 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.126816  1691 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:43.096879  5532 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:43.135438  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 65575.6us
I20260709 13:00:43.137796  1693 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:43.139457  5557 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.143241  1691 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260709 13:00:43.128765  5416 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:43.144290  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:55464
I20260709 13:00:43.149438  1619 raft_consensus.cc:606] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:43.149771  1619 raft_consensus.cc:614] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:43.149814  5283 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.142746  5481 raft_consensus.cc:3055] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:43.150043  5581 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:00:43.103587  5575 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:42.646351  1543 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:43.158597  5575 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:43.160593  5532 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:43.150300  5283 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:43.162494  5283 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:43.155156  5481 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:43.163825  5481 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:43.165614  5557 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.168953  5513 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:43.169947  5513 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:43.170248  5513 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:43.170993  5513 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.168893  5581 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:43.192596  2273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1043) took 2047 ms (client timeout 1619 ms). Trace:
W20260709 13:00:43.193089  2273 rpcz_store.cc:269] 0709 13:00:41.145488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.190832 (+ 45344us) service_pool.cc:224] Handling call
0709 13:00:43.192389 (+2001557us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400427a54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:43.192517 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252437888}
I20260709 13:00:43.190781  5589 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.196159  5581 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:00:43.196987  5435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.002s	sys 0.014s
I20260709 13:00:43.201332  5513 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:43.155120  5484 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:43.204954  5435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.003s	sys 0.014s
I20260709 13:00:43.203359  5581 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:43.224764  5581 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.235296  5562 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.226365  5581 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.204852  5589 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.210690  5442 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.208446  5557 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:43.280987  5562 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:43.294878  5589 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:43.303547  4945 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:43.310806  5568 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:43.311259  5581 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:43.329115  5439 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:43.329871  5593 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.883563  5568 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:44.883848  5439 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:44.884001  5593 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:43.418968  5598 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.885697  5439 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:44.886147  5598 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:43.472369  5588 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.887008  5588 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:44.888173  5598 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:44.888974  5588 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:43.633595  5577 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.654012  5579 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:43.297475  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.300256  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:43.284538  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2077) took 2826 ms. Trace:
I20260709 13:00:46.733596  1536 rpcz_store.cc:276] 0709 13:00:40.458611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.458770 (+   159us) service_pool.cc:224] Handling call
0709 13:00:40.550442 (+ 91672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.106930 (+556488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.106974 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.107045 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:41.107095 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.284291 (+2177196us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b540014cdd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:43.284336 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.284456 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279100800}
I20260709 13:00:42.582589  1538 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:43.927412  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.437083  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.756546  5616 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.315743  1689 raft_consensus.cc:3055] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:46.793176  1689 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:43.390836  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:43.413726  2241 leader_election.cc:336] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Timed out: RequestConsensusVote RPC to 127.0.107.193:42041 timed out after 1.521s (SENT)
W20260709 13:00:43.419525  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.356932  2269 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:46.807276  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:46.807734  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 989) took 3495 ms. Trace:
I20260709 13:00:46.807861  2274 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:46.808329  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:46.808270  2269 rpcz_store.cc:276] 0709 13:00:43.311983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.356277 (+ 44294us) service_pool.cc:224] Handling call
0709 13:00:43.356692 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.807395 (+3450703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.807661 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.808981  2268 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:46.809275  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:46.808975  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:46.810305  2274 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:45.819165  2240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.074s	user 0.016s	sys 0.019s
I20260709 13:00:46.811115  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:45.841361  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2568) took 4141 ms (client timeout 1801 ms). Trace:
W20260709 13:00:46.812896  1613 rpcz_store.cc:269] 0709 13:00:41.699529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.381312 (+681783us) service_pool.cc:224] Handling call
0709 13:00:45.841079 (+3459767us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400067a54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:45.841270 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258936192}
I20260709 13:00:45.859983  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 991) took 2547 ms. Trace:
I20260709 13:00:46.813925  2276 rpcz_store.cc:276] 0709 13:00:43.312463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.859101 (+2546638us) service_pool.cc:224] Handling call
0709 13:00:45.859457 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.859659 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.859687 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.859731 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:45.859763 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.859818 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.859926 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:45.889952  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.923033  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 739) took 2776 ms. Trace:
I20260709 13:00:46.815106  1691 rpcz_store.cc:276] 0709 13:00:43.147023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.148023 (+  1000us) service_pool.cc:224] Handling call
0709 13:00:43.148287 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.151711 (+  3424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.151741 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.152508 (+   767us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.203123 (+ 50615us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:43.203164 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.203239 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.922827 (+2719588us) raft_consensus.cc:1685] finished
0709 13:00:45.922845 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.922977 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3092,"raft.queue_time_us":3196,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":2375,"thread_start_us":38060,"threads_started":1,"wal-append.queue_time_us":108574,"wal-append.run_cpu_time_us":1746,"wal-append.run_wall_time_us":1001783}
I20260709 13:00:45.923863  1540 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:00:42.600883  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:46.606972  1566 debug-util.cc:398] Leaking SignalData structure 0x7b080037d240 after lost signal to thread 434
W20260709 13:00:46.629280  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.123s	user 0.013s	sys 0.049s
W20260709 13:00:46.645717  1685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.454s	user 0.022s	sys 0.051s
W20260709 13:00:46.827001  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.321s	user 0.013s	sys 0.049s
W20260709 13:00:46.827186  1685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.636s	user 0.022s	sys 0.052s
I20260709 13:00:46.827776  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2082) took 4340 ms. Trace:
I20260709 13:00:46.651036  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2537) took 5052 ms. Trace:
W20260709 13:00:46.828919  2240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.084s	user 0.017s	sys 0.019s
I20260709 13:00:46.828477  1686 rpcz_store.cc:276] 0709 13:00:41.598615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.598753 (+   138us) service_pool.cc:224] Handling call
0709 13:00:41.598987 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.738026 (+139039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.650739 (+4912713us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400021f54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:46.650945 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277345536}
I20260709 13:00:46.659260  1432 maintenance_manager.cc:419] P 0c5fc33855324cbf8fc0fd695f8cc99b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033758
W20260709 13:00:46.830215  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.660185  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.662143  2272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 990) took 3349 ms (client timeout 1535 ms). Trace:
I20260709 13:00:46.679431  5610 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.831398  2272 rpcz_store.cc:269] 0709 13:00:43.312232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.661921 (+3349689us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:46.662058 (+   137us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:46.831627  5610 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.832279  5498 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.832803  5498 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.833833  5610 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.680867  1616 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:46.681468  2275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 992) took 3368 ms (client timeout 1626 ms). Trace:
I20260709 13:00:46.681633  1614 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:46.682650  1618 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:46.683496  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:46.845033  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2080) took 4375 ms (client timeout 1579 ms). Trace:
I20260709 13:00:46.688565  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 740) took 3535 ms. Trace:
I20260709 13:00:46.846194  1694 rpcz_store.cc:276] 0709 13:00:43.153304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.687837 (+3534533us) service_pool.cc:224] Handling call
0709 13:00:46.688100 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.688259 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.688283 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.688327 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:46.688362 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.688412 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.688515 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:46.691103  1659 connection.cc:256] RPC call timeout handler was delayed by -3.0087419700000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2768s for a response
W20260709 13:00:46.847565  1659 connection.cc:256] RPC call timeout handler was delayed by -2.8379514839999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:00:46.847990  1659 connection.cc:256] RPC call timeout handler was delayed by -2.6167512819999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:00:46.848357  1659 connection.cc:256] RPC call timeout handler was delayed by -2.6033744670000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 13:00:46.848713  1659 connection.cc:256] RPC call timeout handler was delayed by -2.4119549720000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:00:46.849051  1659 connection.cc:256] RPC call timeout handler was delayed by -1.8629407530000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2823s for a response
W20260709 13:00:46.849867  1566 debug-util.cc:398] Leaking SignalData structure 0x7b0800115d80 after lost signal to thread 1477
I20260709 13:00:46.691571  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:46.850262  5611 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:46.851289  5311 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:46.852535  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:46.692277  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2546) took 4981 ms. Trace:
I20260709 13:00:46.853083  1612 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.853036  1690 rpcz_store.cc:276] 0709 13:00:41.710687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.739803 (+ 29116us) service_pool.cc:224] Handling call
0709 13:00:41.753388 (+ 13585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.504746 (+751358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.692027 (+4187281us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400125054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:46.692223 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723385216}
I20260709 13:00:46.692889  1611 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:46.695384  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 738) took 3822 ms. Trace:
I20260709 13:00:46.854607  1693 rpcz_store.cc:276] 0709 13:00:42.873042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.145871 (+272829us) service_pool.cc:224] Handling call
0709 13:00:43.153259 (+  7388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.167072 (+ 13813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.167101 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.167141 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:43.167177 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.694924 (+3527747us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b54003c00d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:46.695209 (+   285us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.695323 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31335680}
W20260709 13:00:46.699517  1491 auto_rebalancer.cc:893] Removing replace marker failed: Replica e12d7b3551014757ba7dda3e83605b83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:00:46.855806  1491 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:00:46.856051  1491 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:00:46.709102  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.856703  2270 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:46.711750  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2089) took 4111 ms (client timeout 1940 ms). Trace:
I20260709 13:00:46.712145  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:46.851284  1566 debug-util.cc:398] Leaking SignalData structure 0x7b0800151680 after lost signal to thread 1569
I20260709 13:00:46.713496  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:46.858395  1544 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
W20260709 13:00:46.858816  1566 debug-util.cc:398] Leaking SignalData structure 0x7b08003af3e0 after lost signal to thread 1644
I20260709 13:00:46.859551  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:46.850440  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:46.860875  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:46.720393  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.138s	user 0.020s	sys 0.035s
I20260709 13:00:45.766053  5435 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:46.867677  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.285s	user 0.020s	sys 0.035s
W20260709 13:00:46.857483  1545 rpcz_store.cc:269] 0709 13:00:42.600713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.711576 (+4110863us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:46.711671 (+    95us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:46.673597  5529 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:44.855264  5532 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:46.917935  5532 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.920083  5532 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:44.885697  5568 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:46.685117  5386 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:43.331135  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:46.926971  5634 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.927449  5634 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:46.739233  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 3.43839e+06us
I20260709 13:00:46.686803  4765 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:46.929271  1511 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:46.929804  5634 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.929738  4765 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:46.930303  5634 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.930598  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:46.930922  5634 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.931634  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:46.635831  5491 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 5.590s	user 0.029s	sys 0.050s
W20260709 13:00:44.855855  5499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.368s	user 0.020s	sys 0.008s
I20260709 13:00:46.688282  5506 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:46.946998  5506 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.949294  5506 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.949762  5506 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:45.852411  5513 consensus_meta.cc:287] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 2.643s	user 0.015s	sys 0.009s
I20260709 13:00:46.686571  5523 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:00:45.873890  5560 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 3.018s	user 0.015s	sys 0.007s
I20260709 13:00:44.889647  5577 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.961323  5640 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:46.961741  5577 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.962468  1615 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:44.889796  5579 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:46.743161  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:44.883598  5581 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.965948  5579 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:46.967212  5581 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:44.886360  5593 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:43.419549  5594 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:46.969707  5594 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.973094  5594 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:46.729528  5481 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.722082  5487 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.714414  5504 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.749852  5619 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:46.750897  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2088) took 4192 ms. Trace:
I20260709 13:00:46.983909  1538 rpcz_store.cc:276] 0709 13:00:42.558449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.560462 (+  2013us) service_pool.cc:224] Handling call
0709 13:00:42.582287 (+ 21825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.750618 (+4168331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.750837 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.984947  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:46.985458  1538 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:00:46.986233  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:46.986851  1544 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:46.988417  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:46.989391  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:46.989885  1544 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.757893  5617 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.759407  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1793) took 5004 ms. Trace:
I20260709 13:00:46.991315  1687 rpcz_store.cc:276] 0709 13:00:41.754934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.459678 (+704744us) service_pool.cc:224] Handling call
0709 13:00:42.477189 (+ 17511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.480228 (+  3039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.759172 (+4278944us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b54002e4fd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:46.759340 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39655680}
I20260709 13:00:46.757059  5616 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.993594  5616 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.785959  5624 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.994274  5624 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.786545  5614 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.786666  1510 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
W20260709 13:00:46.996692  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 210075us
I20260709 13:00:46.792644  5625 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:46.794035  1689 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.799089  1692 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:46.804199  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:46.812361  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:46.990955  5617 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.998634  2271 raft_consensus.cc:2410] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:00:46.998669  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 3.58427e+06us
W20260709 13:00:46.834841  2275 rpcz_store.cc:269] 0709 13:00:43.312700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.681304 (+3368604us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:46.681403 (+    99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:46.999403  2241 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:42041 timed out after 1.705s (SENT) [suppressed 26 similar messages]
W20260709 13:00:46.843842  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 799) took 4243 ms (client timeout 1705 ms). Trace:
W20260709 13:00:46.845549  1540 rpcz_store.cc:269] 0709 13:00:42.469399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.469523 (+   124us) service_pool.cc:224] Handling call
0709 13:00:46.844801 (+4375278us) spinlock_profiling.cc:243] Waited 3.44 s on lock 0x7b54001b7e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:46.844942 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7901570816}
W20260709 13:00:46.859826  1566 debug-util.cc:398] Leaking SignalData structure 0x7b080032db80 after lost signal to thread 1718
I20260709 13:00:46.735648  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.000772  1536 raft_consensus.cc:2376] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13. Re-sending same reply.
W20260709 13:00:46.863428  2243 connection.cc:256] RPC call timeout handler was delayed by -2.0145823459999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 13:00:46.866377  5611 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.866825  5311 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:44.883052  5442 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:46.868542  1612 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:47.008767  5311 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.866405  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.012764  1543 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.013635  5311 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.880502  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:46.883525  5558 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:47.014520  1545 raft_consensus.cc:2410] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:47.014384  5558 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.015671  1545 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:47.016458  5558 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:46.884106  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.017076  1619 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:46.884735  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:46.886088  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:46.886119  1611 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:46.882365  5451 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.868041  5435 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.895558  5529 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:46.892968  5498 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.897755  5631 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:47.021555  5617 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.021530  5631 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.898028  5615 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:46.868346  5610 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:46.902204  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:46.902968  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2083) took 4404 ms. Trace:
W20260709 13:00:47.031564  1510 connection.cc:256] RPC call timeout handler was delayed by -3.0257202660000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 13:00:46.902997  1585 connection.cc:256] RPC call timeout handler was delayed by -2.4874540669999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
I20260709 13:00:46.906987  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:55464
W20260709 13:00:47.033171  1510 connection.cc:256] RPC call timeout handler was delayed by -2.9969202660000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:00:47.033281  1585 connection.cc:256] RPC call timeout handler was delayed by -2.3663564670000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:00:46.899039  5621 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.905251  5627 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.909994  1509 connection.cc:256] RPC call timeout handler was delayed by -3.0092880440000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:00:46.910808  5632 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:46.925637  5386 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.926633  5635 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:47.037797  5635 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.038754  5558 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:47.039216  5558 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.040450  5635 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:46.931696  4765 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:45.820088  5484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.591s	user 0.007s	sys 0.034s
I20260709 13:00:47.035701  5610 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:47.050698  5484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.821s	user 0.008s	sys 0.035s
I20260709 13:00:46.934213  5638 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:47.041901  5627 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.051468  5638 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.052140  5610 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.052708  5627 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.937906  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 735) took 4065 ms. Trace:
I20260709 13:00:47.053962  5638 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.944574  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:46.944972  5620 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:46.950169  5506 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.053217  1685 rpcz_store.cc:276] 0709 13:00:42.872077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.136983 (+264906us) service_pool.cc:224] Handling call
0709 13:00:43.137399 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:43.148660 (+ 11261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.148692 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:43.155918 (+  7226us) log.cc:844] Serialized 52 byte log entry
0709 13:00:46.827793 (+3671875us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:46.834995 (+  7202us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.912176 (+ 77181us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.937671 (+ 25495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.937749 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.937777 (+    28us) raft_consensus.cc:1685] finished
0709 13:00:46.937783 (+     6us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.937865 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6405,"prepare.queue_time_us":72643,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":1134,"raft.queue_time_us":78918,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":270,"thread_start_us":3734663,"threads_started":5,"wal-append.queue_time_us":155546,"wal-append.run_cpu_time_us":1724,"wal-append.run_wall_time_us":1013086}
I20260709 13:00:46.953984  5559 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.954931  5499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 5.467s	user 0.021s	sys 0.008s
I20260709 13:00:46.953680  5523 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:46.990932  5634 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:46.828135  1537 rpcz_store.cc:276] 0709 13:00:42.487711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.487945 (+   234us) service_pool.cc:224] Handling call
0709 13:00:42.492125 (+  4180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.495109 (+  2984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.495138 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.495549 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.827411 (+4331862us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:46.827449 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.827511 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.827557 (+    46us) raft_consensus.cc:1685] finished
0709 13:00:46.827566 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.827705 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":588,"raft.queue_time_us":3212,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":4321470,"threads_started":1,"wal-append.queue_time_us":467474,"wal-append.run_cpu_time_us":1535,"wal-append.run_wall_time_us":1001560}
W20260709 13:00:47.000420  1566 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2820 after lost signal to thread 1719
W20260709 13:00:47.089308  1566 debug-util.cc:398] Leaking SignalData structure 0x7b08003985c0 after lost signal to thread 2301
W20260709 13:00:47.001753  2243 connection.cc:256] RPC call timeout handler was delayed by -1.780582346000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 13:00:47.000170  1541 rpcz_store.cc:269] 0709 13:00:42.600125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.600658 (+   533us) service_pool.cc:224] Handling call
0709 13:00:46.843014 (+4242356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.091452  1541 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:47.004809  1658 connection.cc:256] RPC call timeout handler was delayed by -2.8954145580000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:00:47.005831  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 741) took 3791 ms (client timeout 2056 ms). Trace:
W20260709 13:00:47.092573  1658 connection.cc:256] RPC call timeout handler was delayed by -2.8720145579999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:00:47.092622  1692 rpcz_store.cc:269] 0709 13:00:43.209082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.390567 (+181485us) service_pool.cc:224] Handling call
0709 13:00:47.000220 (+3609653us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:47.092952  1658 connection.cc:256] RPC call timeout handler was delayed by -2.8288145579999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 13:00:47.007345  1689 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:47.093324  1658 connection.cc:256] RPC call timeout handler was delayed by -2.7766145580000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 13:00:47.007670  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.000074  5616 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:47.009734  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.097651  1536 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:47.011037  1540 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:47.097239  5616 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.006984  5611 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.098759  5616 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.100111  5611 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.003542  5594 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:47.003355  5625 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.104089  5625 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.000170  5578 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.893191  1659 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:47.105665  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 212550us
I20260709 13:00:47.019764  1544 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:47.017501  5622 raft_consensus.cc:2764] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:47.025238  1543 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:47.028039  5529 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.028759  5624 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:47.033555  1510 connection.cc:256] RPC call timeout handler was delayed by -2.8115202660000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 13:00:47.110051  1510 connection.cc:256] RPC call timeout handler was delayed by -2.5928202659999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:00:47.110335  1510 connection.cc:256] RPC call timeout handler was delayed by -2.5082202660000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 13:00:47.033450  1613 raft_consensus.cc:606] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Received request to transfer leadership to TS 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:47.096285  5615 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:47.110643  2243 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:47.033669  1585 connection.cc:256] RPC call timeout handler was delayed by -2.29665406700002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 13:00:47.113327  1585 connection.cc:256] RPC call timeout handler was delayed by -2.2417721640000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 13:00:47.113646  1585 connection.cc:256] RPC call timeout handler was delayed by -1.4380540669999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3173s for a response
I20260709 13:00:47.114125  1688 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:47.115123  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.033025  1539 rpcz_store.cc:276] 0709 13:00:42.498767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.498884 (+   117us) service_pool.cc:224] Handling call
0709 13:00:42.500231 (+  1347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.500409 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:42.582630 (+ 82221us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.901062 (+4318432us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.901272 (+   210us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:46.902686 (+  1414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.902778 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.902907 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12490,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":55575,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10444,"thread_start_us":4395576,"threads_started":3,"wal-append.queue_time_us":341076,"wal-append.run_cpu_time_us":924,"wal-append.run_wall_time_us":1001108}
W20260709 13:00:47.036087  1509 connection.cc:256] RPC call timeout handler was delayed by -2.858988044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 13:00:47.024161  5451 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.037143  5631 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.087808  5523 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.040958  5558 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:46.932777  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 3.60117e+06us
W20260709 13:00:47.049512  2241 connection.cc:256] RPC call timeout handler was delayed by -3.579996666999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
I20260709 13:00:47.129112  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.036330  5621 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.049970  4765 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:47.034528  5617 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.934779  5618 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:46.956095  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 800) took 4314 ms. Trace:
W20260709 13:00:47.082801  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 138299us
I20260709 13:00:47.114943  5636 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.093636  1658 connection.cc:256] RPC call timeout handler was delayed by -2.6416145580000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:00:47.094372  1545 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:47.094596  1538 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:47.002780  5614 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.137403  5633 consensus_queue.cc:1059] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:00:47.137248  4765 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.140663  1618 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:47.137840  1511 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:47.138093  1658 connection.cc:256] RPC call timeout handler was delayed by -2.62001455799998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:00:47.141530  1658 connection.cc:256] RPC call timeout handler was delayed by -2.6002145580000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 13:00:47.141881  1658 connection.cc:256] RPC call timeout handler was delayed by -2.5039145580000195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 13:00:47.142140  1658 connection.cc:256] RPC call timeout handler was delayed by -2.2915145580000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 13:00:47.142326  1658 connection.cc:256] RPC call timeout handler was delayed by -2.2638113759999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:00:47.142460  1658 connection.cc:256] RPC call timeout handler was delayed by -1.8462451269999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 13:00:47.138837  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.107062  1659 leader_election.cc:400] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Vote denied by peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) with higher term. Message: Invalid argument: T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8.
W20260709 13:00:47.117564  1509 connection.cc:256] RPC call timeout handler was delayed by -2.8265880440000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 13:00:47.144665  1509 connection.cc:256] RPC call timeout handler was delayed by -2.795988044000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 13:00:47.144614  1659 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:47.145056  1509 connection.cc:256] RPC call timeout handler was delayed by -2.7518880439999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 13:00:47.145321  1509 connection.cc:256] RPC call timeout handler was delayed by -2.7500880439999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 13:00:47.145598  1509 connection.cc:256] RPC call timeout handler was delayed by -2.6863233880000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 13:00:47.145848  1509 connection.cc:256] RPC call timeout handler was delayed by -2.4485880440000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260709 13:00:47.146102  1509 connection.cc:256] RPC call timeout handler was delayed by -2.4159650979999583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:00:47.146344  1509 connection.cc:256] RPC call timeout handler was delayed by -2.3909880439999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
I20260709 13:00:47.118180  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.147552  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.038369  5386 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.119479  1620 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:47.119837  1619 raft_consensus.cc:2410] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:00:47.146595  1509 connection.cc:256] RPC call timeout handler was delayed by -2.380509113999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 13:00:47.085716  5620 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:47.104672  5578 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.092661  5506 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.169657  5578 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.123178  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.124697  1614 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:47.175765  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.177320  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.126830  1537 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:47.127379  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.179126  1617 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:47.129248  1689 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:47.180845  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1788) took 5427 ms. Trace:
I20260709 13:00:47.181195  1689 rpcz_store.cc:276] 0709 13:00:41.753510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.288070 (+534560us) service_pool.cc:224] Handling call
0709 13:00:42.308956 (+ 20886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.315646 (+1006690us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b54000d5aa0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd1cdc0 00007f29ebda71c0 00007f29ebda8231 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c
0709 13:00:47.180583 (+3864937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.180802 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8526720}
W20260709 13:00:47.129182  2241 connection.cc:256] RPC call timeout handler was delayed by -3.2325966669999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24580000000000002s for a response
I20260709 13:00:47.129837  1613 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 5: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:47.128512  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:47.132138  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.119997  5504 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:00:47.108371  5481 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.193042  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:47.193459  2241 connection.cc:256] RPC call timeout handler was delayed by -2.7024966669999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3047s for a response
W20260709 13:00:47.193992  2241 connection.cc:256] RPC call timeout handler was delayed by -2.4690009560000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:00:47.194306  2241 connection.cc:256] RPC call timeout handler was delayed by -2.4411009560000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:00:47.194579  2241 connection.cc:256] RPC call timeout handler was delayed by -2.0144763160000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:00:47.194893  2241 connection.cc:256] RPC call timeout handler was delayed by -1.978262706999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:00:47.195191  2241 connection.cc:256] RPC call timeout handler was delayed by -1.8375926030000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 13:00:47.195441  2241 connection.cc:256] RPC call timeout handler was delayed by -1.8375926030000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 13:00:47.195694  2241 connection.cc:256] RPC call timeout handler was delayed by -1.7871926029999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 13:00:47.135147  1536 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:47.136231  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.196964  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.149405  5523 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:47.140367  5614 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.128360  5568 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:47.199900  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 76225.3us
I20260709 13:00:47.201371  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.154134  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.151225  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.154745  1538 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:47.151362  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.151643  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:47.205116  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 53538.8us
I20260709 13:00:47.152280  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.137454  1542 rpcz_store.cc:276] 0709 13:00:42.642125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.718496 (+4076371us) service_pool.cc:224] Handling call
0709 13:00:46.718806 (+   310us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:46.758390 (+ 39584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.758422 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:46.759082 (+   660us) log.cc:844] Serialized 78 byte log entry
0709 13:00:46.783690 (+ 24608us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:46.868334 (+ 84644us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.955807 (+ 87473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.955874 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.955910 (+    36us) raft_consensus.cc:1685] finished
0709 13:00:46.955920 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.956045 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":121872,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":79513,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":223,"thread_start_us":229428,"threads_started":4,"wal-append.queue_time_us":24581}
W20260709 13:00:47.150501  1509 connection.cc:256] RPC call timeout handler was delayed by -2.37298804400001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260709 13:00:47.158005  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.096168  5559 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.109436  5611 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:47.120107  5513 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:47.138778  5617 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.171518  5620 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.163060  5451 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.153563  5624 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:47.153517  5618 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:47.161098  5594 raft_consensus.cc:3055] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:47.214125  5615 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:47.166172  5616 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:47.182753  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 54336.6us
I20260709 13:00:47.179988  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c48135c32120406e945bec13a16ae327"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:55464
I20260709 13:00:47.175787  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.187506  5622 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:47.192322  5621 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.193753  1615 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:47.230731  1617 raft_consensus.cc:606] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:47.151494  4765 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.199409  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.207864  1509 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:47.232931  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 71326.2us
I20260709 13:00:47.215229  1613 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:00:47.218281  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.149536  5636 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:47.219736  1658 leader_election.cc:336] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Timed out: RequestConsensusVote RPC to 127.0.107.193:42041 timed out after 1.531s (SENT)
W20260709 13:00:47.198302  5404 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:00:47.236270  5481 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.236653  5617 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.236683  5616 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.236733  5481 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.237691  5618 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.239377  5506 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:47.240495  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:55464
I20260709 13:00:47.234735  5641 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.241744  5611 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:47.198515  5435 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.166035  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.212472  5529 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:00:47.214254  5581 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.218847  5578 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:47.230746  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:47.225675  5594 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:47.234294  1509 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:47.241024  1617 raft_consensus.cc:606] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:47.253562  1617 raft_consensus.cc:614] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:47.219825  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:47.224299  5624 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:47.219247  5633 consensus_queue.cc:1059] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:00:47.208711  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.231950  5622 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:47.258796  1544 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:47.230341  5615 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:47.261606  5615 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.262182  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:47.224153  5634 consensus_queue.cc:1059] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 13:00:47.257481  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 44483.5us
I20260709 13:00:47.297008  2243 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:47.257985  5655 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:47.259945  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:47.260025  5481 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:47.302488  5655 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.302556  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:47.254967  5484 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.302979  5655 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.303515  1692 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:47.263402  1689 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.302922  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:47.304432  1688 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:47.248397  5578 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:47.259123  5624 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.263530  5622 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.258433  5487 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:47.293362  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:47.315748  1694 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:47.229290  5568 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:00:47.293649  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.293790  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:47.316747  1686 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:47.246841  4765 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:00:47.294314  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:47.320408  1690 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:47.263088  5616 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:47.321190  5616 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:47.321571  5616 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.321492  5594 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.248129  5506 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:00:47.305049  5621 raft_consensus.cc:3055] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:47.324533  5621 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:47.252182  5581 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.325435  5621 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.248778  5435 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.327448  5559 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.328797  5636 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:47.227088  5451 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:00:47.299906  5558 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:47.300064  2243 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:47.300379  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 107430us
W20260709 13:00:47.260458  5647 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:00:47.270424   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:47.343998  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.305173  1691 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:47.306041  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:47.306367  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:47.353555  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.374001  1537 raft_consensus.cc:2410] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:47.349769  1692 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:47.372980  2243 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:47.395205  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:47.396066  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.396154  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.344885   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:47.397162  1510 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.397651  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.398758  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:47.400302  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 53837us
I20260709 13:00:47.401149  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.402195  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.399317  1614 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
W20260709 13:00:47.410158  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 190356us
I20260709 13:00:47.410954  2241 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.401643  1542 raft_consensus.cc:2376] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15. Re-sending same reply.
I20260709 13:00:47.412356  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:47.413014  1612 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 5.
I20260709 13:00:47.413053  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.413612  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.310779  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:47.314082  5637 raft_consensus.cc:3055] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:47.418040  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 107326us
I20260709 13:00:47.305768  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:47.295571  1687 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:47.418920  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:47.319483  5568 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:47.335492  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.337286  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:47.228470  1511 leader_election.cc:336] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.801s (SENT)
I20260709 13:00:47.337785  1689 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:47.420995  5568 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:47.342442  1544 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:47.413828  1537 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:47.414964  5513 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:47.412454  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.448176  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.448967  1538 raft_consensus.cc:2410] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:47.449064  5610 raft_consensus.cc:993] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: : Instructing follower 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 13:00:47.449510  5610 raft_consensus.cc:1081] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Signalling peer 5dd1b367d5dd4e6abfd29fc2df2bed07 to start an election
I20260709 13:00:47.449616  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.408111  1660 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:47.295936  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:47.421783  5655 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.417320  5611 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:47.431680  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:47.428570  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.469015  1693 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.472005  5615 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.472854  5513 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.473340  5513 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.474068  5615 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.419960  1685 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:47.394806  5594 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.427906  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.400076  5558 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:47.407871  5619 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:47.417567  5621 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.353686  5633 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
W20260709 13:00:47.442929  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.323791  5578 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.417589  5637 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:47.422778  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.304896  5523 raft_consensus.cc:3055] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:47.430290  5593 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:47.446175  1511 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.435981  5484 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:47.447082  1544 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:47.450587  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.353000  5504 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:47.476114  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:47.476716  5652 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:47.456934  5451 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:47.486810  5581 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.488664  5513 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.491039  5435 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:47.491770  5625 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:47.482461  1693 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:00:47.495011  1536 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:47.491986  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:47.503907  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:47.504617  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 96577.5us
I20260709 13:00:47.531507  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:47.508620  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 280121us
W20260709 13:00:47.510682  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 255235us
I20260709 13:00:47.548820  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:47.492286  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 60640.4us
I20260709 13:00:47.500806  5622 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.510063  1544 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:47.558907  1544 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.510380  5568 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.514110  5504 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.516538  1537 raft_consensus.cc:2410] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:47.509354  5611 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:47.509297  1539 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:47.504211  5620 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.542553  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.506875  5523 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:47.566789  2276 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:47.555363  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 63471.5us
I20260709 13:00:47.568099  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.557636  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:47.545045  1613 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:47.511324  5655 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.506264  5578 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.553860  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.512362  5641 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:47.510193  5619 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:47.508900  5484 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:47.532409  5451 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:47.565163  5504 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.514978  5652 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:47.572981  1584 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:47.573159  1658 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:47.619539  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 46441.8us
I20260709 13:00:47.459142  5616 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.560794  5615 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:47.561779  5386 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:47.578938  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.564440  5611 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.510070  5624 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.571645  1544 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:47.581735  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.581153  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:47.640211  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 59126.3us
I20260709 13:00:47.619899  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:47.572252  5640 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:47.619506  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 46604us
I20260709 13:00:47.561183  5621 consensus_queue.cc:1059] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:00:47.513705  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 71332.6us
I20260709 13:00:47.643590  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:47.643689  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:47.495627  5558 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.561738  5593 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:00:47.577570  4765 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:47.620595  1541 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:47.620469  1658 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.507064  5637 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.652729  1542 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:47.623665  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.579439  5636 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.581431  5451 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:47.625444  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.627718  2276 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:47.610615  5568 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.626981  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.649065  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:47.576545  5617 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:00:47.622480  5638 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:47.657244  5487 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:47.657433  1658 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.622063  5614 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:47.621930  2277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
 from {username='slave'} at 127.0.0.1:45396
I20260709 13:00:47.637964  5386 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:47.662053  1545 raft_consensus.cc:1240] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:47.660466  2268 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:00:47.665122  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.644450  5611 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.675881  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:47.677552  2274 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.669452  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.675639  5631 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:47.629015  5618 consensus_queue.cc:1059] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:00:47.667182  1660 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.672446  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.673040  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:47.689955  1658 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.690927  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.659173  5655 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:47.663714  5506 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:47.678402  2272 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:00:47.668259  5621 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:47.760747  5619 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:47.658800  5667 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:47.665455  4765 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:47.664558  5529 consensus_queue.cc:1059] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 13:00:47.755731   436 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3dc0 after lost signal to thread 1584
W20260709 13:00:47.755808  2298 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfb00 after lost signal to thread 434
W20260709 13:00:47.817742  2298 debug-util.cc:398] Leaking SignalData structure 0x7b08000f52a0 after lost signal to thread 1477
W20260709 13:00:47.818197  2298 debug-util.cc:398] Leaking SignalData structure 0x7b08002d28e0 after lost signal to thread 1491
W20260709 13:00:47.819528  2298 debug-util.cc:398] Leaking SignalData structure 0x7b080027ffa0 after lost signal to thread 1569
I20260709 13:00:47.678575  5386 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.677160  5481 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:47.692768  5435 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:47.670857  5671 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:47.694061  5404 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.698167  5487 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:47.637053  5523 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.700053  5656 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:47.766574  5624 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.693473  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.692543  5594 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:00:47.815696  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 174086us
W20260709 13:00:47.825815  2298 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3420 after lost signal to thread 1644
I20260709 13:00:47.701552  5559 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:00:47.755439  5655 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.670138  5484 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.827813  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:47.829730  5671 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.773464  5506 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:47.822690  5581 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:00:47.812870  5621 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:47.813659  5513 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.832993  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.889094  2269 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:47.815232  5622 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:47.833014  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 165875us
I20260709 13:00:47.890043  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:47.834133  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 133877us
W20260709 13:00:47.843565  2298 debug-util.cc:398] Leaking SignalData structure 0x7b0800285e60 after lost signal to thread 1718
W20260709 13:00:47.890915  2298 debug-util.cc:398] Leaking SignalData structure 0x7b08003da3c0 after lost signal to thread 1719
W20260709 13:00:47.892000  2298 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4ec0 after lost signal to thread 2301
I20260709 13:00:47.891947  2243 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:47.842128  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 150587us
I20260709 13:00:47.895288  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:47.895356  1510 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:47.845607  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.673659  5652 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.855773  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:47.898769  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.832991  5435 raft_consensus.cc:697] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:47.835446  5620 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.857030  5627 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:47.856769  5671 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.916335  1658 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.886312  2277 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:00:47.886368  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.851046  5481 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.856567  5675 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:00:47.938529  5641 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:47.938993  5641 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:47.939811  5641 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.940922  5641 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:47.942495  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.860005  5506 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.944955  5631 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:47.945339  5631 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.945849  5631 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.945295  2270 raft_consensus.cc:2410] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:00:47.888211  5662 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:00:47.948004  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.948776  2270 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:47.949522  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.850916  5523 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.897054  5619 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.951470  2271 raft_consensus.cc:2410] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:47.951320  5451 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:47.952335  2275 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:47.952720  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.954407  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.896914  4765 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:47.955432  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.956489  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.957465  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:47.958103  2275 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:47.942451  2274 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:47.959408  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.960008  2274 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:47.960652  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.961514  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:47.917563  2277 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.814217  5638 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:47.858574  5616 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.914306  1509 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:47.888904  5621 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.924500  5655 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:47.855590  5618 consensus_queue.cc:1059] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:00:48.006981  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 92735.6us
I20260709 13:00:47.924990  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:48.008235  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:48.009167  1538 raft_consensus.cc:2410] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:48.008736  2272 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:47.925267  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.915266  5627 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:48.010490  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 115166us
I20260709 13:00:47.920907  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:48.010844  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 367270us
I20260709 13:00:48.011243  2268 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:48.011461  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:48.011819  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.926043  5668 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.230s	user 0.003s	sys 0.013s
I20260709 13:00:47.926450  5615 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:47.929150  5610 raft_consensus.cc:3055] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:47.900544  5674 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:00:47.931737  5652 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.035348  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.936098  5677 consensus_queue.cc:1059] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:48.038286  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:48.038873  1620 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.937692  5481 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.950536  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:48.038282  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:48.004009  5656 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:47.963476  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:47.966634  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 50372.9us
I20260709 13:00:47.973376  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:47.981709  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 89819.7us
W20260709 13:00:48.002450  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.014578  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.008980  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.015381  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.016633  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.018621  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.042071  2270 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:48.031363  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.014685  4765 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.032441  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.966562  5636 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:48.052852  1658 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:48.052807  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 79498.6us
I20260709 13:00:47.989328  5404 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.039557  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:48.044807  1542 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
W20260709 13:00:48.046598  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.043987  1540 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:48.044306  5656 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.048405  2270 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:48.049441  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:47.990079  5682 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:48.019760  5627 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.052601  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:48.073473  1615 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
W20260709 13:00:47.917186  5633 consensus_queue.cc:1175] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0cccd9c43f9747529680a8e7463961c9" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:48.053881  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:48.082329  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:48.040244  5625 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:47.989578  5611 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.062223  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:48.032959  5610 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:48.028955  5615 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:48.045394  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.055667  1616 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:00:48.064517  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.112994  2243 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:48.038288  5665 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:48.065193  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 92123.8us
I20260709 13:00:48.067018  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.117496  1537 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:48.067761  2268 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:48.056668  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.040562  5638 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:48.074535  1693 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:48.075084  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:48.075551  1510 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.075708  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:48.120095  1689 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:48.076327  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:48.081799  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:48.028455  5624 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:48.082893  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:48.085234  1542 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:48.087627  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:48.121649  1688 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.063596  5451 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:48.041949  5681 consensus_queue.cc:1059] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:00:48.063370  5620 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:48.125706  1685 raft_consensus.cc:2393] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:48.070837  5684 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.110409  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:48.097024  1620 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
W20260709 13:00:48.114876  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 69559.6us
I20260709 13:00:48.122293  1539 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:00:48.055868  4765 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.072628  5636 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:48.083127  5656 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.053242  5481 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:48.063900  5634 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.127041  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 51551us
I20260709 13:00:48.166478  1510 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.107973  5682 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:48.124058  5615 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.167361  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.169493  1510 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:48.066244  5404 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.176034  1688 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
W20260709 13:00:48.177601  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 124795us
I20260709 13:00:48.125139  5593 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:48.247520  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 70368.2us
W20260709 13:00:48.248692  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 83328.8us
I20260709 13:00:48.082741  5504 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:48.250850  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 81406.1us
I20260709 13:00:48.249459  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.251943  1510 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.115724  5625 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:48.261123  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.264115  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.129267  5620 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:48.160233  5618 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:48.247720  5568 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.002s
I20260709 13:00:48.167743  5594 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:48.180809  5682 consensus_queue.cc:1243] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:48.160617  5665 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:48.282450  1688 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:48.293316  4765 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.250000  5484 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:48.296228  2273 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
W20260709 13:00:48.296706  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.169974  5624 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.312026  2271 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:48.176764  5529 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:00:48.261365  5640 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:48.114099  5435 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.320938  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:48.267969  5614 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:48.176541  5684 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.328842  5625 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.312952  5593 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:48.366801  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 102749us
I20260709 13:00:48.241817  5634 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.128393  5638 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.280301  5618 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:48.298357  5594 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.329241  5624 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.331712  5636 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:48.379542  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 115190us
I20260709 13:00:48.282752  5688 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:48.337993  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.403461  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:48.277915  5610 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.394920  5593 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:48.401903  5640 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:48.447026  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.688635  5640 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:48.690868  5640 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.691968  5676 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:48.692893  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.693064  5676 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.410234  2241 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:48.697173  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 286862us
I20260709 13:00:48.468616  5404 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:48.515540  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.702060  5559 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.569875  5615 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.441452  2277 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.702625  5559 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:48.703267  5559 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.571614  5620 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.519277  1616 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:48.421271  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 172476us
W20260709 13:00:48.511770  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 457875us
I20260709 13:00:48.711055  5691 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:48.712698  5729 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.148s	user 0.008s	sys 0.025s
I20260709 13:00:48.480027  2274 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:00:48.717263  2274 pending_rounds.cc:85] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 8
I20260709 13:00:48.717613  2274 pending_rounds.cc:107] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:48.717907  2274 raft_consensus.cc:2889] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:48.719086  5717 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.172s	user 0.003s	sys 0.008s
W20260709 13:00:48.720116  5727 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.165s	user 0.004s	sys 0.005s
I20260709 13:00:48.720348  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1044) took 1083 ms. Trace:
W20260709 13:00:48.721210  5721 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.168s	user 0.009s	sys 0.000s
I20260709 13:00:48.720783  2274 rpcz_store.cc:276] 0709 13:00:47.637030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.962220 (+325190us) service_pool.cc:224] Handling call
0709 13:00:47.962454 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.718666 (+756212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.720032 (+  1366us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54004790d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:48.720279 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189407104}
I20260709 13:00:48.461392  5610 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.398659  5618 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.732321  5578 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:00:48.564767  5622 raft_consensus.cc:3055] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:48.471719  5624 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.751453  1439 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 12 to 14, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:00:48.473537  5627 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:48.473219  5641 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.001s
I20260709 13:00:48.492985  5656 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.443922  5665 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:48.473982  5671 consensus_meta.cc:287] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
W20260709 13:00:48.423777  5673 log.cc:927] Time spent T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:00:48.431432  5638 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:48.461506  5667 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.565121  5674 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:48.417625  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 120432us
W20260709 13:00:48.473572  5386 consensus_meta.cc:287] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.000s
I20260709 13:00:48.470213  5481 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:48.505774  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 112988us
I20260709 13:00:48.499758  5484 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:48.535336  5487 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:48.431391  5504 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:48.407919  5506 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.420727  5593 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.401368  5594 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.461184  5611 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.513938  5614 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:48.440230  5621 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:48.437376  5686 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.326s	user 0.000s	sys 0.006s
I20260709 13:00:48.441643  5631 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.472041  5634 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:48.427294  5689 log.cc:927] Time spent T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:00:48.407610  5636 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.479902  5637 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:48.424216  5690 log.cc:927] Time spent T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 13:00:48.424772  5692 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:00:48.431993  5684 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:48.422139  5694 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
W20260709 13:00:48.423481  5687 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.307s	user 0.000s	sys 0.000s
W20260709 13:00:48.437808  5697 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:48.558146  5675 raft_consensus.cc:3055] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:48.680186  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.513314  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:48.425204  5693 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:00:48.403265  5703 consensus_queue.cc:1059] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:00:48.675051  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 423084us
W20260709 13:00:48.660686  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.408756  5714 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.795940  5386 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.797400  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2124) took 1306 ms. Trace:
I20260709 13:00:48.797605  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1043) took 1172 ms. Trace:
I20260709 13:00:48.797793  5656 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:48.798087  2276 rpcz_store.cc:276] 0709 13:00:47.625214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.673064 (+ 47850us) service_pool.cc:224] Handling call
0709 13:00:47.673359 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.697595 (+ 24236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.697625 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.698022 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.830007 (+131985us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:47.830047 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.830106 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.797216 (+967110us) raft_consensus.cc:1685] finished
0709 13:00:48.797258 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.797392 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15459,"raft.queue_time_us":15570,"raft.run_cpu_time_us":9172,"raft.run_wall_time_us":112364,"thread_start_us":62843,"threads_started":1,"wal-append.queue_time_us":275620}
I20260709 13:00:48.801066  5614 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:48.801628  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2114) took 1398 ms. Trace:
I20260709 13:00:48.802742  5675 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:48.802469  5614 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.803158  5638 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:48.754513  1439 catalog_manager.cc:5697] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 3 to 6, term changed from 4 to 5, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:48.803894  5638 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.804091  5675 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.805768  5675 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.806036  5674 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:48.802090  1543 rpcz_store.cc:276] 0709 13:00:47.403086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.403866 (+   780us) service_pool.cc:224] Handling call
0709 13:00:47.404207 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.518449 (+114242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.518493 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.542090 (+ 23597us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.887403 (+345313us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:47.887444 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.887544 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.801240 (+913696us) raft_consensus.cc:1685] finished
0709 13:00:48.801271 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.801443 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43819,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"thread_start_us":436202,"threads_started":2,"wal-append.queue_time_us":466880}
I20260709 13:00:48.807586  5674 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.809247  5674 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.698396  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:48.708976  5619 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.710039  2277 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:48.710152  5700 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.291s	user 0.014s	sys 0.045s
I20260709 13:00:48.743858  5620 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:48.747963  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.743868  2275 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:00:48.742940  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.738380  5711 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.309s	user 0.010s	sys 0.023s
I20260709 13:00:48.797883  1536 rpcz_store.cc:276] 0709 13:00:47.491409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.574512 (+ 83103us) service_pool.cc:224] Handling call
0709 13:00:47.612081 (+ 37569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.682312 (+ 70231us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b180048d2a0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ebd9d060 00007f29ebd9dbfb 00007f29ebda864b
0709 13:00:47.682394 (+    82us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.682408 (+    14us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.694871 (+ 12463us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.817521 (+122650us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:47.817555 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.817613 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.796818 (+979205us) raft_consensus.cc:1685] finished
0709 13:00:48.796854 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.797159 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27644,"raft.queue_time_us":38293,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4939,"spinlock_wait_cycles":17372032,"thread_start_us":88378,"threads_started":2,"wal-append.queue_time_us":293530}
I20260709 13:00:48.812709  5627 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.812855  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.813539  5671 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.813468  1439 catalog_manager.cc:5697] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 7, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.821424  5404 raft_consensus.cc:3055] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:48.750198  5559 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.822958  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:48.822480  5667 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.823776  1614 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:48.823694  5615 consensus_queue.cc:1059] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:48.824487  5624 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.825417  1612 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.827347  1510 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:48.720791  2243 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:48.665659   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:48.856088  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.853763  5404 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:48.878382  5404 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.878875  5615 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:48.879478  5615 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:48.880162  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:48.880388  5404 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:48.881042  5702 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.450s	user 0.002s	sys 0.011s
I20260709 13:00:48.881098  1692 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:48.857402  5631 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:48.857656  1538 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:48.882959  5619 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:48.884258  5722 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:48.884745  5722 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.885110  5722 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:48.885553  1440 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38400 (request call id 236) took 27480 ms (client timeout 15000 ms). Trace:
I20260709 13:00:48.856882  5484 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:48.858842  5559 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:48.858616  1439 catalog_manager.cc:5697] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 7, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.888639  1439 catalog_manager.cc:5697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
W20260709 13:00:48.886004  1440 rpcz_store.cc:269] 0709 13:00:21.423190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.458729 (+ 35539us) service_pool.cc:224] Handling call
0709 13:00:23.707095 (+2248366us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0f090 00007f29ebdadf3a 00007f29f1b641cc 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc 00007f29f0122392 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:48.885286 (+25178191us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:41.352322 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:41.484703 (+132381us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:41.484768 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:00:41.484786 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:41.485776 (+   990us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:41.485848 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:41.485874 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:00:41.486593 (+   719us) tablet.cc:701] Row locks acquired
0709 13:00:41.486637 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:00:41.486922 (+   285us) write_op.cc:270] Start()
0709 13:00:41.487060 (+   138us) write_op.cc:276] Timestamp: P: 1783602041486860 usec, L: 0
0709 13:00:41.487075 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:00:41.487756 (+   681us) log.cc:844] Serialized 3601 byte log entry
0709 13:00:44.837651 (+3349895us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29e8c9b0ac 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b
0709 13:00:47.097761 (+2260110us) op_driver.cc:464] REPLICATION: finished
0709 13:00:47.245659 (+147898us) write_op.cc:301] APPLY: starting
0709 13:00:47.254642 (+  8983us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:47.262094 (+  7452us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:47.262131 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:47.270820 (+  8689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:47.283816 (+ 12996us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda232a 00007f29ebd27f14 00007f29ebd27ec3 00007f29ebd27e38 00007f29ebd27df3 00007f29ebd270dc 00007f29ebd50e16 00007f29ebd38cbb 00007f29ebd2339d 00007f29ebd26d75
0709 13:00:47.351887 (+ 68071us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:00:47.351968 (+    81us) write_op.cc:312] APPLY: finished
0709 13:00:47.352375 (+   407us) log.cc:844] Serialized 71 byte log entry
0709 13:00:47.620793 (+268418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.627318 (+  6525us) write_op.cc:454] Released schema lock
0709 13:00:47.650120 (+ 22802us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:47.755298 (+105178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:47.761586 (+  6288us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4499807,"reported_tablets":32,"spinlock_wait_cycles":428131072,"child_traces":[["op",{"apply.queue_time_us":126220,"apply.run_cpu_time_us":46249,"apply.run_wall_time_us":439441,"num_ops":9,"prepare.queue_time_us":640786,"prepare.run_cpu_time_us":34512,"prepare.run_wall_time_us":5809865,"raft.queue_time_us":899,"raft.run_cpu_time_us":57640,"raft.run_wall_time_us":2424024,"replication_time_us":5610524,"spinlock_wait_cycles":5132918016,"thread_start_us":6478988,"threads_started":5,"wal-append.queue_time_us":3677027,"wal-append.run_cpu_time_us":3192,"wal-append.run_wall_time_us":1003802}]]}
I20260709 13:00:48.860575  1509 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:48.892665  1509 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:48.893616  5720 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:48.861550  5641 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:48.894548  5720 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:48.845659  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:48.894851  5641 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.895325  5641 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.864238  5622 raft_consensus.cc:740] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:48.896219  5667 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:48.896564  5622 consensus_queue.cc:260] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.897797  5622 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.858004  5671 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.889992  1439 catalog_manager.cc:5697] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:48.878993  5726 log.cc:927] Time spent T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.333s	user 0.000s	sys 0.012s
W20260709 13:00:48.883457  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 56181.1us
W20260709 13:00:48.880501  5728 log.cc:927] Time spent T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.333s	user 0.013s	sys 0.023s
I20260709 13:00:48.868194  5638 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.858469  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45396 (request call id 1004) took 1278 ms. Trace:
I20260709 13:00:48.848342  5386 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:48.848069  5621 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.902727  1612 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:48.923133  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:48.909858  2277 rpcz_store.cc:276] 0709 13:00:47.580164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.580295 (+   131us) service_pool.cc:224] Handling call
0709 13:00:48.705594 (+1125299us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54004c8454. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd9ca3d 00007f29f0d6ccd0 00007f29ea2f1254 00007f29ea2f11e2 00007f29ea2f1111 00007f29ea2f108c 00007f29ea2f0342 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:48.858353 (+152759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496102144}
W20260709 13:00:48.923383  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 67448.7us
I20260709 13:00:48.926903  1439 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 7 to 10, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:00:48.880637  5615 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.932724  5720 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:48.949551  5636 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.950717  5676 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.950798  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:48.951514  5559 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:48.952016  5559 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:48.952432  5559 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.885814  5619 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:48.953490  1538 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:48.946722  1690 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:48.948010  5615 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.954839  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.955588  1541 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:48.956490  5667 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:48.956966  5667 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:48.957360  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:48.958217  1614 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:48.957906  5667 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:48.959730  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:48.960700  1611 raft_consensus.cc:2410] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:48.947656  5506 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:48.949179  5720 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:48.959203  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:48.946569  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.975906  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.954918  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 252400us
I20260709 13:00:48.959542  1538 raft_consensus.cc:1217] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[10.7-13.9]   Dedup: 10.7->[11.8-13.9]
I20260709 13:00:48.981133  5610 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:48.981336  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:48.982177  1619 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.983891  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.984629  1544 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:48.986186  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1058) took 1093 ms. Trace:
I20260709 13:00:48.986554  2272 rpcz_store.cc:276] 0709 13:00:47.892328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.051140 (+158812us) service_pool.cc:224] Handling call
0709 13:00:48.068630 (+ 17490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.084021 (+ 15391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.084046 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.500154 (+416108us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b1800164d40. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c862a6 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a
0709 13:00:48.500881 (+   727us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b2c00047618. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 13:00:48.502864 (+  1983us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.686214 (+183350us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:48.686323 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.686468 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.985887 (+299419us) raft_consensus.cc:1685] finished
0709 13:00:48.985909 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.986032 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16236,"raft.queue_time_us":13475,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":17523,"spinlock_wait_cycles":26140800,"thread_start_us":157916,"threads_started":1,"wal-append.queue_time_us":35898}
I20260709 13:00:48.987929  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:48.988574  1687 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:48.990115  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:48.990777  1685 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.990945  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:48.991612  1543 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:48.992401  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:48.993086  1612 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:48.994287  1616 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:48.976637  1538 pending_rounds.cc:85] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 7
I20260709 13:00:48.999244  1538 pending_rounds.cc:107] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:00:49.003753  1538 raft_consensus.cc:2889] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.946547  1439 catalog_manager.cc:5697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 6, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:00:49.006529  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.006989  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.008841  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.009294  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.011564  1685 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:00:49.012827  1619 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
W20260709 13:00:49.014083  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.987224  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.002099  5722 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:49.021992  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 323767us
I20260709 13:00:49.023876  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.024670  1613 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:49.025238  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:49.017975  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.041241  1685 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:49.064734  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.067438  1439 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.072031  1543 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:49.073532  1692 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:00:49.081379  1536 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:49.084331  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.079093  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:49.089422  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 79514.3us
W20260709 13:00:49.089839  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 126021us
I20260709 13:00:49.089691  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.076959  5614 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.095304  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:49.103536  5731 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:00:49.103379  5688 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:49.105253  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:49.115386  1687 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.105878  5719 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.110111  5722 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:49.127840  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 102702us
I20260709 13:00:49.133315  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:49.133795  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:49.134436  1539 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:49.134944  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 74583.4us
I20260709 13:00:49.133945  5594 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.135716  5593 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:49.139184  1691 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:00:49.140642  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 98443.8us
I20260709 13:00:49.140959  5688 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:49.141860  5722 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.143074  5684 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.143602  1660 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:49.144062  5638 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:49.134954  1690 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:49.133103  5618 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.164033  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.123705  1439 catalog_manager.cc:5697] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 9 to 11, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:00:49.163563  5559 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.168033  5722 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:49.168576  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 1795) took 1160 ms (client timeout 1518 ms). Trace:
I20260709 13:00:49.164883  5688 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:49.168993  1545 rpcz_store.cc:269] 0709 13:00:48.008384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.031718 (+ 23334us) service_pool.cc:224] Handling call
0709 13:00:49.168238 (+1136520us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001865d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:49.168403 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361391488}
I20260709 13:00:49.170306  5688 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:49.171542  5688 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:49.172358  1439 catalog_manager.cc:5697] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 7, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:49.175454  5733 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:00:49.176383  5719 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.176843  5618 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:49.180578  5559 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:49.182335  1687 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:49.189080  5682 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.189707  5682 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:49.190903  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.191262  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.191337  5615 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.191699  5682 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:49.191879  5615 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.194025  5615 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:49.195326  2272 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:49.195689  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:49.196122  5594 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:49.197011  2277 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.164178  5684 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.197852  5684 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.199134  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:49.201406  2274 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:49.202000  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:49.198331  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:49.203306  5610 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:49.203711  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:49.203725  2275 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.204510  5621 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.205802  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:49.199177  1658 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:49.207201  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.207744  5614 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:49.208535  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.208621  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 79575.7us
I20260709 13:00:49.209159  5667 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.209717  5667 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.210916  2243 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:49.210848  5504 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:49.211395  5484 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:49.211947  5578 consensus_queue.cc:1059] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:49.185369  1539 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:49.203733  5610 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.207661  1658 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:49.183234  5714 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:49.216753  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 73304.2us
I20260709 13:00:49.182536  5641 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:49.173977  1439 catalog_manager.cc:5697] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 6, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:49.170450  5722 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:49.212366  5484 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:49.228940  1439 catalog_manager.cc:5697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 6, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:49.234547  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.216794  5610 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:49.235316  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.240537  1544 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:49.236624  5656 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:49.253178  5719 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:49.254410  5739 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:00:49.255961  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48379.8us
I20260709 13:00:49.257998  5593 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:49.259406  5681 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:49.259881  5681 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:49.260877  5681 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.262282  5681 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.237371  5682 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:49.269949  1439 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 7 to 9, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:00:49.240427  5631 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:49.271636  1511 leader_election.cc:336] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.010s (SENT)
I20260709 13:00:49.267163  5594 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:49.280493  1617 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:49.281316  4765 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:49.281991  5719 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:49.298305  4765 raft_consensus.cc:3055] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:49.302600  4765 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:49.283031  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.267838  5656 raft_consensus.cc:697] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:49.279949  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:49.272444  5714 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.305843  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.306250  1536 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:49.292479  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 96916.5us
I20260709 13:00:49.292711  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.278538  5682 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:49.294803  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:49.305896  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.295722  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:49.299409  5667 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:49.282786  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.301328  5641 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:49.301716  1511 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:49.283248  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:49.308435  1537 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:49.303494  4765 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:49.308471  1439 catalog_manager.cc:5697] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 7, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:49.311508  5714 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:49.314728  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46549.2us
I20260709 13:00:49.315438  5656 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.316061  5620 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:49.316277  1511 leader_election.cc:336] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.037s (SENT)
I20260709 13:00:49.316457  5451 raft_consensus.cc:3055] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:49.316824  5451 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:49.317698  5451 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.322762  5386 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:49.323230  5386 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:49.323972  5386 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:49.325526  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.325917  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.326112  1687 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:49.326514  1691 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:49.327064  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.327864  1545 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:49.328281  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.330111  1536 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.294837  5703 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.331167  5703 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.331342  1690 raft_consensus.cc:2410] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:49.331514  5703 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.332150  5610 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.305928  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:49.335242  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.336014  1693 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:49.284364  5594 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:49.336503  5621 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.336651  5594 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.303642  5722 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:49.339128  1612 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:49.341351  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.342018  1687 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:49.342834  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.343272  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.343575  1691 raft_consensus.cc:2393] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 6: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:49.343725  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:49.332695  4765 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.291812  2275 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:00:49.344350  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:49.350368  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.351073  1690 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 5.
I20260709 13:00:49.351450  5451 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.351145  5682 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:49.353101  1690 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:00:49.355070  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 71879.8us
I20260709 13:00:49.359441  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.360126  1539 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:49.361196  1692 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:49.361989  1585 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:49.363340  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.364317  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.365435  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:49.365962  1689 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:49.366796  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.367017  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.367556  1540 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:49.368853  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.369015  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.369424  1618 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.369904  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.370031  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.370503  1614 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:49.370621  1612 raft_consensus.cc:3055] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:49.371062  1612 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:49.371295  5714 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:49.363370  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:49.371865  1612 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.373102  1612 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.375000  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.375845  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.376782  1618 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:49.375097  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.363246  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:49.380417  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.381392  1439 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:49.369532  1536 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:00:49.384184  1543 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
W20260709 13:00:49.386291  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.347747  5610 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:49.389603  5578 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.391288  1693 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:49.379700  5674 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:49.390410  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:49.385612  5667 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.392303  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:49.385501  5714 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:49.401113  1543 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.393211  5578 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:49.378731  5631 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:49.410784  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.419783  1613 raft_consensus.cc:2410] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:00:49.420222  1612 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:49.421698  2275 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:49.427580  2275 pending_rounds.cc:85] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 8
I20260709 13:00:49.427879  2275 pending_rounds.cc:107] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:49.428148  2275 raft_consensus.cc:2889] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:49.402282  1439 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:49.398126  5636 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.424152  1693 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:00:49.427141  1691 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.402916  5593 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:49.435437  1685 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.399748  5674 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:49.444034  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 80769.8us
I20260709 13:00:49.441592  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:49.399153  5688 consensus_queue.cc:1059] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:00:49.437150  1614 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:00:49.411425  5578 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.442423  1618 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.438324  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.463408  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.463604  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.464561  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.465464  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.465903  1611 raft_consensus.cc:2376] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9. Re-sending same reply.
I20260709 13:00:49.439105  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:49.433851  5636 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:49.452946  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 105779us
W20260709 13:00:49.454378  5741 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:49.454110  5674 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:49.454883  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.454067  1543 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:49.455557  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.455641  5611 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:00:49.456362  1616 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.458865  2276 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:49.491753  1439 catalog_manager.cc:5697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:49.466619  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.483879  1690 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
W20260709 13:00:49.485844  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 51239.1us
W20260709 13:00:49.448221  5721 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:00:49.440490  5681 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.495226  1689 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:49.496301  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:49.419533  5667 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.510653  1439 catalog_manager.cc:5697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:00:49.493556  5611 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.519254  5719 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.520220  5638 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:49.478453  5636 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.448642  5593 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:49.526937  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.527344  2275 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:49.475554  5655 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.531329  1611 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:49.533936  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.551328  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.553124  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.555255  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:49.560052  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 65765.7us
I20260709 13:00:49.560335  1612 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:49.561914  1620 raft_consensus.cc:2393] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:49.565317  1543 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.570067  2276 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.552958  5638 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:49.584066  1616 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:49.585554  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.488163  5684 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:49.595433  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.569528  1439 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 4 to 6, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:49.556465  5641 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.534492  5681 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.602746  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:49.603494  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.608247  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:49.609512  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:49.606591  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.612841  1539 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.613194  1613 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:49.614821  4765 consensus_queue.cc:1059] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:49.605316  5720 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:49.617419  2272 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:49.619235  5481 raft_consensus.cc:3055] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:49.619071  5720 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.619573  5481 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:49.620352  1509 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:49.621513  5671 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.621935  5671 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.622327  5671 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.623293  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:49.624482  1540 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:49.625419  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:49.626085  1544 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:49.630090  1688 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:49.629515  1439 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 6 to 8, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.565279  5611 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.639570  1536 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 14: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:49.555876  5722 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:00:49.634758  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.633885  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:49.651096  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 52630.2us
I20260709 13:00:49.615578  5621 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.659183  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:49.662258  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.587870  5719 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.665987  1439 catalog_manager.cc:5697] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 2 to 5, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:49.595508  5655 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.674160  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.679105  1613 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:49.641347  5641 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.685165  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.689567  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:49.671198  5559 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.695178  1616 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:00:49.695629  1616 pending_rounds.cc:85] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 7
I20260709 13:00:49.695508  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.696058  1616 pending_rounds.cc:107] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:00:49.694397  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:49.699368  1613 raft_consensus.cc:2410] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:49.696401  1616 raft_consensus.cc:2889] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:49.704205  2275 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:49.680526  1439 catalog_manager.cc:5697] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 3 to 5, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:49.707693  1439 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 8 to 10, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.709718  1439 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 9 to 12, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 12 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.665742  5451 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:00:49.668666  5621 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:49.750784  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.725114  2272 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.753499  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.777076  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:49.777920  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 145387us
I20260709 13:00:49.784570  2275 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:49.786890  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 105293us
W20260709 13:00:49.793046  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.795230  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.798358  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.683861  5593 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.811439  1689 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:49.784780  5667 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:49.815416  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.816038  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:49.816390  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.813781  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:49.817878  1543 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.733547  5638 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.784421  5665 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.176s
I20260709 13:00:49.799031  5656 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:49.816439  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:49.822736  2275 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.826450  2276 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:49.828375  1694 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.812263  5722 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:49.833711  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.835253  1612 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:49.837422  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.839828  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:49.843760  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.825477  5681 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:49.854004  1613 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
W20260709 13:00:49.848237  5746 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:00:49.848136  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.865490  1615 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.849248  5578 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.851022  5504 raft_consensus.cc:2764] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:00:49.870956  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.882215  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 55056.1us
I20260709 13:00:49.886667  1543 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:49.882138  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.888476  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:49.889175  1689 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:49.888564  1686 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:49.893198  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.894228  1612 raft_consensus.cc:2410] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:49.894882  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.863176  5404 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.875898  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:49.895640  1613 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
W20260709 13:00:49.911571  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.916379  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.888994  5611 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:49.919745  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.907606  2269 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:49.922138  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 58131.1us
I20260709 13:00:49.923337  1612 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:49.918591  5747 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:00:49.938510  1611 raft_consensus.cc:2410] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:49.903730  5404 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:49.919467  5756 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:00:49.917480  5720 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:49.937366  5641 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:49.958956  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:49.962067  5667 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:49.962759  5404 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:49.966696  5621 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:49.969022  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 53798.3us
I20260709 13:00:49.969666  2241 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:49.970400  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.971220  5504 raft_consensus.cc:2764] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:49.972952  5655 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:49.973410  2272 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
W20260709 13:00:49.953677  5749 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:00:49.982016  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:49.966372  5671 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:49.962879  5762 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:00:49.988044  5720 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:49.988368  5671 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:49.988665  5720 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.989070  5671 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:49.989624  5594 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.002s
I20260709 13:00:49.989810  5671 consensus_queue.cc:1243] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer e2a2b76c98ee44ff95e6508c34da0e3d log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:49.991043  5641 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:49.991248  5768 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:49.991406  5636 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:49.993291  5578 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:49.996675  5720 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.002187  5636 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:49.991508  5641 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:50.004685  5703 consensus_meta.cc:287] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.001s
I20260709 13:00:50.005234  5703 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.005405  5641 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.006543  5641 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.990082  5594 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.009774  2277 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:50.010901  5594 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.010999  5768 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.013376  5768 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:50.015864  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 45176.7us
I20260709 13:00:50.006546  2243 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:50.018486  2243 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:50.019273  5780 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:50.019822  5780 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:50.020776  5780 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.023730  5667 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:50.024323  5667 raft_consensus.cc:697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:50.025308  5667 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.028298  2243 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:50.038765  5656 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:50.040967  5656 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.037889  5594 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:50.046288  5594 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.046615  5594 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.051859  5703 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:50.067898  5722 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:50.058641  5719 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.072959  5559 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.076006  5722 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.078552  5594 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.090797  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.091053  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:50.091318  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.091982  2272 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:50.092016  5594 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:50.092023  5481 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.093422  5481 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.091521  2277 raft_consensus.cc:2393] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 7: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:50.096096  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.097544  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:50.098930  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.100303  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.101719  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.102487  2277 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:50.103881  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.111054  2277 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:50.112457  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.113699  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.115489  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.117313  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.117579  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.117905  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:50.118602  2277 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:50.119541  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.121037  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.122591  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.123157  2269 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:50.124290  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:50.117657  1613 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.129169  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:50.137364  5779 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:50.139353  5722 consensus_queue.cc:1059] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:50.140288  5665 raft_consensus.cc:3055] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:50.140614  5665 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:50.140810  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.141610  5779 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.141377  5665 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.142501  5665 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.148757  5779 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.151273  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.152853  5665 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:50.153451  5779 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:50.153600  5784 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:50.155890  1511 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.156666  5784 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.157264  5784 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:50.155004  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.159327  5785 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.160633  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.161437  5785 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.162606  2241 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.163388  5785 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.165887  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:50.170877  2243 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:50.172137  5667 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:50.172506  5667 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.172851  5667 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.175853  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:50.176679  1620 raft_consensus.cc:1217] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[8.9-10.10]   Dedup: 10.10->[]
I20260709 13:00:50.178752  1620 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
W20260709 13:00:50.181314  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.182698  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:50.184234  1620 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:50.183498  1617 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.185266  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:50.191602  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.191746  1620 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:50.192693  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.193468  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:50.196607  5656 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:50.197031  5656 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.197386  5656 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.199041  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:50.200330  1611 raft_consensus.cc:3055] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:50.200596  1611 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:50.201413  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.201223  1611 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.202178  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:50.196028  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.202587  5776 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.203419  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.204607  5776 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.205317  5481 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.207134  5682 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:50.209599  5667 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.202196  1611 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:50.212975  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48077us
I20260709 13:00:50.207072  5656 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.217415  5656 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:50.219908  1611 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:00:50.220958  1611 pending_rounds.cc:85] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 8
I20260709 13:00:50.221158  1611 pending_rounds.cc:107] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:50.221370  1611 raft_consensus.cc:2889] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.222061  5684 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:50.222338  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:50.217082  5667 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.223063  1611 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:50.229041  5757 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.393s	user 0.001s	sys 0.001s
I20260709 13:00:50.229346  1611 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:50.230248  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:50.230754  1611 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.230636  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:50.231624  5451 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:50.232044  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.232069  5451 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:50.236718  5451 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.239279  1615 raft_consensus.cc:2410] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:50.240336  1615 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:50.240376  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.240762  1615 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:50.241175  5506 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.241571  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.241583  1615 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.242780  1615 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.242981  1659 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:50.243326  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.239312  1611 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:50.242460  5506 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.247546  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.248055  5593 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.247628  5506 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.248500  5593 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.250563  5593 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.252421  5481 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.253077  5481 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.258239  5506 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.261020  5481 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.261926  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:50.246779  1659 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.265228  1659 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.252352  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.193743  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.266589  1611 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:50.273098  2243 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:50.271952  1542 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:00:50.270942  5481 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:50.274029  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.275657  1659 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.255723  1613 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:50.279466  1615 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:50.279784  1617 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:50.284742  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.284526  5631 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.314044  5481 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:50.339938  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 87673.1us
I20260709 13:00:50.340991  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.341989  5593 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.342473  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:50.347203  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 63617.6us
I20260709 13:00:50.367116  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:50.367677  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.368105  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.281955  5667 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:50.284224  5506 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.342485  5593 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:50.372562  5682 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.381904  1659 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:50.386979  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44623us
I20260709 13:00:50.388379  1659 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.389410  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.389523  5786 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.389827  5719 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.373728  5481 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.393148  1659 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.379367  5681 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.386943  5593 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.376511  5667 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:50.410236  5638 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.410615  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.412858  2277 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.415414  5506 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.418995  5681 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.420109  1659 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.422957  4765 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.421548  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.438474  5682 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.441524  5681 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:50.442011  5681 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:50.446857  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.449000  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.450160  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.450160  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.452781  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.453496  5776 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:50.453873  5776 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.454200  5776 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.462102  5776 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.466704  1690 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:50.473747  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:50.474416  1690 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.474804  5761 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:50.475194  5761 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:50.472996  5776 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.476063  5761 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.477088  5761 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.481114  1690 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
W20260709 13:00:50.481359  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.476493  5776 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:50.469852  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.483062  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.484376  5779 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:50.485153  5784 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:50.485638  5784 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:50.483651  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.487092  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.487426  1615 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:50.487818  1615 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:50.488080  5796 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:50.486527  5784 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.488566  5796 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:50.488610  1615 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.489670  1615 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.489574  5796 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.483130  5776 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.492815  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.493892  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:50.497656  1620 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.496948  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.501832  1615 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:50.500741  5776 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.517191  5481 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.518119  5481 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.520038  4765 raft_consensus.cc:2764] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:00:50.520782  4765 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.521240  4765 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.535320  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2597) took 1171 ms. Trace:
I20260709 13:00:50.535864  1692 rpcz_store.cc:276] 0709 13:00:49.364065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.372821 (+  8756us) service_pool.cc:224] Handling call
0709 13:00:49.373188 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:49.373582 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.373608 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:49.374132 (+   524us) log.cc:844] Serialized 52 byte log entry
0709 13:00:49.688232 (+314100us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:49.723556 (+ 35324us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.724276 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.724375 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.228511 (+504136us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:50.534880 (+306369us) raft_consensus.cc:1685] finished
0709 13:00:50.535014 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.535210 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":460,"prepare.queue_time_us":14526,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":904,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":24509,"spinlock_wait_cycles":7773440,"thread_start_us":313724,"threads_started":1,"wal-append.queue_time_us":429268}
W20260709 13:00:50.538717  1541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.012s	sys 0.007s
W20260709 13:00:50.539047  1541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.012s	sys 0.007s
I20260709 13:00:50.539624  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2134) took 1528 ms. Trace:
I20260709 13:00:50.541384  1687 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:50.539939  1541 rpcz_store.cc:276] 0709 13:00:49.011638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.011768 (+   130us) service_pool.cc:224] Handling call
0709 13:00:49.022245 (+ 10477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.077475 (+ 55230us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:49.201337 (+123862us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180048d360. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:49.403330 (+201993us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.539306 (+1135976us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.539360 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:50.539410 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.539472 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.539576 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12433,"prepare.queue_time_us":52415,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":260926,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":23524,"spinlock_wait_cycles":25939328,"thread_start_us":1340920,"threads_started":3,"wal-append.queue_time_us":398834}
I20260709 13:00:50.551846  4765 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:50.552150  1545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.024s	sys 0.021s
W20260709 13:00:50.552520  1545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.024s	sys 0.021s
I20260709 13:00:50.564356  1620 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
W20260709 13:00:50.565728  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 64814.8us
I20260709 13:00:50.569969  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:50.570962  5803 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.571782  5803 consensus_queue.cc:1059] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:50.574210  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.572474  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.565804  5784 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:50.577111  5784 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:50.579831  4765 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.579180  5620 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:50.584381  5620 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.586215  5620 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.586820  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:50.677909  4765 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:50.681166  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.699977  4765 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:50.700438  4765 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:50.578477  5776 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.731726  5802 raft_consensus.cc:3055] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:50.732219  5802 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:50.733104  5802 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:50.734987  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 238106us
I20260709 13:00:50.736357  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.734424  5802 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.738384  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.740185  4765 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.741896  5776 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.743469  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:50.744093  1690 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.745026  5803 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.747051  5784 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:50.747400  1658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.002s	sys 0.014s
W20260709 13:00:50.747763  1658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.002s	sys 0.014s
I20260709 13:00:50.748600  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:50.750550  5506 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.750954  5796 raft_consensus.cc:2764] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:50.751034  5506 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.752944  5506 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:50.753378  5506 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.753437  1690 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:50.755648  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:50.753846  5506 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.770023  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:50.770955  1685 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:50.771780  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:50.772641  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:50.774087  1691 raft_consensus.cc:2410] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:00:50.774855  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:50.775592  1690 raft_consensus.cc:2376] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9. Re-sending same reply.
I20260709 13:00:50.777484  5506 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:50.750373  5786 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:50.779855  5786 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.782356  5786 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.782927  1685 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:50.783900  5506 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.784323  5506 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.785202  5671 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:50.792168  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:50.792794  1543 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:50.794520  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:50.795063  1689 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.797034  5784 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.797462  5784 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.799279  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:50.799440  5784 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.799969  1690 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:50.802623  1689 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:50.804280  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:50.804937  1690 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:00:50.805205  5506 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:50.800552  5671 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:50.807548  5671 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.808756  5671 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.815412  1690 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:50.815884  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:50.816147  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:50.816493  1691 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:50.819120  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 80795.3us
I20260709 13:00:50.819794  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.822953  1691 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:50.824136  1685 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:50.824929  5808 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:50.825167  5807 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:50.825342  5808 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:50.825584  5796 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:50.825737  5807 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.826381  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.826221  5796 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.825762  5808 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.828208  5796 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.828475  5807 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.834815  5807 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.835959  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.836768  5807 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:50.837175  5807 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:50.837565  5807 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:50.840108  5780 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.010s	sys 0.003s
W20260709 13:00:50.840706  5780 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.010s	sys 0.004s
I20260709 13:00:50.845816  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.846874  5802 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:50.847241  5802 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:50.847582  5802 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.848371  5621 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:50.853891  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.855665  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.856794  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.857383  1614 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:50.858325  5671 consensus_queue.cc:1059] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:50.859041  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.859602  1617 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:50.859777  5779 raft_consensus.cc:3055] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:50.861088  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.861289  1509 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:50.861562  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.861550  1614 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:50.862113  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.862928  5784 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:50.863005  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.863307  5784 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.863644  5784 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:50.864153  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.864907  5776 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:50.865137  5620 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:50.865386  5776 raft_consensus.cc:697] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:50.865707  5620 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:50.866361  5776 consensus_queue.cc:237] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.866659  5620 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.860204  5779 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:50.863554  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.871444  5779 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.872644  5779 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.873806  5481 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:50.874185  5481 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.874589  5481 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:50.874853  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.875240  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.876585  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.881373  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1816) took 1539 ms. Trace:
I20260709 13:00:50.881724  1694 rpcz_store.cc:276] 0709 13:00:49.341611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.342796 (+  1185us) service_pool.cc:224] Handling call
0709 13:00:49.343076 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.832194 (+489118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.881173 (+1048979us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54003241d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:50.881322 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790253312}
I20260709 13:00:50.883998  5803 raft_consensus.cc:2764] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:00:50.893365  5713 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:50.893909  5506 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:50.893994  5713 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.894613  5506 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.896163  5713 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:50.896554  5506 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.893546  4765 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.897112  4765 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.897459  4765 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:50.899068  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 45255.3us
I20260709 13:00:50.849577  5621 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:50.876578  5808 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.903314  5807 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.871236  5784 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:50.907591  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:50.910122  1620 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:50.917757  4765 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.911692  5802 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.922209  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:50.922802  1619 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:50.931439  1660 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.940236  4765 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:50.915072  5621 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:50.944211  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.944854  5703 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:50.946146  5703 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:50.946555  5703 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.945087  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:50.947687  1620 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.943120  5796 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.951570  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.953078  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:50.954187  5808 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.954841  5808 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.955456  5808 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.955974  5807 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.945256  5641 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.959339  5641 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.961236  5641 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.962164  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:50.962718  1694 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:50.943650  5688 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:00:50.963595  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:50.965209  5641 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:50.965602  5641 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.965909  5641 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.967319  5802 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.970280  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:50.973812  5641 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:50.977130  5641 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:51.008363  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:51.008991  1688 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:50.978410  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:50.985142  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2584) took 1527 ms (client timeout 1526 ms). Trace:
I20260709 13:00:50.982499  5621 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.014988  1694 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:51.015147  1618 rpcz_store.cc:269] 0709 13:00:49.457303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.463185 (+  5882us) service_pool.cc:224] Handling call
0709 13:00:50.984944 (+1521759us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400068954. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:50.985056 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080287104}
I20260709 13:00:50.989127  5779 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.016286  5779 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.018404  5779 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:50.992825  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.020743  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:51.022709  1692 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:51.024567  5714 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:51.025591  5719 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.026024  5719 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.027926  5719 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.028781  5655 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:51.029312  5655 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.031361  5655 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:51.032752  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.033344  2276 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
W20260709 13:00:51.035686  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.035899  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:51.036289  5802 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.036794  5802 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.038241  2269 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:51.038762  5802 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.034396  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.040751  5638 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.041299  5638 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.045118  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.045706  5681 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.047233  2270 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:51.047876  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.048243  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:51.048796  2270 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:51.049314  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.016573  5621 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:50.991833  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:51.049397  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.989480  1612 consensus_meta.cc:287] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.041s	user 0.014s	sys 0.000s
I20260709 13:00:51.048676  5636 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:51.051512  2274 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:51.051560  1612 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:51.052234  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2608) took 1187 ms. Trace:
I20260709 13:00:51.052561  1612 rpcz_store.cc:276] 0709 13:00:49.864681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.902060 (+ 37379us) service_pool.cc:224] Handling call
0709 13:00:51.052184 (+1150124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:51.045723  2273 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:51.054402  1620 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:51.056353  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.060039  2275 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:51.059955  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:51.062745  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.013s	sys 0.003s
W20260709 13:00:51.063055  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.013s	sys 0.003s
I20260709 13:00:51.063783  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.059003  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:51.064293  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.065393  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:51.066077  1692 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:51.067842  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.069016  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:51.024921  5784 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.072765  2277 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:51.078593  1545 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:51.078507  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.079015  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.079599  1620 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:51.079628  5621 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:51.079823  2277 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:51.073729  2274 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:00:51.074417  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.052498  5636 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:51.076128  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.082211  5636 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.077421  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.077569  5638 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:51.080819  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.081736  1585 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:51.086988  1543 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.087754  5638 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:51.087644  5621 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:51.088306  5638 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.088810  5638 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.088816  5621 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.090054  5621 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.091749  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.095822  5638 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.098716  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:51.099521  5665 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.099921  5618 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.062849  5720 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.100796  1620 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.060684  5719 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:51.109738  1541 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:51.059552  5802 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:00:50.986313  5481 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.109915  1543 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
W20260709 13:00:51.111855  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 158806us
I20260709 13:00:51.111969  1694 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:51.101716  5714 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:51.115969  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.116065  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.113306  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.104676  5638 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:51.119684  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.124967  1543 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:00:51.125487  1543 pending_rounds.cc:85] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 5
I20260709 13:00:51.125825  1543 pending_rounds.cc:107] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:00:51.126786  1536 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:51.128175  1694 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:51.126183  1543 raft_consensus.cc:2889] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.112190  5784 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.114641  5620 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.130131  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.138595  1540 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:51.141191  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.107973  5618 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.143091  1686 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:51.149343  2270 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:00:51.150869  2277 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:51.149199  5636 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.151818  5481 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:51.141916  5620 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.128607  5665 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.153600  5620 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.154098  5665 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.128033  5641 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:51.155061  5641 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:51.155989  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:51.156666  2271 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.156052  5641 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.129297  5714 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.160614  5714 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.110467  5720 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.161945  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:51.116706  5719 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:51.162493  1612 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.163259  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:51.163352  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.130647  5682 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.170648  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.122776  5807 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:00:51.181563  1538 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.182047  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:51.174446  2271 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:51.182859  1689 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:51.184449  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.172917  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:51.187880  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.188627  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.185242  1537 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:51.168361  5636 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.190863  5404 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.185933  5682 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.191655  5404 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.193136  5618 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.194197  5638 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.194718  5638 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.197016  5681 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.199591  1692 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:00:51.199879  5720 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.194329  5703 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.171819  5796 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:51.191015  5714 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:00:51.204910  5719 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.207134  5636 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:51.207618  5636 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:51.208426  5636 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.211629  5684 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.212045  5684 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:51.217727  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.218128  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.219239  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:51.232710  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 61031us
I20260709 13:00:51.233414  1685 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:51.237809  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.238091  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.239122  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.239284  1620 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:51.239804  5802 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:51.240175  5802 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:51.241153  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:51.241010  5802 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.241912  1686 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:51.242179  5802 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.242967  5796 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:51.237231  1541 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:51.248353  1612 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:51.251884  1543 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:51.253307  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.253997  1543 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:51.254732  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:51.263815  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.264678  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.266357  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:51.267145  1689 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:51.267390  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:51.267968  1611 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.269075  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.269608  1620 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:51.271064  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.271706  1620 raft_consensus.cc:2393] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:51.272987  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.273727  1620 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:51.274883  1509 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.276397  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.277108  1540 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:51.243947  5796 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.279192  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.279771  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:51.280522  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.281199  1615 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:51.283166  1614 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:51.281288  1620 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:51.286188  1620 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 11. Ops: []
I20260709 13:00:51.287071  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:51.288704  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.288959  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.289278  1544 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:51.289651  1541 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 8: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:51.286549  1611 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:51.290380  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.291025  1611 raft_consensus.cc:2393] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:51.276281  5714 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:51.271862  5779 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:51.292702  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:51.171093  5784 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.295173  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.279150  5681 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.301575  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.296051  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.302102  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:51.302518  1611 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:51.302807  1613 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.303622  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.298147  1618 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:51.304378  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:51.305081  1619 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.299820  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.305761  1617 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:51.281369  5720 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:51.302162  1544 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:51.310235  1689 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:51.311439  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.306823  1510 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:51.315233  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.318404  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.319629  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:51.320276  1611 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.327312  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.328518  1542 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:51.338893  1611 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:51.341192  1613 raft_consensus.cc:2410] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:51.341531  1615 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:00:51.298617  5779 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.343590  1543 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:51.345086  1614 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:51.317629  5720 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:51.350883  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:51.355062  1689 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:51.353480  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 46763.1us
I20260709 13:00:51.359988  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:51.361958  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:51.362578  1690 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:51.365286  1543 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:51.349365  5779 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:51.348436  5714 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:51.372628  1510 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:51.381575  1510 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:51.357609  5720 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.328207  5665 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:00:51.397212  5665 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:51.361243  5674 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:51.391333  1619 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:51.378465  5776 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:51.383085  5722 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:51.407138  1543 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:00:51.415161  5822 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:51.398550  5620 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:00:51.432058  5714 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.433058  1541 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:51.433370  1541 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:51.434010  1541 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.434964  1541 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.436025  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.411202  5667 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:51.440598  5593 consensus_meta.cc:287] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.040s	user 0.013s	sys 0.000s
I20260709 13:00:51.443369  5784 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:51.443950  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:51.466538  1692 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.445653  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:51.446918  1715 debug-util.cc:398] Leaking SignalData structure 0x7b0800328f80 after lost signal to thread 434
I20260709 13:00:51.457506  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.419991  1689 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:00:51.459054  1693 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:51.468945  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:51.470325  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 88840.9us
I20260709 13:00:51.471095  1510 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:51.475011  1538 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:51.479974  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.481413  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.482035  1540 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.504925  1540 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
W20260709 13:00:51.515592  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.630184  1692 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
W20260709 13:00:51.646843  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 160294us
I20260709 13:00:51.647605  1510 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:51.648518  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.669246  1692 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:51.675426  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 219117us
I20260709 13:00:51.680243  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.682492  1541 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:51.685596  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:51.686231  1687 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.682919  1541 pending_rounds.cc:85] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 8
I20260709 13:00:51.687127  1541 pending_rounds.cc:107] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:51.687413  1541 raft_consensus.cc:2889] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.688791  1692 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:00:51.691686  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 44151.6us
I20260709 13:00:51.694862  1692 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:51.697145  1510 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:51.628147  5722 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:51.471009  5621 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.704864  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.720348  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.470642  5593 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.724380  1540 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:51.723869  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:51.725742  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.729076  1619 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:51.730769  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.731340  1540 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.732241  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:51.733587  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.827s	user 0.009s	sys 0.013s
I20260709 13:00:51.703486  5674 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:51.681582  5831 consensus_queue.cc:1059] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:00:51.745783  1618 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:51.723048  5803 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.749595  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:51.720244  5671 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:51.742355  1613 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:51.742300  1619 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:51.747388  1691 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:51.751291  1540 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:51.752282  1691 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:51.753042  1691 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:00:51.740940  1715 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4300 after lost signal to thread 1477
W20260709 13:00:51.754371  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080030e680 after lost signal to thread 1569
W20260709 13:00:51.754658  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080030e6c0 after lost signal to thread 1570
I20260709 13:00:51.689829  5784 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:00:51.730201  5796 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.749182  1692 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:51.761011  1615 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:51.762570  1687 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:51.763574  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.732290  5722 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:51.768939  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.769357  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.741859  5674 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:51.771178  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.771864  1540 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:51.773198  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.773706  1615 raft_consensus.cc:1275] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:00:51.777755  5802 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.004s
I20260709 13:00:51.780435  1536 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:51.780711  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.785888  1538 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:00:51.781790  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.784461  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:51.789104  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.790084  1660 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.791033  1660 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:51.791769  4765 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:51.792197  4765 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.792531  4765 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.795447  1617 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:00:51.772578  5674 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.760455  5803 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.767678  5796 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:51.803172  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.899s	user 0.009s	sys 0.013s
I20260709 13:00:51.794071  5688 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:51.796211  5631 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:51.808385  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 853) took 1994 ms. Trace:
I20260709 13:00:51.815843  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.798139  5681 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:51.810787  1616 rpcz_store.cc:276] 0709 13:00:49.811289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.811428 (+   139us) service_pool.cc:224] Handling call
0709 13:00:49.824364 (+ 12936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.840785 (+ 16421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.840815 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.846290 (+  5475us) log.cc:844] Serialized 26 byte log entry
0709 13:00:51.804798 (+1958508us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:51.804851 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.804932 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:51.804983 (+    51us) raft_consensus.cc:1685] finished
0709 13:00:51.805000 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.805141 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6083,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":6555,"thread_start_us":1900688,"threads_started":1,"wal-append.queue_time_us":182233,"wal-append.run_cpu_time_us":1620,"wal-append.run_wall_time_us":1003851}
I20260709 13:00:51.799609  5759 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:00:51.832345  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.840430  1542 raft_consensus.cc:2376] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11. Re-sending same reply.
W20260709 13:00:51.845263  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 123906us
I20260709 13:00:51.852407  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:51.872428  2269 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:51.871351  2243 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:51.868705  2271 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:51.815241  5722 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.886708  5836 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:51.827900  5681 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:51.886739  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 180227us
I20260709 13:00:51.888785  5681 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.889607  5836 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:51.889717  5838 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:51.890309  5838 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.890252  5836 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.890843  5838 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.892494  5836 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:51.893250  5836 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:51.893738  5836 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:51.894613  5836 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.896139  5839 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:51.848224  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:51.872442  5621 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.870317  5593 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:51.937628  4765 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:51.942526  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 53489.6us
W20260709 13:00:51.940048  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 68668.9us
I20260709 13:00:51.944065  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:51.946604  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 96647.7us
W20260709 13:00:51.948827  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.949319  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.941820  5656 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:51.951676  5831 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.967839  4765 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:51.955374  5656 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:51.975414  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:51.978973  4765 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:51.979667  4765 raft_consensus.cc:697] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:51.984658  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.983403  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 192417us
I20260709 13:00:51.987162  1509 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:51.987401  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080030cd00 after lost signal to thread 1644
W20260709 13:00:51.988526  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080030cce0 after lost signal to thread 1645
I20260709 13:00:51.988270  4765 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:00:51.989905  1715 debug-util.cc:398] Leaking SignalData structure 0x7b08003740a0 after lost signal to thread 1718
W20260709 13:00:51.990249  1715 debug-util.cc:398] Leaking SignalData structure 0x7b0800370080 after lost signal to thread 1719
W20260709 13:00:51.991631  1715 debug-util.cc:398] Leaking SignalData structure 0x7b08003fca40 after lost signal to thread 2301
W20260709 13:00:51.991930  1715 debug-util.cc:398] Leaking SignalData structure 0x7b08002fca40 after lost signal to thread 2302
I20260709 13:00:51.986220  5688 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:51.993959  5656 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:51.994513  5688 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.995451  5656 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.995539  5636 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:51.976136  5803 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:51.992405  1715 debug-util.cc:398] Leaking SignalData structure 0x7b080037db40 after lost signal to thread 5611
I20260709 13:00:52.001159  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:51.970242  5831 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:51.983263  5631 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:52.003050  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 59086.4us
I20260709 13:00:52.004415  5845 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:52.006114  5638 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:52.007007  5816 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.940s	user 0.005s	sys 0.002s
W20260709 13:00:52.009390  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 63161.9us
I20260709 13:00:51.999397  5641 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:51.109423   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:52.016263  1584 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:52.028394  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:51.985929  5796 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.025557  1693 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:52.033811  5803 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.035090  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:52.035681  1685 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:52.035754  1686 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:00:52.025609  5720 consensus_meta.cc:287] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.002s
I20260709 13:00:52.039440  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:52.039965  1541 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.040426  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:52.042771  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:52.044253  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:52.041112  1614 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:52.046131  1617 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:52.062536  1541 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:52.064000  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:52.064368  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:52.010905  5784 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:52.031832  5620 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.030694  5641 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.011179  5847 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:00:52.071449  1612 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:52.063907  5681 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:52.084743  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 107939us
I20260709 13:00:52.043321  5796 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:52.100153  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 50982.6us
I20260709 13:00:52.040954  5845 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:52.094880  5852 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:52.046011  5803 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:52.098769  5667 consensus_queue.cc:1059] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:52.046875  5840 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:52.036610  5720 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:52.071724  5779 consensus_meta.cc:287] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.002s
I20260709 13:00:52.059902  5799 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.137372  5684 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:52.139101  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2621) took 1018 ms. Trace:
I20260709 13:00:52.146852  5682 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:52.149420  5703 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:52.150200  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1077) took 1103 ms. Trace:
I20260709 13:00:52.156714  5776 raft_consensus.cc:3055] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:52.160960  5681 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:52.161698  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:52.255612  2268 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.162443  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:52.163257  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:52.164036  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:52.165261  2269 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:00:52.257859  2269 pending_rounds.cc:85] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 10
I20260709 13:00:52.258240  2269 pending_rounds.cc:107] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:00:52.258525  2269 raft_consensus.cc:2889] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:52.158460  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.045840  5621 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:00:52.085017  5641 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.248822  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:52.250989  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 191395us
I20260709 13:00:52.250510  1694 rpcz_store.cc:276] 0709 13:00:51.121150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.121272 (+   122us) service_pool.cc:224] Handling call
0709 13:00:51.121618 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.128532 (+  6914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.138832 (+1010300us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b54002e59d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:52.139031 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14683520}
I20260709 13:00:52.249706  2277 rpcz_store.cc:276] 0709 13:00:51.046442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.080803 (+ 34361us) service_pool.cc:224] Handling call
0709 13:00:51.150562 (+ 69759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.151185 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.150025 (+998840us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b5400586bd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:52.150150 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159755648}
I20260709 13:00:52.264722  1544 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:52.263401  2243 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:52.254907  5830 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:00:52.140357  5796 raft_consensus.cc:697] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:52.253146  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 223236us
I20260709 13:00:52.166610  5835 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:52.177274  5852 consensus_queue.cc:1243] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer e2a2b76c98ee44ff95e6508c34da0e3d log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:52.276156  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 839) took 1136 ms. Trace:
I20260709 13:00:52.251804  5776 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:52.278414  1536 rpcz_store.cc:276] 0709 13:00:51.162630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.162853 (+   223us) service_pool.cc:224] Handling call
0709 13:00:51.780281 (+617428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.788410 (+  8129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.275991 (+487581us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b5400313150. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:52.276107 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394960128}
W20260709 13:00:52.273047  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 206924us
I20260709 13:00:52.272756  1611 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:52.263015  5802 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.272046  5714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.017s	sys 0.022s
I20260709 13:00:52.176173  5803 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:52.143705  5620 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
W20260709 13:00:52.281409  2241 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.691s (SENT) [suppressed 41 similar messages]
I20260709 13:00:52.268517  5593 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:52.336371  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:52.337028  1615 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:52.330128  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 232509us
I20260709 13:00:52.331493  1613 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:52.253005  5779 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.248826  5851 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:00:52.288142  5667 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:52.326212  5714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.017s	sys 0.022s
I20260709 13:00:52.291045  5799 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.367270  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 65852.5us
I20260709 13:00:52.335418  5404 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:52.270651  5846 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:00:52.271879  5784 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:00:52.455688  1545 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:52.290302  5852 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.249547  5840 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.264923  5681 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.283028  5656 consensus_queue.cc:1059] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:00:52.139038  5631 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:52.391448  5667 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:52.464731  1615 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:52.334962  5847 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:00:52.473161  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.327242  5674 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.325804  5802 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.474011  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 845) took 1256 ms. Trace:
I20260709 13:00:52.332404  5835 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.353319  5593 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.455873  5865 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:52.480872  1537 rpcz_store.cc:276] 0709 13:00:51.217312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.239981 (+ 22669us) service_pool.cc:224] Handling call
0709 13:00:51.240237 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.240437 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:51.262973 (+ 22536us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.136378 (+873405us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b18002f03e0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a 00007f29ebdafa2a
0709 13:00:52.473684 (+337306us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.473741 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:52.473798 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.473852 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.473960 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22191,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"spinlock_wait_cycles":14816512,"thread_start_us":337042,"threads_started":2}
I20260709 13:00:52.534785  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:52.538463  1536 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:52.476887  5667 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:52.395043  5845 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.495332  5860 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.475096  5796 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:52.534772  5865 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:52.556490  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 78195.2us
I20260709 13:00:52.566987  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:52.568100  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 286635us
I20260709 13:00:52.570079  2269 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:52.460031  5799 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.549592  5831 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:52.576399  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:52.557987  5854 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
W20260709 13:00:52.565997  5850 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
I20260709 13:00:52.472237  5852 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:52.641717  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 74788us
I20260709 13:00:52.575197  5618 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:52.495431  5776 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:52.640949  5869 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:00:52.675405  5843 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:52.565044  5784 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 13:00:52.663352  5870 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:00:52.676463  1660 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:52.666006  5867 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:00:52.666369  5759 raft_consensus.cc:3055] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:52.677999  5759 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:52.678597  5842 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.679056  5842 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.679474  5842 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.670881  5671 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:52.679760  5802 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.680289  5802 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.636878  5720 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.680734  5802 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.680931  5720 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:52.682555  5720 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:52.682906  5720 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:52.683212  5879 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.683606  5720 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.684226  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 846) took 1443 ms. Trace:
I20260709 13:00:52.684712  5720 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:52.684861  5703 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:52.685098  5719 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:52.685478  5703 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.685644  5719 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.674819  5618 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:52.687544  5703 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.687784  5719 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.689419  5779 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.690770  5836 raft_consensus.cc:3055] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:52.690959  5840 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.691164  5836 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:52.692090  5674 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.692003  5836 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.564695  5860 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:52.693202  5836 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.671984  5681 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.693924  5681 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:52.694334  5860 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:52.694396  5681 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.688033  5703 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:52.696943  5703 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:52.686815  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 347452us
I20260709 13:00:52.678893  5759 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.699185  1658 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:52.699498  5759 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.700258  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:52.701889  5682 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:52.702251  5682 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.688151  5803 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:52.688593  5618 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:52.702472  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:52.684562  1544 rpcz_store.cc:276] 0709 13:00:51.240776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.322983 (+ 82207us) service_pool.cc:224] Handling call
0709 13:00:51.324710 (+  1727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.269068 (+944358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.684019 (+414951us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b5400354b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:52.684169 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2157812992}
I20260709 13:00:52.724794  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:52.733106  1617 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:00:52.727793  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 333081us
I20260709 13:00:52.735204  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:52.736001  1509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.010s	sys 0.003s
W20260709 13:00:52.736405  1509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.010s	sys 0.003s
W20260709 13:00:52.736688  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 688562us
W20260709 13:00:52.743641  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 461980us
I20260709 13:00:52.745869  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:52.747696  1511 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:52.749013  2268 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:52.702620  5682 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.750898  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:52.751927  2269 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:52.778987  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:52.699509  5703 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.756793  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:00:52.807941  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 51239us
I20260709 13:00:52.808888  1617 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:52.809685  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:52.702822  5857 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:52.806695  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 59072.3us
I20260709 13:00:52.813798  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:52.817417  1658 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:52.771270  5722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.000s	sys 0.015s
I20260709 13:00:52.820261  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:52.820981  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:52.780459  5641 consensus_meta.cc:287] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.002s
I20260709 13:00:52.779707  5719 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:52.831249  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:52.836295  1511 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:52.831563  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:52.779763  5684 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:52.741591  5802 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.749791  5840 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.750326  5618 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:52.838136  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:52.831602  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:52.864816  1689 raft_consensus.cc:2393] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:52.823588  2273 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.838177  1694 raft_consensus.cc:2368] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9.
I20260709 13:00:52.841050  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:52.806043  5481 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.843266  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:52.844026  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:52.865945  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:52.866250  1687 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:52.853850  5838 consensus_meta.cc:287] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.962s	user 0.008s	sys 0.004s
I20260709 13:00:52.819818  5674 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:52.845890  5841 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.846076  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:52.846899  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:52.850843  5779 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.881882  5481 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.882357  5386 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.882498  5858 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.336s	user 0.000s	sys 0.005s
I20260709 13:00:52.870857  5684 raft_consensus.cc:697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:52.882911  5386 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.883598  5684 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.884124  5481 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.884477  5852 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:52.884843  5386 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:52.885206  1536 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:52.814152  5863 raft_consensus.cc:2764] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:00:52.878247  5674 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:52.830261  5876 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.886312  1686 raft_consensus.cc:2368] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12.
I20260709 13:00:52.813108  5857 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.886449  5841 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.881932  5620 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.886464  5876 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.889555  5876 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:52.886818  5857 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.895911  1544 raft_consensus.cc:1275] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:52.817319  5860 consensus_queue.cc:1059] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:00:52.822636  5404 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:52.897114  5404 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.857865  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 850) took 1580 ms. Trace:
I20260709 13:00:52.844756  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:52.897958  1692 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.898888  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:52.831389  5636 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:52.903246  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.872725  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:52.875021  1687 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:52.905671  2273 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:52.886168  5674 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:52.878822  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:52.882239  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:52.878254  5879 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.866629  1694 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:52.913497  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:52.914242  2270 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:52.863905  5802 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:52.938023  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.897648  1545 rpcz_store.cc:276] 0709 13:00:51.277788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.415833 (+138045us) service_pool.cc:224] Handling call
0709 13:00:51.420330 (+  4497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.469194 (+1048864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.857602 (+388408us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b5400353c54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:52.857799 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246693248}
W20260709 13:00:52.908680  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 232270us
I20260709 13:00:52.910228  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:52.886904  5841 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:52.859205  5722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.000s	sys 0.015s
I20260709 13:00:52.920531  1692 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:52.955899  1689 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:52.956152  1660 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:00:52.934264  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 363877us
I20260709 13:00:52.957736  2241 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:52.941767  1585 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:52.902959  5404 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.882661  5719 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.877272  1509 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:52.854897  5641 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.967844  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:52.978658  1536 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.975585  2272 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:52.914744  5620 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:53.035584  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 221968us
I20260709 13:00:52.940142  5631 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:53.082002  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46809.7us
W20260709 13:00:53.082448  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 44276.1us
I20260709 13:00:53.084939  1545 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:53.083647  4765 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:00:53.083053  1660 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:52.902740  5838 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:52.985666  5860 raft_consensus.cc:3055] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:53.134019  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 176320us
W20260709 13:00:53.167860  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 84862.4us
I20260709 13:00:53.087478  5703 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:52.958282  5802 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:52.916255  5857 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:52.912850  5879 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.185978  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:53.191965  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.060s	sys 0.145s
I20260709 13:00:53.207715  4765 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:00:53.210381  1693 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:53.224032  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.060s	sys 0.146s
I20260709 13:00:53.224931  5843 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:53.233105  5843 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:53.234200  5843 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.237056  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:53.207129  5886 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.208096  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 101933us
I20260709 13:00:53.240536  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:53.237854  5886 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.241140  1617 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:53.241667  4765 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.242144  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:53.242590  1542 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:53.242537  4765 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.244184  5886 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.244585  4765 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:53.208962  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:53.253115  1617 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.135620  5860 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:53.259230  4765 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.259649  2243 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:53.259902  4765 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.262658  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:53.207060  5882 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.101011  5878 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 13:00:53.094987  5719 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.101588  5631 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.280416  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:53.211910  5838 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:00:53.280354  5842 consensus_meta.cc:287] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.002s
I20260709 13:00:53.247143  5703 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:00:53.281201  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 339447us
I20260709 13:00:53.251452  5620 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:53.223167  5875 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:53.290047  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:53.284883  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 374642us
W20260709 13:00:53.291644  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 414094us
I20260709 13:00:53.133795  5881 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.179s
I20260709 13:00:53.301165  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2197) took 1021 ms. Trace:
I20260709 13:00:53.258770  5386 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:53.308403  1692 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.354212  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:53.310479  1691 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:53.310982  1585 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:53.340459  4765 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.339386  1616 rpcz_store.cc:276] 0709 13:00:52.280040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.282043 (+  2003us) service_pool.cc:224] Handling call
0709 13:00:52.324367 (+ 42324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.324592 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:52.727490 (+402898us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.300755 (+573265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.300820 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.300884 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.300966 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.301103 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":642987,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":47045,"thread_start_us":907788,"threads_started":3,"wal-append.queue_time_us":558465}
I20260709 13:00:53.362653  1692 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:53.309010  5620 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.335819  5886 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.389411  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:53.369323  5896 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.381636  5620 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.308434  5842 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.367872  5892 raft_consensus.cc:2764] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:00:53.390816  5656 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:53.369921  5386 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.437397  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:53.388813  5880 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.339811  5875 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.434497  5481 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.352380  5860 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.288399  5882 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.386885  5886 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.437798  5641 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.442502  5656 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.425391  5878 consensus_queue.cc:1059] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:00:53.560591  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:53.561479  1542 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:53.426214  5904 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
W20260709 13:00:53.577833  1536 consensus_meta.cc:287] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.000s
I20260709 13:00:53.580044  1536 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:53.572665  5919 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:53.440034  5906 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:00:53.435333  5896 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.550148  5656 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.586589  5877 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.229s
I20260709 13:00:53.546607  5880 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:53.550626  5802 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:53.590426  5919 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.542259  5481 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.591001  5631 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:53.595283  5902 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:00:53.596400  5896 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:53.557315  5857 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.564960  5860 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:53.613189  1542 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:00:53.598649  5404 consensus_meta.cc:287] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.612s	user 0.004s	sys 0.000s
W20260709 13:00:53.603330  5897 log.cc:927] Time spent T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:00:53.588392  5891 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.648617  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 439625us
W20260709 13:00:53.610622  5759 consensus_meta.cc:287] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.911s	user 0.009s	sys 0.002s
I20260709 13:00:53.599117  5719 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.532816  5703 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.599980  5842 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:53.608333  5920 log.cc:927] Time spent T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:00:53.586488  5784 raft_consensus.cc:2764] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:00:53.705196  2241 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:53.601352  5877 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.613863  5894 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 13:00:53.615336  5916 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:53.612511  5481 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.814850  1584 leader_election.cc:400] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9.
I20260709 13:00:53.607084  5919 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.604866  5386 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:53.658036  5720 consensus_meta.cc:287] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.973s	user 0.010s	sys 0.003s
I20260709 13:00:53.607749  5886 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:53.614660  5873 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.610845  5879 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.609813  5620 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.789355  1542 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:53.688133  5667 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.133s	user 0.008s	sys 0.005s
I20260709 13:00:53.614293  5930 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:53.803210  1536 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:53.658923  5404 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:53.809473  2243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.010s	sys 0.009s
W20260709 13:00:53.810701  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 105551us
W20260709 13:00:53.880571  2243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.010s	sys 0.009s
I20260709 13:00:53.610649  5656 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.614521  5907 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.423s
I20260709 13:00:53.614467  5911 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.357s
I20260709 13:00:53.615267  5905 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:53.815574  1584 leader_election.cc:403] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:53.815846  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 504846us
I20260709 13:00:53.803934  5847 raft_consensus.cc:3055] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:53.822216  5925 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.901165  5925 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.904032  5404 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:53.904634  1688 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:53.906296  5925 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:53.812194  5836 consensus_meta.cc:287] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.114s	user 0.015s	sys 0.005s
I20260709 13:00:53.601697  5880 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.906791  5905 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.908943  5905 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:53.807435  5904 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.909714  5904 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.910771  5881 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:53.911712  5904 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:53.823104  5840 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.950s	user 0.006s	sys 0.003s
I20260709 13:00:53.912350  5840 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:53.913130  1689 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:53.820021  5759 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:53.826249  5682 consensus_meta.cc:287] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.996s	user 0.008s	sys 0.004s
W20260709 13:00:53.852371  5918 log.cc:927] Time spent T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:00:53.853053  5899 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:00:53.915589  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 111355us
I20260709 13:00:53.916399  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:53.855935  5889 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:53.856257  5917 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:53.856897  5875 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.858429  5681 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.930840  5681 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.863942  5865 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.931244  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:53.931555  5865 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.850044  5873 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:53.933853  5873 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:53.934327  5873 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:53.935070  5875 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:53.935561  5875 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.867471  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1089) took 1116 ms. Trace:
I20260709 13:00:53.816298  5877 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.938622  5928 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.937588  2277 rpcz_store.cc:276] 0709 13:00:52.750838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.752662 (+  1824us) service_pool.cc:224] Handling call
0709 13:00:52.780051 (+ 27389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.820141 (+ 40090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.820184 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.820718 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.097538 (+276820us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:53.326871 (+229333us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.866995 (+540124us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b18004088e0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29eb94d4bc 00007f29e8c9b48b 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ebd9d060 00007f29ebdaf716 00007f29ebdc0287
0709 13:00:53.867105 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.867170 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.867211 (+    41us) raft_consensus.cc:1685] finished
0709 13:00:53.867300 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.867419 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39739,"prepare.queue_time_us":697108,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":318555,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":6921,"spinlock_wait_cycles":3316608,"thread_start_us":624447,"threads_started":3,"wal-append.queue_time_us":417383}
W20260709 13:00:53.868858  1509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.003s	sys 0.050s
I20260709 13:00:53.939100  5928 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:53.939669  1509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.003s	sys 0.050s
W20260709 13:00:53.939973  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 599899us
I20260709 13:00:53.941066  5928 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.712390  5891 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.913340  5930 raft_consensus.cc:697] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:53.941526  5904 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:53.942198  5930 consensus_queue.cc:237] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.942952  5891 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:53.835402  1542 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:53.944891  1542 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.945809  1542 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:53.880896  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 620024us
W20260709 13:00:53.884518  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 300829us
I20260709 13:00:53.889266  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:53.895192  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 883) took 1231 ms. Trace:
I20260709 13:00:53.951095  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:53.829428  5916 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.896167  5620 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:53.900682  5847 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:53.849714  5667 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.914148  5759 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:53.922412  5889 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:53.920351  5682 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.926980  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 881) took 1286 ms. Trace:
I20260709 13:00:53.929651  5938 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:53.929737  5905 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:53.930296  5925 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:53.920938  5907 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9.
I20260709 13:00:53.953940  1584 leader_election.cc:400] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12.
I20260709 13:00:53.987645  1584 leader_election.cc:403] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:00:53.886664  5882 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.961556  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2178) took 1036 ms. Trace:
I20260709 13:00:53.951468  1613 rpcz_store.cc:276] 0709 13:00:52.663587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.663698 (+   111us) service_pool.cc:224] Handling call
0709 13:00:52.665055 (+  1357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.665406 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.665440 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.665890 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.962884 (+296994us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:52.962924 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.962990 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.894993 (+932003us) raft_consensus.cc:1685] finished
0709 13:00:53.895014 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.895137 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83983,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":35163,"thread_start_us":296627,"threads_started":1,"wal-append.queue_time_us":624151}
I20260709 13:00:53.936589  5656 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:53.937434  5941 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.976521  1615 rpcz_store.cc:276] 0709 13:00:52.640678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.640826 (+   148us) service_pool.cc:224] Handling call
0709 13:00:52.641155 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.660943 (+ 19788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.660974 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.714381 (+ 53407us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.236314 (+521933us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:53.236389 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.236684 (+   295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.926740 (+690056us) raft_consensus.cc:1685] finished
0709 13:00:53.926764 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.926908 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19397,"raft.queue_time_us":79991,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4081,"thread_start_us":419485,"threads_started":1,"wal-append.queue_time_us":812501}
I20260709 13:00:53.980909  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:54.001698  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 69417.8us
I20260709 13:00:54.001937  1536 raft_consensus.cc:2410] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:00:53.981611  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 92403.7us
I20260709 13:00:54.002388  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:54.003368  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:54.004317  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:53.920658  5802 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:53.951660  1543 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:54.007615  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:54.008240  1543 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.937445  5875 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.983685  1617 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 13:00:53.974313  5759 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.989545  1690 raft_consensus.cc:2368] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7.
I20260709 13:00:54.007197  5880 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.990248  1540 rpcz_store.cc:276] 0709 13:00:52.924926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.925050 (+   124us) service_pool.cc:224] Handling call
0709 13:00:52.925374 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.261209 (+335835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.261253 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.261730 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.396391 (+134661us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:53.543744 (+147353us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.960936 (+417192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.961330 (+   394us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.961372 (+    42us) raft_consensus.cc:1685] finished
0709 13:00:53.961387 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.961502 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1910,"prepare.queue_time_us":171350,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":317024,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":40723,"thread_start_us":943578,"threads_started":4,"wal-append.queue_time_us":271855}
I20260709 13:00:53.974627  5836 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.999866  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:54.094344  1618 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.005707  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:53.983547  5936 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:53.976706  5889 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.102968  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.104104  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.105043  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.106158  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:53.985488  5631 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
W20260709 13:00:54.052140  5674 consensus_meta.cc:287] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.107s	user 0.013s	sys 0.008s
W20260709 13:00:54.112766  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 107102us
I20260709 13:00:54.080966  1617 pending_rounds.cc:85] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 8
I20260709 13:00:54.065122  4765 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:53.987360  5881 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:53.993762  5841 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 1.026s	user 0.018s	sys 0.003s
I20260709 13:00:54.095546  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.000958  5919 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:00:54.097328  5847 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.079990  5682 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:53.946547  5917 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.049582  1542 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:00:54.124406  1542 pending_rounds.cc:85] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 7
I20260709 13:00:54.124634  1542 pending_rounds.cc:107] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:00:54.124938  1542 raft_consensus.cc:2889] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.110594  1536 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:54.111544  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 61676.6us
I20260709 13:00:54.075073  5928 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:54.136689  5928 raft_consensus.cc:697] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:54.137583  5928 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.138440  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:54.138938  5904 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:00:54.139182  1689 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:54.140091  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.140101  5835 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:54.140605  1689 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:54.140894  5835 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:54.140780  5404 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:54.141222  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.141436  5835 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.142629  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.142836  5908 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:54.143249  1689 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:54.144407  5835 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:54.144884  5835 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.145241  5835 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.144379  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.113538  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:54.142649  1620 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:54.113698  1617 pending_rounds.cc:107] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:00:54.113894  4765 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.075642  5909 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.114758  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.078950  5873 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:54.011243  5620 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.155293  5907 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:54.155385  5620 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.155965  1536 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:00:54.157546  5620 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.011507  5891 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12.
I20260709 13:00:54.120458  1540 raft_consensus.cc:2393] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:54.121855  5674 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:53.987229  5905 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:53.989235  5925 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:54.158491  5891 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:54.074407  5916 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:53.985561  5938 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.160399  5674 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.133836  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 884) took 1403 ms. Trace:
I20260709 13:00:54.117384  5881 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:54.135499  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.168231  1613 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:54.135648  5877 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.147668  1689 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:00:54.149175  1617 raft_consensus.cc:2889] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.161755  1611 rpcz_store.cc:276] 0709 13:00:52.730193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.730328 (+   135us) service_pool.cc:224] Handling call
0709 13:00:52.730641 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.748883 (+ 18242us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:53.084117 (+335234us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.552383 (+468266us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.552821 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.552956 (+   135us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:53.552986 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.553044 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.133622 (+580578us) raft_consensus.cc:1685] finished
0709 13:00:54.133643 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.133785 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30023,"prepare.queue_time_us":507066,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":760,"raft.queue_time_us":405360,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":32123,"thread_start_us":592278,"threads_started":3,"wal-append.queue_time_us":900842}
I20260709 13:00:54.153379  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:54.085001  5942 consensus_queue.cc:1059] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:00:54.099957  1543 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:00:54.102029  5836 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.080806  5842 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:00:54.078769  5802 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:54.175602  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.015393  5941 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:54.101815  5880 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.172148  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:54.130309  5930 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.159993  5891 consensus_queue.cc:1048] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:54.173235  1618 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:54.129930  5796 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:54.154848  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.150907  5863 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:54.180246  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.170987  5881 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.159988  5925 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:54.233384  1613 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:54.236363  4765 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.255435  1613 pending_rounds.cc:85] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 4
I20260709 13:00:54.255740  1613 pending_rounds.cc:107] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:00:54.255978  1613 raft_consensus.cc:2889] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.256275  1613 pending_rounds.cc:107] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:00:54.256494  1613 raft_consensus.cc:2889] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.171659  5873 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:54.179369  5875 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.108311  5936 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.247602  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.179080  5882 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:54.265728  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 93645.6us
I20260709 13:00:54.124778  5841 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:54.156036  5907 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:00:54.236686  5942 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.268311  5860 consensus_meta.cc:287] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.004s
I20260709 13:00:54.294485  5953 raft_consensus.cc:3055] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:54.295012  5953 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:54.295917  5953 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.297415  5953 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.301503  1685 raft_consensus.cc:2368] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13.
I20260709 13:00:54.265285  5875 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:54.310595  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.278712  5835 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:54.288729  5404 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.239377  5930 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:54.279000  5949 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:54.168710  5909 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.291109  5928 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.361284  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.290340  5667 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:54.366452  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:54.367079  1613 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.370079  5802 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:54.371806  5937 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:00:54.319046  5875 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.375680  1613 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:54.376325  1620 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:54.379274  5947 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:00:54.380600  5944 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:00:54.381850  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 141799us
I20260709 13:00:54.281631  5796 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.314740  5942 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.267171  5863 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.323941  5938 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.391920  5593 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.394029  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.398478  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.399366  1541 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:54.324934  5835 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:54.402346  5946 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
W20260709 13:00:54.406198  5950 log.cc:927] Time spent T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:00:54.400224  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.412779  1541 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:54.361793  5404 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:54.418814  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 130751us
I20260709 13:00:54.421309  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1828) took 1582 ms. Trace:
I20260709 13:00:54.422098  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.423213  5889 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.425603  1611 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:54.425946  1611 pending_rounds.cc:85] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 4
I20260709 13:00:54.426148  1611 pending_rounds.cc:107] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:00:54.421656  1688 rpcz_store.cc:276] 0709 13:00:52.838878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.839164 (+   286us) service_pool.cc:224] Handling call
0709 13:00:52.839497 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.904997 (+1065500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.421097 (+516100us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400305054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:54.421260 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448884608}
I20260709 13:00:54.422633  1616 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:54.374440  5928 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:54.428773  5936 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:54.429003  5909 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.429863  5936 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:00:54.431268  5951 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:54.431712  5404 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.433048  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:54.433393  1611 raft_consensus.cc:2889] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.433642  1614 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.434597  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.438182  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1838) took 1005 ms. Trace:
I20260709 13:00:54.439816  5863 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.438529  1688 rpcz_store.cc:276] 0709 13:00:53.434792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.434393 (+999601us) service_pool.cc:224] Handling call
0709 13:00:54.438130 (+  3737us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.442848  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:54.444597  5942 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:54.446156  1584 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:54.446128  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 61072.4us
I20260709 13:00:54.448395  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:54.451565  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:54.453377  1660 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:54.383618  5873 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.426034  5905 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:54.461876  1613 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:54.414757  5835 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.463166  5682 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:54.464321  5835 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:54.464483  5404 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:54.465205  5404 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:54.465883  5928 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:54.466409  5863 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.466058  5404 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:54.458418  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:54.471750  1688 raft_consensus.cc:2376] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13. Re-sending same reply.
I20260709 13:00:54.472615  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:54.473686  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.474927  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.475569  1688 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:54.476620  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.460778  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:54.466850  5863 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.468461  5889 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.460292  5593 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:54.445451  5799 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.457628  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:54.455957  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:54.479516  1688 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 5.
I20260709 13:00:54.456907  5909 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.458791  5938 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:54.542363  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.543064  2274 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:54.539430  5930 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:54.524551  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.545359  1541 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:54.539896  1616 raft_consensus.cc:2368] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10.
I20260709 13:00:54.479666  5703 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.542354  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.546753  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:54.538981  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 83087.3us
I20260709 13:00:54.547884  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.461061  5836 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:54.519003  5865 consensus_meta.cc:287] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 13:00:54.533016  5881 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.513948  5593 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:54.550006  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.550215  5674 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:54.578859  2271 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:54.540445  5917 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.555297  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.485929  5905 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:54.458587  5952 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:00:54.559681  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.559798  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.459833  5942 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:00:54.563407  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.564996  1585 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:54.565857  5890 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.356s	user 0.000s	sys 0.002s
I20260709 13:00:54.546710  5841 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:54.566334  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:54.566918  1537 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:54.567865  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2636) took 1305 ms. Trace:
I20260709 13:00:54.569434  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2179) took 1644 ms. Trace:
W20260709 13:00:54.511579  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 62756.7us
I20260709 13:00:54.461530  5481 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:00:54.558784  1614 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:00:54.544585  5842 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:54.541409  5909 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:54.580662  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:54.583865  2268 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:54.578727  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.480003  5620 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:00:54.552738  5703 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:54.623839  5703 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.625406  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:54.626012  1620 raft_consensus.cc:2368] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11.
I20260709 13:00:54.626659  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.627122  1620 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:54.627699  5863 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.627799  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.628441  5930 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.628875  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:54.608964  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 44042us
I20260709 13:00:54.636161  1585 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:54.609320  1692 rpcz_store.cc:276] 0709 13:00:53.262235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.262370 (+   135us) service_pool.cc:224] Handling call
0709 13:00:54.567710 (+1305340us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b5400109fd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:54.567796 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103572352}
I20260709 13:00:54.612543  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.542793  5938 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:54.615021  1511 leader_election.cc:400] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10.
I20260709 13:00:54.640015  1511 leader_election.cc:403] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:00:54.614249  5799 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.617190  5963 consensus_queue.cc:1048] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:54.617821  5962 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:54.618904  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:54.647783  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.622509  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.647603  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.629312  5796 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.651580  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.630365  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.630584  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.633066  5881 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:54.634013  5903 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 1.413s	user 0.002s	sys 0.000s
I20260709 13:00:54.661592  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.542101  5953 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:54.581344  5593 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:54.650628  5759 consensus_meta.cc:287] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.002s
I20260709 13:00:54.637243  1660 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:54.639187  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.572417  5924 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.642076  1511 leader_election.cc:400] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11.
I20260709 13:00:54.682044  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:54.616215  5842 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.620431  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.584771  5905 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.609648  5880 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:54.652758  2269 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:54.658649  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.659314  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:54.705163  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.615842  5909 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.593680  5386 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.662088  1615 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:00:54.628878  5930 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.644758  5907 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.709878  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.710949  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.646940  5938 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.677131  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.594367  1538 rpcz_store.cc:276] 0709 13:00:52.925353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.925468 (+   115us) service_pool.cc:224] Handling call
0709 13:00:52.963974 (+ 38506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.111858 (+1147884us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:54.134458 (+ 22600us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.255181 (+120723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:54.255236 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:54.255284 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.569218 (+313934us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002c2254. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:54.569272 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.569384 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15822,"prepare.queue_time_us":22960,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":26612,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":18254,"spinlock_wait_cycles":2610849152,"thread_start_us":116629,"threads_started":1,"wal-append.queue_time_us":164521}
I20260709 13:00:54.678149  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.685847  5841 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.585994  5674 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.720947  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.646169  5863 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.684875  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.703123  1536 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:00:54.723067  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.723699  1536 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:54.724463  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.703533  2275 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEARNER]: Advancing to term 9
I20260709 13:00:54.659618  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.725322  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.726079  1692 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:54.705796  1585 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:54.708976  5887 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.426s	user 0.002s	sys 0.000s
I20260709 13:00:54.708801  5386 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.709451  5930 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.759636  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 879) took 2472 ms. Trace:
I20260709 13:00:54.760111  1612 rpcz_store.cc:276] 0709 13:00:52.277279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.277484 (+   205us) service_pool.cc:224] Handling call
0709 13:00:52.277891 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.723582 (+445691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.723620 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.735887 (+ 12267us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.222974 (+487087us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:53.223027 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.228472 (+  5445us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.633492 (+1405020us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:54.721175 (+ 87683us) raft_consensus.cc:1685] finished
0709 13:00:54.721200 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.749303 (+ 28103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9365,"raft.queue_time_us":360437,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":24253312,"thread_start_us":797020,"threads_started":2,"wal-append.queue_time_us":401210}
I20260709 13:00:54.711673  2269 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:54.712205  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:54.712355  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.715939  2271 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 6.
I20260709 13:00:54.649560  5620 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.717705  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.768318  2274 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:54.703763  5842 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.713477  5779 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.704025  5905 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.727176  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.774837  1536 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:00:54.775692  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.727437  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.746369  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.722052  1686 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:00:54.710266  5907 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.781064  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.703997  5865 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:54.741001  1616 raft_consensus.cc:2410] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:54.750784  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.695187  5759 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.757865  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:54.775974  5843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.530s	user 0.012s	sys 0.019s
I20260709 13:00:54.792667  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:54.792819  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:54.793224  1692 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:54.751328  5883 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.529s	user 0.010s	sys 0.008s
I20260709 13:00:54.703215  5924 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:54.773413  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.798780  2277 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:00:54.802589  1688 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.784334  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.787387  1538 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:54.788878  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.763087  5621 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:54.764204  2270 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:00:54.808617  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:54.814935  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 182043us
W20260709 13:00:54.795142  5843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.550s	user 0.012s	sys 0.019s
I20260709 13:00:54.815418  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.822144  2271 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
W20260709 13:00:54.795049  5883 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.609s	user 0.011s	sys 0.008s
I20260709 13:00:54.816229  2275 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:54.788249  5907 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.768546  5928 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:00:54.817673  1659 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:54.811892  5925 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:54.917430  1612 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:54.820966  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.815938  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:54.827375  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.923187  2271 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:00:54.831898  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.832046  5674 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.833510  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.836500  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2176) took 1913 ms. Trace:
I20260709 13:00:54.840495  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:54.938128  1537 rpcz_store.cc:276] 0709 13:00:52.922951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.923067 (+   116us) service_pool.cc:224] Handling call
0709 13:00:52.923374 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.585710 (+1662336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.836232 (+250522us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54001b7454. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:54.836428 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3778710784}
I20260709 13:00:54.840673  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.939425  1611 raft_consensus.cc:2410] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:54.939563  2273 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:54.845335  5872 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:54.848659  5776 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.853560  5620 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10.
I20260709 13:00:54.855726  1692 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
W20260709 13:00:54.859205  5964 log.cc:927] Time spent T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:00:54.871165  5960 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:00:54.780495  5779 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:54.881321  5386 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:54.799636  5796 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:54.900421  5882 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.900285  5703 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.763260  5863 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:54.911676  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:54.907495  2275 pending_rounds.cc:85] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 4
I20260709 13:00:54.818993  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.970412  1538 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:54.970614  2275 pending_rounds.cc:107] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:00:54.970944  2275 raft_consensus.cc:2889] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.971269  2275 pending_rounds.cc:107] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:00:54.971570  2275 raft_consensus.cc:2889] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.949245  5872 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:54.938035  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 120416us
I20260709 13:00:54.942014  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2641) took 1635 ms. Trace:
I20260709 13:00:54.946549  1611 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:00:54.823485  5621 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:54.952800  5966 raft_consensus.cc:2764] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:54.953997  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.981920  2271 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:54.958710  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:54.982352  1611 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:54.982954  1692 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:54.983803  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.984407  1692 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:54.984778  1611 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:54.985194  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:54.964705  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:54.966653  1658 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:40935, user_credentials={real_user=slave}} blocked reactor thread for 153935us
I20260709 13:00:54.925942  1691 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:54.975813  1686 rpcz_store.cc:276] 0709 13:00:53.306453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.833194 (+1526741us) service_pool.cc:224] Handling call
0709 13:00:54.941946 (+108752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.987000  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:54.988471  1538 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:54.979089  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:54.992151  1544 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:00:54.992491  1544 pending_rounds.cc:85] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 10
I20260709 13:00:54.992698  1544 pending_rounds.cc:107] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:00:54.992915  1544 raft_consensus.cc:2889] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.993134  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:54.993515  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2165) took 3509 ms (client timeout 2116 ms). Trace:
I20260709 13:00:54.993767  1692 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:54.976824  5875 consensus_meta.cc:287] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.004s
W20260709 13:00:54.993846  1539 rpcz_store.cc:269] 0709 13:00:51.471715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.704610 (+232895us) service_pool.cc:224] Handling call
0709 13:00:54.981124 (+3276514us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002107d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:54.981253 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889039104}
I20260709 13:00:55.000878  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:55.001350  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:54.995980  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.002143  1691 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:54.976147  5872 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:54.970036  5882 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.004087  1538 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:00:54.997159  5909 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.004844  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.007799  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.009131  2270 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:55.009922  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:55.010991  1539 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:55.010953  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:55.013213  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.012328  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:55.013913  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 301706us
W20260709 13:00:55.018251  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.006949  5843 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.027469  1687 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:54.991132  5796 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:55.027869  2273 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:55.034598  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2645) took 1088 ms. Trace:
I20260709 13:00:55.034945  1687 rpcz_store.cc:276] 0709 13:00:53.945716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.025602 (+1079886us) service_pool.cc:224] Handling call
0709 13:00:55.027318 (+  1716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.034356 (+  7038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.034550 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:55.036209  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.036887  1687 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:55.037917  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.040313  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.032274  2271 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:55.031189  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:55.012887  5846 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.188s	user 0.008s	sys 0.020s
W20260709 13:00:55.045644  5846 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.230s	user 0.008s	sys 0.020s
I20260709 13:00:55.046494  1687 raft_consensus.cc:2410] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:00:55.048523  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.052930  5779 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.055729  5863 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.056334  5703 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.056993  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.057785  2273 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 6: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:55.060087  5759 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:55.059968  5842 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:55.061009  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.062219  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.016848  5865 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:55.049286  1687 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:54.994474  5386 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:00:55.073932  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1837) took 1125 ms. Trace:
I20260709 13:00:55.073326  1692 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:55.075448  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2642) took 1130 ms. Trace:
I20260709 13:00:55.076050  1692 rpcz_store.cc:276] 0709 13:00:53.945022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.027767 (+1082745us) service_pool.cc:224] Handling call
0709 13:00:55.073034 (+ 45267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.075202 (+  2168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.075397 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:55.062394  5842 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:55.006546  5875 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:55.050144  5674 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:55.066422  5873 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:55.104336  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:55.182741  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 95381.5us
I20260709 13:00:55.143800  5877 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:55.229036  5926 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:55.075091  1545 rpcz_store.cc:276] 0709 13:00:53.948738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.948902 (+   164us) service_pool.cc:224] Handling call
0709 13:00:53.949209 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:53.949526 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.949552 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:53.970768 (+ 21216us) log.cc:844] Serialized 52 byte log entry
0709 13:00:54.779777 (+809009us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b1800040d20. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb9450d1 00007f29ebd60a0f
0709 13:00:54.956639 (+176862us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:54.956711 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.957135 (+   424us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.065886 (+108751us) raft_consensus.cc:1685] finished
0709 13:00:55.065910 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.073809 (+  7899us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8440,"raft.queue_time_us":29346,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":14045,"spinlock_wait_cycles":4469120,"thread_start_us":176679,"threads_started":1,"wal-append.queue_time_us":1069655}
W20260709 13:00:55.204928  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 173830us
I20260709 13:00:55.172799  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:55.153934  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.289115  5835 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.214334  1688 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:55.285686  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.289512  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:55.110569  1692 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:55.289609  5835 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.290443  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2647) took 1343 ms. Trace:
I20260709 13:00:55.290795  1692 rpcz_store.cc:276] 0709 13:00:53.946772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.077150 (+1130378us) service_pool.cc:224] Handling call
0709 13:00:55.110174 (+ 33024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.290229 (+180055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.290393 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:55.291167  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:55.291706  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.192390  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:55.285981  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 208396us
I20260709 13:00:55.291909  5851 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:55.291966  5835 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.292258  1618 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:55.292510  5851 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:55.292523  5962 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:55.293076  5851 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.293111  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.294251  1545 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:55.067390  5843 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.294939  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:55.235947  5841 consensus_meta.cc:287] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 13:00:55.295315  1692 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 6.
I20260709 13:00:55.303705  5909 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.304266  5909 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:55.304447  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:55.304836  5909 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.305929  1692 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:55.306512  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 793) took 1300 ms. Trace:
I20260709 13:00:55.307020  1692 rpcz_store.cc:276] 0709 13:00:54.005773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.305394 (+1299621us) service_pool.cc:224] Handling call
0709 13:00:55.305778 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.306317 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.306467 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:55.307919  2241 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:55.069168  5796 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.286216  5873 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.191094  5928 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:55.328281  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.293251  5962 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:55.310392  5938 consensus_meta.cc:287] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.568s	user 0.003s	sys 0.008s
I20260709 13:00:55.282874  5674 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.282299  5877 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 13:00:55.300446  5593 consensus_meta.cc:287] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.005s
I20260709 13:00:55.348322  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:55.352298  5889 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.344882  5873 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.379845  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2653) took 1007 ms. Trace:
I20260709 13:00:55.380388  1692 rpcz_store.cc:276] 0709 13:00:54.372254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.355783 (+983529us) service_pool.cc:224] Handling call
0709 13:00:55.379266 (+ 23483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.379515 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.379539 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.379585 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:55.379615 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.379665 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.379793 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:55.355875  2272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45390 (request call id 1092) took 2593 ms (client timeout 1798 ms). Trace:
I20260709 13:00:55.240700  5865 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:55.385946  2272 rpcz_store.cc:269] 0709 13:00:52.751789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.752750 (+   961us) service_pool.cc:224] Handling call
0709 13:00:55.345108 (+2592358us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b5400203854. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:55.345199 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144800512}
I20260709 13:00:55.109459  5621 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.171442  5891 consensus_queue.cc:1059] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.170s
I20260709 13:00:55.346648  5836 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:55.387436  5836 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.387868  5836 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:55.301291  5977 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:55.320920  5841 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:55.356978  5962 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:55.346985  5928 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:55.400907  5836 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:55.408977  5972 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
W20260709 13:00:55.380095  5974 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
W20260709 13:00:55.409323  1431 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.444s	user 0.021s	sys 0.016s
I20260709 13:00:55.445499  1691 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 6.
I20260709 13:00:55.361032  5938 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.366204  5593 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.435500  5928 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:55.458658  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.382256  5848 consensus_queue.cc:1059] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:00:55.428963  5977 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:55.457687  5843 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:55.485747  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1829) took 2646 ms (client timeout 2243 ms). Trace:
W20260709 13:00:55.486478  5993 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:55.485831  1692 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:55.459614  5981 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:00:55.488132  1690 rpcz_store.cc:269] 0709 13:00:52.839207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.842999 (+  3792us) service_pool.cc:224] Handling call
0709 13:00:55.485497 (+2642498us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001ac7d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:55.485660 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583352704}
I20260709 13:00:55.521697  1690 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:55.490962  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:55.507231  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2204) took 1346 ms. Trace:
W20260709 13:00:55.511399  5799 consensus_meta.cc:287] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.861s	user 0.008s	sys 0.002s
I20260709 13:00:55.512943  5674 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:55.513231  5905 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.724s	user 0.004s	sys 0.005s
I20260709 13:00:55.540299  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2646) took 1594 ms. Trace:
I20260709 13:00:55.515543  5882 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:55.517572  5979 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:00:55.523838  1536 rpcz_store.cc:276] 0709 13:00:54.161291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.819685 (+658394us) service_pool.cc:224] Handling call
0709 13:00:54.820086 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.081977 (+261891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.081994 (+    17us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.082234 (+   240us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.361593 (+279359us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:55.361674 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.361821 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.507007 (+145186us) raft_consensus.cc:1685] finished
0709 13:00:55.507027 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.507168 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81579,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":438958,"threads_started":2,"wal-append.queue_time_us":366971}
I20260709 13:00:55.543439  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2653) took 1108 ms. Trace:
I20260709 13:00:55.533775  1690 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:55.538537  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.550367  2272 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:00:55.540853  1686 rpcz_store.cc:276] 0709 13:00:53.946146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.063096 (+1116950us) service_pool.cc:224] Handling call
0709 13:00:55.063431 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.063798 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.063840 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.064386 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.151866 (+ 87480us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:55.151912 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.151985 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.540110 (+388125us) raft_consensus.cc:1685] finished
0709 13:00:55.540129 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.540247 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2299,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":32591,"thread_start_us":87093,"threads_started":1,"wal-append.queue_time_us":442558}
I20260709 13:00:55.449952  5873 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:55.552847  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2650) took 1600 ms. Trace:
I20260709 13:00:55.555054  1687 rpcz_store.cc:276] 0709 13:00:53.952611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.077252 (+1124641us) service_pool.cc:224] Handling call
0709 13:00:55.077584 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.077818 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.077853 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.101868 (+ 24015us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.341313 (+239445us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:55.341362 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.341426 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.552633 (+211207us) raft_consensus.cc:1685] finished
0709 13:00:55.552653 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.552776 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":239136,"threads_started":1,"wal-append.queue_time_us":355762}
I20260709 13:00:55.557471  1687 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:55.554160  1536 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:55.549711  1611 rpcz_store.cc:276] 0709 13:00:54.434773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.985631 (+550858us) service_pool.cc:224] Handling call
0709 13:00:55.018141 (+ 32510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.081058 (+ 62917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.081078 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.136651 (+ 55573us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.382628 (+245977us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:55.382685 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.382799 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.543239 (+160440us) raft_consensus.cc:1685] finished
0709 13:00:55.543258 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.543387 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33894,"raft.queue_time_us":138270,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":188766,"threads_started":1,"wal-append.queue_time_us":356712}
I20260709 13:00:55.559276  1536 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:00:55.549965  5930 consensus_meta.cc:287] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.001s
I20260709 13:00:55.542577  5875 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.561393  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.551672  5799 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:55.565414  5846 consensus_queue.cc:1059] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:55.565840  5977 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:55.566808  5776 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.000s
W20260709 13:00:55.567190  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 2205) took 1392 ms (client timeout 1592 ms). Trace:
I20260709 13:00:55.568956  1618 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:00:55.569365  5873 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.560209  1536 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:55.569885  2273 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:55.584972  1536 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.571153  5593 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:55.571624  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1831) took 2731 ms (client timeout 2226 ms). Trace:
I20260709 13:00:55.576009  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.587247  1611 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:55.576043  2271 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:55.576678  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.588124  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:55.584057  1617 rpcz_store.cc:269] 0709 13:00:54.175284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.175397 (+   113us) service_pool.cc:224] Handling call
0709 13:00:55.567021 (+1391624us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54002170d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:55.567136 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951495552}
I20260709 13:00:55.589624  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.578873  5992 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:55.588873  1611 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:55.591672  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.592242  1611 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
W20260709 13:00:55.586921  1685 rpcz_store.cc:269] 0709 13:00:52.839836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.839954 (+   118us) service_pool.cc:224] Handling call
0709 13:00:55.571455 (+2731501us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400021f54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:55.571569 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3270788480}
I20260709 13:00:55.607828  1617 raft_consensus.cc:2410] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:55.548950  5848 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:55.574885  5796 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.549676  5905 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.540057  5981 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.633576  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.633499  5842 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.561277  5845 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:00:55.642171  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.591599  5879 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.640528  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2641) took 1217 ms. Trace:
I20260709 13:00:55.586593  5835 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:00:55.647214  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.647821  1536 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:55.648165  1536 pending_rounds.cc:85] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 5
I20260709 13:00:55.648366  1536 pending_rounds.cc:107] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:00:55.648558  1536 raft_consensus.cc:2889] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.648809  1536 pending_rounds.cc:107] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:00:55.649035  1536 raft_consensus.cc:2889] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.650601  5892 raft_consensus.cc:3055] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:55.651105  5892 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:55.652158  5892 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.653445  5892 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:55.654717  5905 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.656145  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2211) took 1241 ms. Trace:
I20260709 13:00:55.656626  1613 rpcz_store.cc:276] 0709 13:00:54.415295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.415534 (+   239us) service_pool.cc:224] Handling call
0709 13:00:54.415847 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.462302 (+ 46455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.655838 (+1193536us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b54001126d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:55.656074 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93008768}
I20260709 13:00:55.658633  5882 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.659607  1612 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:00:55.661943  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2645) took 1237 ms. Trace:
I20260709 13:00:55.663983  5842 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.666043  5842 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.669539  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.669840  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.670259  1611 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:55.670516  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.662359  1612 rpcz_store.cc:276] 0709 13:00:54.424122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.942220 (+518098us) service_pool.cc:224] Handling call
0709 13:00:55.659305 (+717085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.660094 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.661715 (+  1621us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54001126d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:55.661876 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613433600}
I20260709 13:00:55.672169  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:55.645961  1616 rpcz_store.cc:276] 0709 13:00:54.423211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.817026 (+393815us) service_pool.cc:224] Handling call
0709 13:00:54.834367 (+ 17341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.842475 (+  8108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.842523 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.847225 (+  4702us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.028336 (+181111us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:55.028378 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.028468 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.517331 (+488863us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b24000f8738. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8b3e9c4 00007f29e8b3cacb 00007f29e8cf7dc9 00007f29e8cf7a55 00007f29e8cf709d 00007f29eb92910e 00007f29eb94088c 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221
0709 13:00:55.632802 (+115471us) raft_consensus.cc:1685] finished
0709 13:00:55.632821 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.640468 (+  7647us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39083,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":5816064,"thread_start_us":180571,"threads_started":1,"wal-append.queue_time_us":261987}
I20260709 13:00:55.670761  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.673171  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:55.678078  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.678861  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:55.679633  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:55.688633  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.689671  1584 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:55.690593  1615 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:55.581717  5930 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:55.591274  5992 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.694571  1509 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:55.695226  1620 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:55.696291  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.696494  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.697113  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:55.677778  5907 consensus_meta.cc:287] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.000s
I20260709 13:00:55.643573  5877 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.702955  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:55.714908  2271 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:55.680526  5882 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.680542  5836 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.667202  5835 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:55.703261  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.710489  5799 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:55.693954  5905 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:55.721114  5889 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.721627  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:55.722043  5987 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.184s	user 0.001s	sys 0.001s
I20260709 13:00:55.714370  5985 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:55.710513  5875 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.714702  5865 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:55.725783  1613 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:55.726969  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.686903  5796 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.705546  1509 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.729489  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.737933  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.741140  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:55.736218  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.728655  2271 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:00:55.742666  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:55.704644  5938 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.680758  5879 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.730628  5799 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:55.743927  5865 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.736971  5593 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:55.745457  5991 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:55.745920  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.746155  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.746434  5930 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.745457  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.747057  1613 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:00:55.744856  5875 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:55.750039  5962 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.750876  5882 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:55.750818  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:55.751369  5796 consensus_queue.cc:1059] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:55.734566  5905 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:55.774893  1611 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:00:55.753224  5872 consensus_meta.cc:287] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.003s
I20260709 13:00:55.754576  5784 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:55.755257  5860 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:55.755815  5877 consensus_queue.cc:1059] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:55.756633  5776 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:55.746351  5992 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.758571  5977 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:55.714532  5873 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:55.772234  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.767935  5593 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:55.727782  5907 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:55.774302  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.774089  5875 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:55.821012  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.821925  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.752174  5851 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.752266  5985 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:55.730170  5966 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:00:55.781543  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2633) took 3743 ms. Trace:
I20260709 13:00:55.767694  5799 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:55.774103  5876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.561s	user 0.012s	sys 0.019s
I20260709 13:00:55.789579  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:55.791147  2272 raft_consensus.cc:2393] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:00:55.822546  1510 connection.cc:256] RPC call timeout handler was delayed by -1.4793306020000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
I20260709 13:00:55.771289  2273 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:00:55.773960  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.775926  5905 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:55.810987  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:55.774986  1431 maintenance_manager.cc:643] P 0c5fc33855324cbf8fc0fd695f8cc99b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.944s	user 0.192s	sys 0.093s Metrics: {"bytes_written":30828,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":538161,"dirs.run_cpu_time_us":503,"dirs.run_wall_time_us":63622,"drs_written":1,"lbm_read_time_us":6346,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":265229,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":362090,"threads_started":2,"update_count":34,"wal-append.queue_time_us":405040}
W20260709 13:00:55.814543  2241 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Timed out: RequestConsensusVote RPC to 127.0.107.193:42041 timed out after 1.807s (SENT)
W20260709 13:00:55.830531  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 116668us
I20260709 13:00:55.774466  5882 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.835451  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1852) took 1354 ms. Trace:
I20260709 13:00:55.835295  1693 rpcz_store.cc:276] 0709 13:00:52.033426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.033651 (+   225us) service_pool.cc:224] Handling call
0709 13:00:52.045679 (+ 12028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.229357 (+1183678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.776164 (+2546807us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002e4ad4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:55.776311 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2677823872}
I20260709 13:00:55.816805  5593 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.769241  5865 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:55.840802  1685 raft_consensus.cc:2376] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9. Re-sending same reply.
I20260709 13:00:55.779114  5860 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.779556  5872 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:55.841233  1510 connection.cc:256] RPC call timeout handler was delayed by -1.3020306020000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 13:00:55.864157  1510 connection.cc:256] RPC call timeout handler was delayed by -1.0401795040000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2336s for a response
I20260709 13:00:55.866135  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:55.792603  5776 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:55.869315  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:55.846487  6009 consensus_queue.cc:1059] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:55.842068  2241 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:55.844118  1615 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:55.844507  1538 rpcz_store.cc:276] 0709 13:00:54.481001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.009090 (+528089us) service_pool.cc:224] Handling call
0709 13:00:55.027318 (+ 18228us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:55.049820 (+ 22502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.049855 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:55.053684 (+  3829us) log.cc:844] Serialized 52 byte log entry
0709 13:00:55.287492 (+233808us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:55.287538 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.287624 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.835257 (+547633us) raft_consensus.cc:1685] finished
0709 13:00:55.835274 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.835399 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":218,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":33036,"thread_start_us":232705,"threads_started":1,"wal-append.queue_time_us":415564}
W20260709 13:00:55.849514  6005 log.cc:927] Time spent T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:00:55.854144  5879 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.854736  5882 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:55.871738  6017 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:55.872486  1545 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:00:55.872820  1545 pending_rounds.cc:85] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 8
I20260709 13:00:55.839327  5848 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.873036  1545 pending_rounds.cc:107] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:55.873339  1545 raft_consensus.cc:2889] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.873389  5848 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.855461  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:55.840552  5876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.628s	user 0.012s	sys 0.020s
I20260709 13:00:55.875360  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:55.875908  2271 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:55.876159  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 61631.1us
I20260709 13:00:55.868034  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:55.877027  1543 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:55.878475  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:55.841346  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 80094.5us
I20260709 13:00:55.881127  1613 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:55.881971  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.862608  1432 maintenance_manager.cc:419] P 0c5fc33855324cbf8fc0fd695f8cc99b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11045 bytes on disk
I20260709 13:00:55.888155  2273 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:55.862953  5949 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.863802  5860 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:55.894631  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.782413  5835 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.898249  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:55.893126  5941 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.903522  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:55.863421  5981 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:55.897007  5839 consensus_queue.cc:1059] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:00:55.910348  6017 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:55.910694  6017 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:55.907155  1431 maintenance_manager.cc:643] P 0c5fc33855324cbf8fc0fd695f8cc99b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.004s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":272,"lbm_reads_lt_1ms":4}
I20260709 13:00:55.911464  6017 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.913827  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:55.914549  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:55.916887  1613 raft_consensus.cc:2410] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:55.917428  2271 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:55.919035  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.920085  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.921383  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.922389  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.930442  1545 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
W20260709 13:00:55.936403  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.926060  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:55.919497  5865 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.937899  1613 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:55.940407  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:55.942242  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:55.942759  1545 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:55.944954  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 99061.7us
I20260709 13:00:55.945796  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:55.950601  1509 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:55.922606  5593 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:55.953979  5909 consensus_meta.cc:287] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.000s
I20260709 13:00:55.955608  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.958312  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:55.922379  5799 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:55.968514  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:55.971017  1536 raft_consensus.cc:2368] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7.
I20260709 13:00:55.974350  1537 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:55.971678  1685 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:55.958854  5851 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.971819  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:55.977600  1545 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:55.937999  5776 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:55.987255  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:55.988068  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:55.969753  6009 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.992378  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:55.992805  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:55.989730  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:55.998165  1545 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:55.999691  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 112669us
I20260709 13:00:55.925381  5949 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.001091  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:55.973191  5848 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:55.994041  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:55.975028  5909 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:56.003703  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:56.008023  1538 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:56.003913  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:55.969532  5703 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:00:55.984562  5981 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:56.006381  1545 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:00:56.008935  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:56.009050  5962 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:56.006533  5985 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.958474  5928 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.006474  6012 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:56.011173  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:56.001876  5941 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:56.017819  5865 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.028685  1538 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:56.044836  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:56.029218  1545 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:00:56.061108  1510 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:56.026952  1693 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:56.048231  1617 raft_consensus.cc:2410] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:00:56.028329  1659 leader_election.cc:336] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.945s (SENT)
I20260709 13:00:56.024703  5799 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:56.057148  6018 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:56.023682  5593 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:56.058320  5981 raft_consensus.cc:697] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:56.047216  1537 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:56.067544  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:56.027545  6009 consensus_queue.cc:1059] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:00:56.069788  5784 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:56.070827  5941 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:56.028070  5907 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.072716  5875 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.104089  5941 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.105155  5875 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:56.073874  6008 log.cc:927] Time spent T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:00:56.075728  5796 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:56.042860  6012 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.107334  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 802) took 1024 ms. Trace:
I20260709 13:00:56.107061  5981 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.107801  5949 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:56.022619  5905 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.108601  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:56.107699  1690 rpcz_store.cc:276] 0709 13:00:55.082609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.551970 (+469361us) service_pool.cc:224] Handling call
0709 13:00:55.552246 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.552568 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.552597 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.557316 (+  4719us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.736352 (+179036us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:55.772914 (+ 36562us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.773966 (+  1052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.774032 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.856306 (+ 82274us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b180028b640. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:56.073394 (+217088us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:56.107142 (+ 33748us) raft_consensus.cc:1685] finished
0709 13:00:56.107163 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.107281 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10930,"prepare.queue_time_us":37165,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2576,"raft.queue_time_us":1254,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":6525,"spinlock_wait_cycles":33280128,"thread_start_us":103065,"threads_started":1,"wal-append.queue_time_us":243558}
I20260709 13:00:56.109172  2271 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:56.077039  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:56.109920  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:56.110080  5905 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:56.110291  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:56.026654  5882 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.111200  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:56.111382  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:56.112655  1612 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:56.032248  5985 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.113251  2272 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:56.102465  5803 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 13:00:56.077832  5986 log.cc:927] Time spent T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.518s	user 0.001s	sys 0.000s
I20260709 13:00:56.114332  5985 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.079473  5879 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:56.107709  6012 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:56.107095  5796 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:56.116065  5872 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:56.116515  5796 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.103413  5865 consensus_queue.cc:1059] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:00:56.119400  5674 raft_consensus.cc:3055] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:56.119758  5674 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:56.097343  5671 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:56.120342  5671 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:56.120483  5674 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.121184  5671 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.112679  5882 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:56.124696  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2644) took 2179 ms (client timeout 2178 ms). Trace:
W20260709 13:00:56.125069  1688 rpcz_store.cc:269] 0709 13:00:53.945507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.618707 (+673200us) service_pool.cc:224] Handling call
0709 13:00:56.124526 (+1505819us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400125054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:56.124637 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348282624}
I20260709 13:00:56.128568  5928 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.128669  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1855) took 1669 ms. Trace:
I20260709 13:00:56.129204  1691 rpcz_store.cc:276] 0709 13:00:54.459501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.012118 (+552617us) service_pool.cc:224] Handling call
0709 13:00:56.128527 (+1116409us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400161054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:56.128615 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990229376}
I20260709 13:00:56.129315  5928 consensus_queue.cc:1059] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:56.132617  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:56.133311  1542 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:56.134011  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:56.134591  1542 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 16: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:56.135248  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:56.135785  6007 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:00:56.136113  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:56.137107  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:56.137389  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 806) took 1038 ms. Trace:
I20260709 13:00:56.137766  1687 rpcz_store.cc:276] 0709 13:00:55.099162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.558444 (+459282us) service_pool.cc:224] Handling call
0709 13:00:55.561962 (+  3518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.569935 (+  7973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.569966 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.570454 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.764306 (+193852us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:55.764358 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.764454 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.135232 (+370778us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:56.137125 (+  1893us) raft_consensus.cc:1685] finished
0709 13:00:56.137145 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.137336 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11696,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":6906240,"thread_start_us":193486,"threads_started":1,"wal-append.queue_time_us":208356}
I20260709 13:00:56.110469  2271 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:56.091423  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:56.093111  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:56.093230  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:56.094530  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:56.102602  5593 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:00:56.077966  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:56.100734  5860 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.144157  1540 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:56.145641  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.121606  5674 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.141263  1545 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.092324  1510 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.142103  1658 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.143116  2274 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:56.149578  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 57319.4us
I20260709 13:00:56.150352  1510 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:56.147024  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 55669.5us
I20260709 13:00:56.151348  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:56.154801  1659 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:56.163740  1510 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.107275  5925 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:00:56.171114  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.172987  1545 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:56.174460  1545 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:56.176110  1545 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:56.182430  1537 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:56.180088  1510 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.184568  1510 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:56.186409  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:56.186996  2273 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:00:56.188920  6014 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:56.189754  6014 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.190192  6014 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:56.196213  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.200788  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 46047.9us
I20260709 13:00:56.203069  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:56.203841  2273 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:56.210301  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:56.210892  2273 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.211982  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:56.214223  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:56.153862  5919 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:56.217401  5919 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:56.167928  5966 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:56.162899  6009 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:56.177526  5872 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:56.196067  5722 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:56.178351  5925 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:56.328154  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.280237  2273 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:00:56.181044  5893 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:56.352787  1540 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:56.205749  5784 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:56.194954  5909 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:56.363106  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 148941us
I20260709 13:00:56.364035  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:56.195801  5865 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:56.355815  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 167650us
I20260709 13:00:56.219851  5919 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:56.178196  5703 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:00:56.367224  5892 consensus_meta.cc:287] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.004s
I20260709 13:00:56.205356  5879 consensus_queue.cc:1059] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.154s
I20260709 13:00:56.387499  5879 raft_consensus.cc:3055] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:56.387842  5879 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:56.388531  5879 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.389726  5879 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.224114  5966 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:56.382676  6017 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:56.220571  5852 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
W20260709 13:00:56.361016  6026 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 13:00:56.403586  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:56.361265  5784 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.391382  1443 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 12, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.359076  5841 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:00:56.400959  5919 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.371035  5859 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:56.361411  6009 raft_consensus.cc:697] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:56.408107  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:56.397074  5966 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.424530  1538 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:56.426295  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:56.371261  5909 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.417589  5784 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.378506  5962 consensus_queue.cc:1059] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:00:56.429119  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:56.429462  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.435285  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:56.436481  1538 raft_consensus.cc:2376] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10. Re-sending same reply.
I20260709 13:00:56.437126  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:56.437839  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:56.438153  1538 raft_consensus.cc:2376] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10. Re-sending same reply.
I20260709 13:00:56.431969  5919 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.438616  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:56.439774  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:56.440291  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:56.437384  2241 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:56.432772  5848 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:56.447161  2241 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.402755  6028 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:00:56.452368  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.455590  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:56.456795  1612 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:56.458276  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:56.461370  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:56.462791  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:56.466377  1614 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:56.469522  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:56.439419  5860 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.480749  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 892) took 2527 ms. Trace:
I20260709 13:00:56.482043  5883 raft_consensus.cc:3055] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:56.434731  5839 consensus_queue.cc:1059] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:56.485266  1619 rpcz_store.cc:276] 0709 13:00:53.953311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.953770 (+   459us) service_pool.cc:224] Handling call
0709 13:00:53.978141 (+ 24371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.161566 (+183425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.161594 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:54.161632 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:54.161668 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.480555 (+2318887us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400068e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:56.480597 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.480698 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421387008}
I20260709 13:00:56.451642  5892 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:56.449292  5852 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:56.488060  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:56.512068  1619 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:56.486578  5883 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:56.484411  5593 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:00:56.523291  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 318700us
I20260709 13:00:56.525724  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:56.510887  5941 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.530741  1619 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:56.535322  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:56.539048  6035 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:00:56.542382  5883 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.546783  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:56.547932  5883 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:56.561376  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.549929  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:56.583957  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:56.536598  5941 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.551017  5839 raft_consensus.cc:3055] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:56.591132  5636 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:56.592065  5992 raft_consensus.cc:3055] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:56.593750  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:56.606351  1614 raft_consensus.cc:2376] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10. Re-sending same reply.
I20260709 13:00:56.596017  1659 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:56.597100  6014 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.552763  5942 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:56.598898  6012 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.551718  6045 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:56.599411  5847 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.488010  6009 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.594209  5966 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.533686  5593 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.588256  5688 raft_consensus.cc:2764] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:00:56.588552  5840 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:56.600833  5839 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:00:56.654173  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 285306us
I20260709 13:00:56.567512  5921 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:00:56.646517  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 50594us
I20260709 13:00:56.605754  6023 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.606012  5992 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:56.650570  1542 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:56.611428  5848 raft_consensus.cc:697] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:56.647146  5841 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:56.672550  5841 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:56.687705  5841 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.700631  5848 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.702004  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2212) took 1935 ms. Trace:
I20260709 13:00:56.702389  1541 rpcz_store.cc:276] 0709 13:00:54.767078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.790882 (+ 23804us) service_pool.cc:224] Handling call
0709 13:00:56.701843 (+1910961us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b540009f454. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:56.701957 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778995072}
I20260709 13:00:56.706590  5841 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.707474  5924 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:56.708916  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 52722.8us
I20260709 13:00:56.710469  5898 consensus_queue.cc:1059] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:56.711266  5898 raft_consensus.cc:3055] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:56.711555  5898 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:56.712311  5898 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.713290  5898 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.709920  1659 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:56.716416  1685 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:56.717155  1694 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:56.717415  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.718317  1691 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:56.725114  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:56.725771  1687 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:56.741868  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 231362us
W20260709 13:00:56.795652  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 51556.4us
W20260709 13:00:56.794399  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 78082.6us
W20260709 13:00:56.714970  5674 consensus_meta.cc:287] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
W20260709 13:00:56.799786  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 84067.7us
I20260709 13:00:56.800642  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:56.803344  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:56.806694  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.808030  6032 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.809556  5638 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:56.809933  5638 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:56.810815  5638 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.811288  5941 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:56.811954  5638 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.812592  6034 raft_consensus.cc:3055] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:56.812958  6034 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:56.813664  6034 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.817730  5992 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.818847  5992 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:56.819433  6036 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.281s	user 0.000s	sys 0.002s
I20260709 13:00:56.823988  5966 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.824298  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:56.825359  5593 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.825620  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:56.804392  6011 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:56.827195  2273 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:56.826957  6011 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:56.828907  6011 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:56.799479  5784 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.831769  1540 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:00:56.832634  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2658) took 2189 ms. Trace:
I20260709 13:00:56.832847  5784 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.837399  5925 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:56.838406  5925 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:56.825369  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:56.839891  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.840772  6015 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.850s	user 0.002s	sys 0.000s
I20260709 13:00:56.840363  1443 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:56.824011  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2174) took 3902 ms. Trace:
W20260709 13:00:56.841614  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2655) took 2406 ms (client timeout 2203 ms). Trace:
W20260709 13:00:56.864056  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 57423.2us
I20260709 13:00:56.842706  1615 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:56.867018  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.851388  6012 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.666077  6023 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:56.853964  2276 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:56.854127  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.793114  6037 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:00:56.832970  1618 rpcz_store.cc:276] 0709 13:00:54.643711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.355282 (+711571us) service_pool.cc:224] Handling call
0709 13:00:55.355599 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.584614 (+229015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.832404 (+1247790us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54001400d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:56.832580 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490086272}
I20260709 13:00:56.855968  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:56.859102  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.851002  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:56.863672  1544 rpcz_store.cc:276] 0709 13:00:52.921701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.921837 (+   136us) service_pool.cc:224] Handling call
0709 13:00:54.981346 (+2059509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.993261 (+ 11915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.823083 (+1829822us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b54002107d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:56.823804 (+   721us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54002107d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:56.823941 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4759294592}
I20260709 13:00:56.883489  1687 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:56.866186  2243 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.793454  5842 raft_consensus.cc:2764] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:00:56.864205  1620 rpcz_store.cc:269] 0709 13:00:54.435324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.628678 (+193354us) service_pool.cc:224] Handling call
0709 13:00:56.841372 (+2212694us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b540036d154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:56.841505 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195335424}
W20260709 13:00:56.869722  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 69136.1us
I20260709 13:00:56.890275  1659 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.891584  1659 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:56.870613  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.892596  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.868673  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:56.893786  2274 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.873826  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:56.894788  2268 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:56.885885  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:56.797972  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 131252us
I20260709 13:00:56.888259  2243 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.720317  5840 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.152s
W20260709 13:00:56.956727  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 65213.1us
I20260709 13:00:56.971009  1659 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:56.871239  6034 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.982933  2268 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:56.801687  5933 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:00:56.801000  5620 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 13:00:57.030788  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.006577  1545 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
W20260709 13:00:57.007722  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 110525us
W20260709 13:00:57.049732  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 92164.1us
I20260709 13:00:57.053032  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:56.877511  5919 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:56.876643  5881 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:56.980463  5638 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.057333  6050 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:56.805015  5924 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.153s
I20260709 13:00:56.884518  5841 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:56.981613  5840 consensus_queue.cc:1243] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:57.065301  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:57.088798  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:57.051270  6045 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:56.805449  5839 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:57.049088  5796 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:57.008167  6012 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:57.057901  5919 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.067713  5842 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.954990  5879 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:57.115185  6023 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:57.115411  2269 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:57.113725  5851 consensus_queue.cc:1175] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e12d7b3551014757ba7dda3e83605b83" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 13:00:57.116351  5796 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:57.118037  6012 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:57.118898  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 52868.1us
I20260709 13:00:57.122972  6033 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:57.104410  6045 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.170207  1443 catalog_manager.cc:5697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.162140  5892 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.113862  5919 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:57.178035  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.104569  6044 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 13:00:57.201326  1511 connection.cc:256] RPC call timeout handler was delayed by -1.0419365389999484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 13:00:57.179032  1585 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:57.184305  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2224) took 1483 ms. Trace:
I20260709 13:00:57.203827  1691 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:00:57.281636  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 102692us
I20260709 13:00:57.202039  1687 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:00:57.282004  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:57.220243  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2218) took 1093 ms. Trace:
I20260709 13:00:57.204591  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.284330  1693 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:57.203506  1689 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:57.204275  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:57.286214  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.202958  1685 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:57.281392  1616 rpcz_store.cc:276] 0709 13:00:55.700454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.701908 (+  1454us) service_pool.cc:224] Handling call
0709 13:00:55.729103 (+ 27195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.748874 (+ 19771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.748937 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.748989 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:55.749040 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.184080 (+1435040us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54000e1d54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:57.184135 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.184254 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44880768}
I20260709 13:00:57.235657  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:57.236083  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:57.289611  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:57.178632  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.290490  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.204162  1688 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:57.282903  1542 rpcz_store.cc:276] 0709 13:00:56.126644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.135043 (+  8399us) service_pool.cc:224] Handling call
0709 13:00:57.220052 (+1085009us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400281754. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:57.220189 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183416192}
I20260709 13:00:57.289688  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:57.292080  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.234042  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:57.333686  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.334350  1687 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:57.334970  1584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.007s
I20260709 13:00:57.335098  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:57.335383  1584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.006s	sys 0.007s
W20260709 13:00:57.335630  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 536965us
I20260709 13:00:57.333437  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:57.336215  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:57.337159  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:57.337285  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 55347us
I20260709 13:00:57.337972  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:57.338341  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.338981  1689 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.345053  1584 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:57.337761  1537 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:00:57.208521  6032 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:57.231343  6051 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:00:57.357753  1691 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
W20260709 13:00:57.238049  5621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.848s	user 0.016s	sys 0.034s
I20260709 13:00:57.367079  1688 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:57.174435  6045 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:57.369083  1542 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:57.180748  5892 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:57.368121  1687 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:57.378981  1693 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:57.357005  5882 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:00:57.251310  5620 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.164045  5879 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:57.369982  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:57.379580  5621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.980s	user 0.018s	sys 0.037s
I20260709 13:00:57.268640  5925 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:57.333413  5938 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.397990  1689 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:57.242367  5840 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 13:00:57.414796  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:57.427013  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.427591  1693 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:57.412048  1583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.009s	sys 0.008s
I20260709 13:00:57.333232  5893 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:57.423792  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:57.384555  6009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.021s	sys 0.032s
W20260709 13:00:57.430771  1583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.009s	sys 0.008s
W20260709 13:00:57.430913  6009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.022s	sys 0.032s
W20260709 13:00:57.384243  6053 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.005s	sys 0.011s
I20260709 13:00:57.432384  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.184645  5688 consensus_queue.cc:1059] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.200s
I20260709 13:00:57.433561  6009 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:57.434146  6009 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:57.434396  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.435176  6009 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:57.357187  5593 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:00:57.432679  6053 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.006s	sys 0.011s
I20260709 13:00:57.413599  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.438282  1687 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:57.435740  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.459770  1689 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.465891  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.416980  5860 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:57.498775  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.482854  5759 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:57.482273  5621 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:57.486902  5883 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:57.422062  5620 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:57.425612  5925 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:57.496047  5909 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:57.518596  6033 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:57.527570  6065 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.482264  5927 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:00:57.542287  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2242) took 1228 ms. Trace:
I20260709 13:00:57.549391  1617 rpcz_store.cc:276] 0709 13:00:56.314245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.314372 (+   127us) service_pool.cc:224] Handling call
0709 13:00:56.314787 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.315012 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.315037 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.356830 (+ 41793us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.655131 (+298301us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:56.655164 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.655224 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.542031 (+886807us) raft_consensus.cc:1685] finished
0709 13:00:57.542057 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.542213 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":263613,"threads_started":1,"wal-append.queue_time_us":493478}
I20260709 13:00:57.465790  5893 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:57.530975  5872 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:57.485381  5938 consensus_queue.cc:1059] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:00:57.535895  5759 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:57.558115  1544 raft_consensus.cc:2376] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14. Re-sending same reply.
I20260709 13:00:57.568696  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 902) took 1109 ms. Trace:
I20260709 13:00:57.569164  1615 rpcz_store.cc:276] 0709 13:00:56.459778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.460289 (+   511us) service_pool.cc:224] Handling call
0709 13:00:56.842465 (+382176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.864755 (+ 22290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.568465 (+703710us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b540036d150. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:57.568631 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878009088}
I20260709 13:00:57.547467  6012 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:57.551878  5909 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:57.592041  5796 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:57.562314  5872 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:57.551692  6033 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:57.632328  6054 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:00:57.656910  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.643167  6057 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:00:57.597273  5909 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:57.685956  5852 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.001s	sys 0.089s
W20260709 13:00:57.695905  5852 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.001s	sys 0.089s
I20260709 13:00:57.676113  6058 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.696285  5852 raft_consensus.cc:697] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:57.696750  6058 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:57.697485  5852 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:57.712280  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.716292  5925 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:57.628873  5759 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:57.725282  5759 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:57.728330  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.733210  6021 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.743s	user 0.010s	sys 0.011s
I20260709 13:00:57.734836  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 857) took 1856 ms. Trace:
I20260709 13:00:57.735230  1543 rpcz_store.cc:276] 0709 13:00:55.877915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.878545 (+   630us) service_pool.cc:224] Handling call
0709 13:00:55.878836 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.879149 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.879179 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.879506 (+   327us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.989964 (+110458us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:55.990001 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.990067 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.732353 (+1742286us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:57.734519 (+  2166us) raft_consensus.cc:1685] finished
0709 13:00:57.734539 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.734776 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":623,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":4826,"spinlock_wait_cycles":4869504,"thread_start_us":44390,"threads_started":1,"wal-append.queue_time_us":72022}
W20260709 13:00:57.754789  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.773849  2270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.017s
W20260709 13:00:57.774385  2270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.000s	sys 0.017s
W20260709 13:00:57.776044  2241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.009s	sys 0.017s
W20260709 13:00:57.776541  2241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.009s	sys 0.017s
W20260709 13:00:57.777081  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.777590  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.779898  2243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.015s	sys 0.010s
W20260709 13:00:57.780359  2243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.015s	sys 0.010s
I20260709 13:00:57.843500  1689 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
W20260709 13:00:57.845463  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.846037  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.848664  6033 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:57.846454  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:57.846576  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 326775us
W20260709 13:00:57.846458  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 501361us
W20260709 13:00:57.848037  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 959667us
I20260709 13:00:57.856417  1687 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:00:57.876629  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.878931  1687 raft_consensus.cc:2368] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9.
I20260709 13:00:57.882179  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:57.877065  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.856657  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:57.892275  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:57.892910  2268 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:57.779728  5859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.016s	sys 0.015s
I20260709 13:00:57.895462  2273 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:00:57.895975  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.002s	sys 0.027s
W20260709 13:00:57.854895  5656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.004s	sys 0.020s
I20260709 13:00:57.899081  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:57.899042  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.002s	sys 0.027s
I20260709 13:00:57.901429  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:57.846971  6009 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:57.855096  5924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.006s	sys 0.025s
W20260709 13:00:57.902034  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.003s	sys 0.026s
I20260709 13:00:57.912297  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:57.851226  5880 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:57.855050  6043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.007s	sys 0.024s
I20260709 13:00:57.887255  1687 raft_consensus.cc:2368] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10.
I20260709 13:00:57.913092  2269 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.911718  2268 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
W20260709 13:00:57.922036  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.002s	sys 0.014s
W20260709 13:00:57.901737  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 563747us
W20260709 13:00:57.914398  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.014s	sys 0.017s
W20260709 13:00:57.924098  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.014s	sys 0.017s
I20260709 13:00:57.918493  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:57.914637  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.004s	sys 0.026s
W20260709 13:00:57.899915  6028 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.000s	sys 0.016s
I20260709 13:00:57.925276  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:57.899865  5621 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:57.923797  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.002s	sys 0.014s
I20260709 13:00:57.896824  6070 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:57.928812  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:57.929252  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.929647  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:57.952963  2271 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:57.904428  6076 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:00:57.930904  1693 consensus_meta.cc:287] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.503s	user 0.004s	sys 0.012s
I20260709 13:00:57.957902  1693 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:00:57.923188  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:57.931640  1686 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.017s
W20260709 13:00:57.925575  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 562315us
I20260709 13:00:57.933951  1687 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:57.890301  6047 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:57.933202  6028 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.000s	sys 0.016s
I20260709 13:00:57.897289  5941 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.900753  5925 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:57.994773  2274 consensus_meta.cc:287] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.040s	user 0.012s	sys 0.008s
W20260709 13:00:57.910028  5924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.006s	sys 0.026s
I20260709 13:00:57.899927  6053 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:57.897945  5859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.017s	sys 0.015s
I20260709 13:00:57.897099  5796 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:57.944727  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:57.995738  1613 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:57.996495  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 51883.7us
I20260709 13:00:57.997298  1511 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:57.948145  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.947480  1509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.016s
W20260709 13:00:57.999159  1509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.003s	sys 0.016s
I20260709 13:00:57.930289  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:57.953444  2241 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.750s (SENT) [suppressed 31 similar messages]
W20260709 13:00:57.922211  6043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.007s	sys 0.025s
I20260709 13:00:57.933230  6046 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.915288  5879 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:57.929085  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:57.965552  1620 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:00:57.964660  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:58.005396  2274 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:58.005592  2276 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:58.005635  1616 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:57.991299  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.006556  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:58.006805  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.026s
W20260709 13:00:58.007313  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.004s	sys 0.026s
I20260709 13:00:58.007500  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:57.982371  1538 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.008s	sys 0.034s
W20260709 13:00:58.008508  1538 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.010s	sys 0.034s
I20260709 13:00:58.009058  2269 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:00:57.916414  6033 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:57.966261  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:57.994560  1618 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:57.900527  5656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.004s	sys 0.021s
W20260709 13:00:57.958923  1686 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.002s	sys 0.018s
I20260709 13:00:58.007222  2276 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:58.013031  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:57.920040  5892 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:00:57.962327  5620 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.003648  1619 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:58.004207  1536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.021s	sys 0.079s
W20260709 13:00:58.022071  1536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.022s	sys 0.080s
W20260709 13:00:58.004207  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 81090.4us
I20260709 13:00:58.014180  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:57.933370  6060 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.014993  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 1064) took 1160 ms. Trace:
I20260709 13:00:58.033418  2274 rpcz_store.cc:276] 0709 13:00:56.847481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.854371 (+  6890us) service_pool.cc:224] Handling call
0709 13:00:58.008033 (+1153662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.033681  1693 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:58.035454  1693 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:58.036059  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:58.036924  1613 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 7: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:57.919611  5848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.011s	sys 0.021s
I20260709 13:00:58.038828  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:58.015555  1511 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:58.015976  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.014s	sys 0.014s
I20260709 13:00:57.961558  5719 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:58.003351  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:57.926430  6042 consensus_queue.cc:1059] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:00:58.019798  6058 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:57.969692  2271 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:00:58.010859  5938 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.044174  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.014s	sys 0.014s
I20260709 13:00:58.004735  5872 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.045977  1612 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:00:58.069837  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 54368.7us
W20260709 13:00:58.070386  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 877) took 1666 ms (client timeout 1750 ms). Trace:
I20260709 13:00:58.070633  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:00:58.071005  1545 rpcz_store.cc:269] 0709 13:00:56.403654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.428105 (+ 24451us) service_pool.cc:224] Handling call
0709 13:00:58.070212 (+1642107us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400355054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:58.070324 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048174848}
I20260709 13:00:58.071949  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:58.051131  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:57.986851  6069 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:00:58.022250  6033 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:58.051079  2274 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:00:58.051748  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:58.046439  5848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.016s	sys 0.024s
I20260709 13:00:58.052562  5938 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:58.087287  5992 consensus_meta.cc:287] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.268s	user 0.009s	sys 0.009s
I20260709 13:00:58.087378  5938 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.087867  5992 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:58.088322  5992 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.088706  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1876) took 1695 ms. Trace:
I20260709 13:00:58.003729  5796 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.089994  5962 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:00:58.091589  6033 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.092281  5796 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.034658  5924 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:58.093366  5924 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.055868  6019 raft_consensus.cc:3055] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:58.057051  6039 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.447s	user 0.007s	sys 0.013s
I20260709 13:00:57.968008  6070 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.060215  5883 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:57.991982  6076 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.076058  5909 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.073426  5882 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:58.064960  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:58.139632  1620 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 16: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:58.139792  1619 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:58.065217  5968 raft_consensus.cc:3055] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:58.068266  5876 consensus_queue.cc:1059] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:58.014578  6053 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:57.955668  5621 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.017568  5879 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:58.014117  6062 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:58.079756  2269 pending_rounds.cc:85] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 7
I20260709 13:00:58.078599  1613 raft_consensus.cc:2410] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:00:58.196030  2269 pending_rounds.cc:107] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:58.196425  2269 raft_consensus.cc:2889] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.080713  5893 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.085536  5943 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:58.089059  1540 rpcz_store.cc:276] 0709 13:00:56.392929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.393207 (+   278us) service_pool.cc:224] Handling call
0709 13:00:56.393602 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.832087 (+438485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.088479 (+1256392us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54000f1754. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:58.088651 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007116544}
I20260709 13:00:58.094331  6011 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:58.004652  5941 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:57.993522  6047 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:58.144893  5898 consensus_meta.cc:287] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.431s	user 0.016s	sys 0.002s
I20260709 13:00:58.063189  5719 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.064416  1687 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:58.083950  5872 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:58.100818  5847 consensus_meta.cc:287] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.450s	user 0.007s	sys 0.011s
I20260709 13:00:58.090296  5992 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.099028  6019 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:58.077634  6079 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:58.182196  5968 raft_consensus.cc:740] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:58.274899  2277 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
W20260709 13:00:58.277873  6084 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:00:58.191859  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.194278  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:00:58.143478  5919 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.944s	user 0.018s	sys 0.010s
I20260709 13:00:58.201299  5943 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:58.017252  6044 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:00:58.198791  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:58.144507  2273 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.227188  5872 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:00:58.273136  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 319667us
I20260709 13:00:58.186232  5879 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:58.282919  1687 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:58.199337  6011 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:58.278340  6079 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:58.220851  5893 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.281577  6006 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.182112  5882 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.342149  5684 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.342734  5684 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.343780  2273 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:00:58.345110  5921 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.345754  5921 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.349504  5921 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:58.360381  6087 log.cc:927] Time spent T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:00:58.216832  6062 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:58.299052  5943 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.335986  5879 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.324643  5924 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:58.372421  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.373198  1687 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:00:58.375362  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2228) took 1139 ms. Trace:
I20260709 13:00:58.333288  5872 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.325975  5925 raft_consensus.cc:697] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:58.367482  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 295552us
I20260709 13:00:58.404946  2241 leader_election.cc:400] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9.
I20260709 13:00:58.405893  2241 leader_election.cc:400] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10.
I20260709 13:00:58.406165  2241 leader_election.cc:403] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:00:58.367857  6072 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:00:58.406771  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:00:58.394685  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.325047  5919 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.359434  6079 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:58.358798  5848 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.385083  1538 rpcz_store.cc:276] 0709 13:00:57.235259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.294044 (+ 58785us) service_pool.cc:224] Handling call
0709 13:00:57.294324 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.294497 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:58.008873 (+714376us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.372379 (+363506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.372431 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:58.372479 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.372544 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.374363 (+  1819us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":719514,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"thread_start_us":1007203,"threads_started":2}
I20260709 13:00:58.408926  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.375262  6086 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.421674  1538 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:58.378047  5924 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.421473  5656 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:00:58.423543  6089 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:00:58.423997  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.404817  6083 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:58.411943  5992 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.448094  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.277274  6019 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.363775  6006 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:58.420044  6068 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:00:58.449682  5621 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:58.429939  1694 raft_consensus.cc:2368] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13.
I20260709 13:00:58.409456  6047 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.420742  5620 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.422381  6044 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:00:58.479395  6070 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.425053  6086 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.422385  5848 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.489430  5848 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.490056  6083 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.492722  6083 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.494323  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 815) took 1289 ms. Trace:
I20260709 13:00:58.494884  1690 rpcz_store.cc:276] 0709 13:00:57.205139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.205254 (+   115us) service_pool.cc:224] Handling call
0709 13:00:57.205507 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.205792 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.205819 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.206252 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.924578 (+718326us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:57.924621 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.924689 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.494016 (+569327us) raft_consensus.cc:1685] finished
0709 13:00:58.494042 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.494220 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5029,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":718044,"threads_started":1,"wal-append.queue_time_us":1012674}
I20260709 13:00:58.497387  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.498081  1690 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:00:58.377681  5968 consensus_queue.cc:260] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:00:58.415153  5851 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10.
I20260709 13:00:58.509464  5847 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:58.509218  5872 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.509917  5847 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:58.510392  1543 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:58.430650  5924 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.430920  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.512488  1687 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:58.512776  5924 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:58.513415  5924 consensus_queue.cc:1059] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:58.513892  1687 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:58.514206  5924 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:58.431747  1693 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:00:58.515347  5847 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.515933  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1863) took 1307 ms. Trace:
I20260709 13:00:58.514479  5674 raft_consensus.cc:3055] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:58.516397  1693 rpcz_store.cc:276] 0709 13:00:57.208842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.036410 (+827568us) service_pool.cc:224] Handling call
0709 13:00:58.036760 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.514907 (+478147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.515664 (+   757us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400305054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:58.515871 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907579648}
I20260709 13:00:58.517138  5674 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:58.518062  1693 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:58.517969  5674 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.519219  5674 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.522042  5719 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:58.448165  5992 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.524458  5992 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.526099  5919 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:58.433023  5925 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:58.434110  6088 log.cc:927] Time spent T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:00:58.427799  1585 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:58.531174  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 103473us
I20260709 13:00:58.531963  1585 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:58.439143  6078 log.cc:927] Time spent T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:00:58.443967  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.539759  1510 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:58.411293  6011 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.468012  5882 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.469092  5941 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:58.474256  5842 consensus_meta.cc:287] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 1.313s	user 0.015s	sys 0.005s
W20260709 13:00:58.475347  5759 consensus_meta.cc:287] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.750s	user 0.010s	sys 0.005s
W20260709 13:00:58.478008  6009 consensus_meta.cc:287] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.564s	user 0.003s	sys 0.004s
I20260709 13:00:58.516636  5847 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:58.432412  6045 consensus_meta.cc:287] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 1.015s	user 0.014s	sys 0.014s
I20260709 13:00:58.527531  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.581933  1693 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:58.529677  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:58.582787  2241 leader_election.cc:336] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 2.129s (SENT)
I20260709 13:00:58.583266  1690 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 8: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:58.583374  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:58.569973  1687 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: [4.7-7.9]
I20260709 13:00:58.457734  6062 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:00:58.586648  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2227) took 1351 ms. Trace:
I20260709 13:00:58.586771  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.587270  1690 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:58.543635  5924 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:58.543332  5621 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:58.590801  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2665) took 2634 ms. Trace:
I20260709 13:00:58.542852  6096 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:58.568665  6028 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:00:58.542900  6086 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:58.582808  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:58.615244  1693 raft_consensus.cc:2376] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7. Re-sending same reply.
I20260709 13:00:58.577430  5842 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.588122  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:58.587007  1536 rpcz_store.cc:276] 0709 13:00:57.234925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.236228 (+  1303us) service_pool.cc:224] Handling call
0709 13:00:57.343302 (+107074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.343663 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.343700 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.363561 (+ 19861us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.032809 (+669248us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:58.032849 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.032924 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.586485 (+553561us) raft_consensus.cc:1685] finished
0709 13:00:58.586502 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.586602 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79384,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":59463,"thread_start_us":668941,"threads_started":1,"wal-append.queue_time_us":838042}
W20260709 13:00:58.578958  1686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.019s
W20260709 13:00:58.622673  1686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.012s	sys 0.019s
W20260709 13:00:58.612721  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 284717us
I20260709 13:00:58.616291  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.585875  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:58.586263  6011 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.591157  1692 rpcz_store.cc:276] 0709 13:00:55.957420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.967455 (+ 10035us) service_pool.cc:224] Handling call
0709 13:00:55.967745 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.168417 (+200672us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:56.206699 (+ 38282us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.743535 (+1536836us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b18003640c0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a 00007f29ebdafa2a
0709 13:00:57.957234 (+213699us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.957702 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.957840 (+   138us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:57.957869 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.957939 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.587369 (+629430us) raft_consensus.cc:1685] finished
0709 13:00:58.590577 (+  3208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.590741 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38138,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":62026,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"spinlock_wait_cycles":22052096,"thread_start_us":413727,"threads_started":2,"wal-append.queue_time_us":1914534}
W20260709 13:00:58.626228  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 43488.6us
I20260709 13:00:58.624419  1693 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:58.627355  1687 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 14: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:00:58.618924  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.018s	sys 0.014s
I20260709 13:00:58.568424  5992 consensus_queue.cc:1059] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:00:58.631922  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.019s	sys 0.014s
I20260709 13:00:58.629602  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2238) took 1110 ms. Trace:
I20260709 13:00:58.597095  5621 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:58.641198  1544 rpcz_store.cc:276] 0709 13:00:57.519227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.776607 (+257380us) service_pool.cc:224] Handling call
0709 13:00:57.776972 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.777179 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:58.370853 (+593674us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.628471 (+257618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.628679 (+   208us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:58.628901 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.628975 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.629540 (+   565us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":281173,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"thread_start_us":736864,"threads_started":2}
W20260709 13:00:58.653731  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.656265  1690 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:58.660270  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:58.624938  6096 raft_consensus.cc:697] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:58.683945  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:58.684588  1544 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:00:58.589318  6045 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.687788  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:58.629171  6098 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:58.692358  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 64070.2us
I20260709 13:00:58.665585  6043 raft_consensus.cc:3055] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:58.664059  5621 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:58.690532  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 283846us
I20260709 13:00:58.700212  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:58.668790  6083 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.676124  5992 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.666047  6113 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.696903  1544 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:58.697857  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:58.703156  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:58.706156  5919 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.709313  1688 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:58.696405  5941 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.688298  6062 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:58.702137  6043 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:58.727185  6062 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.727754  6043 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.705741  5882 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:00:58.700438  1511 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:58.678398  6086 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:58.719594  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:58.700628  6101 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:58.716492  5919 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.717250  5992 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:58.736790  6095 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:00:58.701913  5674 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:00:58.748338  2241 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:58.752929  2241 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:58.712378  6083 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:58.761739  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.754097  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 53916.6us
I20260709 13:00:58.769263  1511 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:58.702049  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:58.728937  6043 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.724094  6098 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:58.695930  6103 consensus_queue.cc:1059] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:00:58.783756  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 81786.6us
I20260709 13:00:58.812346  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:58.813092  2269 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:58.743834  5881 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:58.747406  5919 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.745971  6101 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:58.828353  6101 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.829021  6105 raft_consensus.cc:3055] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:58.829447  6105 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:58.830322  6105 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.831637  6105 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.832010  5882 consensus_queue.cc:1059] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:00:58.833299  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.834022  1585 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:58.754266  6106 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:00:58.753178  6120 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.815860  6115 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:00:58.815980  6108 log.cc:927] Time spent T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:00:58.766324  5759 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.765570  6017 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:58.809846  5941 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:58.823176  6109 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:00:58.812345  6098 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.825608  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:58.835196  6100 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.746577  5872 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:58.719666  5924 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.831048  6112 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.837186  5881 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:58.850188  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.847023  5759 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:00:58.850966  5941 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.844153  6079 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.752260  6096 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.891857  6079 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:58.859009  6100 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.863662  5881 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.818522  5943 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:00:58.863168  6017 raft_consensus.cc:697] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:58.865082  5872 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:58.858739  6098 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.902351  6014 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:58.878904  6112 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.906402  6017 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:58.892886  5941 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.896181  6100 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.845799  6120 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:58.919569  6123 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:58.921530  6045 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:58.913543  6112 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:58.967000  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 424571us
I20260709 13:00:58.968940  1510 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:58.973165  1540 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:58.979303  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 165904us
I20260709 13:00:59.002059  2273 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:59.005633  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1139) took 1075 ms. Trace:
I20260709 13:00:59.008183  5852 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.006319  2276 rpcz_store.cc:276] 0709 13:00:57.930126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.018585 (+ 88459us) service_pool.cc:224] Handling call
0709 13:00:58.018926 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.380634 (+361708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.380978 (+   344us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.381528 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.626066 (+244538us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:58.654273 (+ 28207us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.705508 (+ 51235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.705573 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.004995 (+299422us) raft_consensus.cc:1685] finished
0709 13:00:59.005035 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.005382 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50978,"prepare.queue_time_us":96654,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":100938,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":13386,"thread_start_us":591823,"threads_started":3,"wal-append.queue_time_us":490172}
I20260709 13:00:59.009310  5852 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.013574  6079 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:59.019357  6079 raft_consensus.cc:697] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:59.019582  5656 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:59.020058  5656 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:59.021061  6079 consensus_queue.cc:237] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.021811  5656 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.016570  6070 raft_consensus.cc:3055] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:58.893326  5759 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.027559  5852 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:59.032461  5593 raft_consensus.cc:3055] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:59.039129  5593 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:59.041756  5593 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.050405  5656 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.912096  5872 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.053838  5872 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.026165  6070 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:59.054536  5872 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.069615  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.074183  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.075335  1545 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
W20260709 13:00:59.076159  2277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1112) took 4420 ms (client timeout 1915 ms). Trace:
W20260709 13:00:59.076618  2277 rpcz_store.cc:269] 0709 13:00:54.655483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.814930 (+159447us) service_pool.cc:224] Handling call
0709 13:00:59.075739 (+4260809us) spinlock_profiling.cc:243] Waited 3.35 s on lock 0x7b54006bd5d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:59.075918 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7708432256}
I20260709 13:00:59.079362  6083 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.074240  1443 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 11, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.080374  6132 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:59.082180  6070 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.080667  5898 raft_consensus.cc:3055] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:59.081740  1443 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 5 to 8, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.091966  6127 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:59.083385  5898 raft_consensus.cc:740] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:58.937103  6117 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:59.100088  5992 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.100414  5943 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.101150  6117 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:59.101859  6117 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.107757  6120 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.108645  6070 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.106495  5925 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:00:59.111764  5898 consensus_queue.cc:260] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.093114  6127 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.114879  5977 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:59.115290  5977 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:59.116537  5977 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.117630  5977 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.122014  5898 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.134384  2269 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:59.134500  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.136209  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.137884  6062 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.138254  6100 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.139786  6127 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.140033  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2667) took 1104 ms. Trace:
W20260709 13:00:59.140733  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.140491  1620 rpcz_store.cc:276] 0709 13:00:58.035353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.035498 (+   145us) service_pool.cc:224] Handling call
0709 13:00:59.139548 (+1104050us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b54003a1454. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:59.139799 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151544064}
I20260709 13:00:59.141000  6100 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:00:59.141315  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.142333  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.142767  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.143707  1687 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:59.145435  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.147439  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.148849  2271 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:00:59.149840  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:59.150332  6071 log.cc:927] Time spent T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.127s	user 0.002s	sys 0.000s
I20260709 13:00:59.155517  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.151684  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.136049  5872 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.151151  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.156191  1545 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:59.163726  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1117) took 4419 ms. Trace:
W20260709 13:00:59.167128  6066 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.089s	user 0.002s	sys 0.000s
I20260709 13:00:59.167589  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.154146  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:59.169677  6073 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.985s	user 0.000s	sys 0.001s
I20260709 13:00:59.169871  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.153690  5621 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.156658  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:59.132484  5879 consensus_meta.cc:287] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.679s	user 0.013s	sys 0.004s
I20260709 13:00:59.177369  6126 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:00:59.177677  1543 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:59.178233  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.187391  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.192524  6102 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:00:59.192842  5992 consensus_queue.cc:1059] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:59.173421  2270 rpcz_store.cc:276] 0709 13:00:54.744207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.009764 (+265557us) service_pool.cc:224] Handling call
0709 13:00:55.010036 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.027881 (+ 17845us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:55.074444 (+ 46563us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.171348 (+2096904us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b180019b760. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a 00007f29ebdafa2a
0709 13:00:57.774951 (+603603us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.775561 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.775744 (+   183us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:57.775791 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.775886 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.149366 (+1373480us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:59.163295 (+ 13929us) raft_consensus.cc:1685] finished
0709 13:00:59.163321 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.163532 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6850,"prepare.queue_time_us":45455,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3729,"raft.queue_time_us":5081,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":34442,"spinlock_wait_cycles":46354944,"thread_start_us":603309,"threads_started":1,"wal-append.queue_time_us":2868571}
I20260709 13:00:59.179395  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.196004  1692 raft_consensus.cc:2376] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9. Re-sending same reply.
I20260709 13:00:59.196981  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.197360  1611 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:59.197788  1614 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:59.198454  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.198755  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.199213  1611 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:59.199664  1613 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:00:59.200688  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.200979  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.180263  1693 raft_consensus.cc:2376] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7. Re-sending same reply.
I20260709 13:00:59.201952  1620 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:59.180902  2272 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.204457  6006 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.179915  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:59.207768  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1866) took 1998 ms (client timeout 2184 ms). Trace:
W20260709 13:00:59.208099  1689 rpcz_store.cc:269] 0709 13:00:57.209509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.844405 (+634896us) service_pool.cc:224] Handling call
0709 13:00:59.179565 (+1335160us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5800003698. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:00:59.207702 (+ 28137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42510592}
I20260709 13:00:59.197696  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.209693  1619 raft_consensus.cc:2410] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:00:59.209770  5847 consensus_meta.cc:287] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.621s	user 0.013s	sys 0.005s
I20260709 13:00:59.200748  5839 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.180984  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.180420  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.190070  5879 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.201956  1618 raft_consensus.cc:2410] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:59.215852  5942 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:59.221246  5942 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:59.223877  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.211671  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:00:59.182601  6011 consensus_meta.cc:287] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.000s
I20260709 13:00:59.231437  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:59.200785  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.210659  2272 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:59.212710  5883 raft_consensus.cc:3055] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:59.204533  5872 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.263051  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 808) took 2034 ms. Trace:
I20260709 13:00:59.263435  1619 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:59.263849  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.263624  5759 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.265076  1545 raft_consensus.cc:2393] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:59.265795  5759 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.266088  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.267333  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.267663  5941 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:59.268424  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.269433  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.269582  5941 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.270459  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.210623  6113 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.289670  5684 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.290958  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2232) took 2031 ms. Trace:
I20260709 13:00:59.291558  1537 rpcz_store.cc:276] 0709 13:00:57.259274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.347479 (+ 88205us) service_pool.cc:224] Handling call
0709 13:00:57.347802 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.590373 (+242571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.590416 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.590469 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:57.590513 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.290334 (+1699821us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54000b0ed4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:59.290424 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.290646 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557306752}
I20260709 13:00:59.294466  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2240) took 1201 ms. Trace:
I20260709 13:00:59.296545  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:59.295019  1542 rpcz_store.cc:276] 0709 13:00:58.092775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.095278 (+  2503us) service_pool.cc:224] Handling call
0709 13:00:58.122903 (+ 27625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.123227 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:58.200977 (+ 77750us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.526487 (+325510us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b180048ca00. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a 00007f29ebdafa2a
0709 13:00:59.067935 (+541448us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.219979 (+152044us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.233061 (+ 13082us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:59.238491 (+  5430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.253435 (+ 14944us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.293826 (+ 40391us) raft_consensus.cc:1685] finished
0709 13:00:59.293977 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.294213 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28249,"prepare.queue_time_us":72061,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":234428,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":120,"spinlock_wait_cycles":17282560,"thread_start_us":528110,"threads_started":2,"wal-append.queue_time_us":685484}
I20260709 13:00:59.297331  1614 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 16: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:59.298175  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:59.298614  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:59.298888  1614 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.299101  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.300333  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.301442  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.302044  1611 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 6.
I20260709 13:00:59.302963  5919 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.303421  2243 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:59.304095  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:59.304934  1619 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.305197  5919 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.307627  6041 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.308584  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.308418  6041 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.309769  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.303303  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.263466  1686 rpcz_store.cc:276] 0709 13:00:57.201558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.202455 (+   897us) service_pool.cc:224] Handling call
0709 13:00:57.341891 (+139436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:57.366972 (+ 25081us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:58.012673 (+645701us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.623351 (+610678us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.623504 (+   153us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:59.104314 (+480810us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b1800051580. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:59.159588 (+ 55274us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b1800051580. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c862a6 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a
0709 13:00:59.160759 (+  1171us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b2c0009d728. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 13:00:59.161637 (+   878us) log.cc:844] Serialized 52 byte log entry
0709 13:00:59.165897 (+  4260us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:59.166329 (+   432us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.170567 (+  4238us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b1800051580. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:00:59.220267 (+ 49700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.233182 (+ 12915us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.233241 (+    59us) raft_consensus.cc:1685] finished
0709 13:00:59.233258 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.235482 (+  2224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10185,"prepare.queue_time_us":768371,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":151,"raft.queue_time_us":82629,"raft.run_cpu_time_us":579,"raft.run_wall_time_us":26344,"spinlock_wait_cycles":28453120,"thread_start_us":1166586,"threads_started":2,"wal-append.queue_time_us":707286}
I20260709 13:00:59.310644  1537 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:59.324443  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2241) took 1231 ms. Trace:
I20260709 13:00:59.262182  5883 raft_consensus.cc:740] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:59.325165  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.337818  1537 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:59.314615  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:59.340162  6075 log.cc:927] Time spent T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.977s	user 0.003s	sys 0.000s
I20260709 13:00:59.340495  1542 raft_consensus.cc:2376] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8. Re-sending same reply.
I20260709 13:00:59.341760  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.341985  6117 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:00:59.315721  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1876) took 2099 ms (client timeout 1515 ms). Trace:
I20260709 13:00:59.356446  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:59.356915  1691 rpcz_store.cc:269] 0709 13:00:57.216016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.333191 (+117175us) service_pool.cc:224] Handling call
0709 13:00:59.315380 (+1982189us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b5400125f54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:59.315548 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47924480}
I20260709 13:00:59.357347  1536 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:59.317904  5968 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.358243  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:59.321573  5593 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:59.368479  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.322801  6041 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.322867  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 1076) took 1333 ms. Trace:
W20260709 13:00:59.323031  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 53263.9us
I20260709 13:00:59.371106  2274 rpcz_store.cc:276] 0709 13:00:57.989840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.085341 (+ 95501us) service_pool.cc:224] Handling call
0709 13:00:58.085641 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.201635 (+115994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.201682 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.202207 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.619386 (+417179us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:58.619533 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.322188 (+702655us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400881dd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:59.322267 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.322341 (+    74us) raft_consensus.cc:1685] finished
0709 13:00:59.322357 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.322657 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":608,"raft.queue_time_us":1454,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":11346,"spinlock_wait_cycles":264175360,"thread_start_us":333496,"threads_started":1,"wal-append.queue_time_us":464423}
I20260709 13:00:59.323930  2243 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:59.311712  6070 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:59.324831  1540 rpcz_store.cc:276] 0709 13:00:58.093049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.325921 (+232872us) service_pool.cc:224] Handling call
0709 13:00:58.326281 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.974015 (+647734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.324199 (+350184us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b540025b7d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:59.324390 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485891840}
I20260709 13:00:59.323906  1585 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:59.326879  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:59.350437  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.353588  5992 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:59.354230  6132 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.355005  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1878) took 1465 ms. Trace:
I20260709 13:00:59.357900  5942 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.359016  4765 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.359236  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.320986  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.360786  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2224) took 2126 ms. Trace:
I20260709 13:00:59.361222  6117 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:59.363705  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.363752  6076 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:00:59.334785  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2670) took 1296 ms (client timeout 1622 ms). Trace:
I20260709 13:00:59.336561  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:00:59.366775  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.367602  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.367118  5621 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.417605  1686 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:59.440785  6070 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:00:59.417740  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:59.376513  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 820) took 2168 ms (client timeout 2129 ms). Trace:
W20260709 13:00:59.441234  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.441835  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:59.441990  1694 rpcz_store.cc:269] 0709 13:00:57.207713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.467073 (+259360us) service_pool.cc:224] Handling call
0709 13:00:59.376091 (+1909018us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54001095d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:59.376343 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333207296}
I20260709 13:00:59.442750  5992 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.443466  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.443830  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:59.444691  1616 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:59.444815  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.375069  5835 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:59.409354  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:59.407002  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.397535  6045 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:00:59.311977  1620 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:59.419658  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.410522  2277 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:59.444780  1543 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:00:59.425231  5688 raft_consensus.cc:3055] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:59.326138  5879 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.449534  6132 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:59.451082  6070 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.326460  1545 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:59.356518  6053 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.459431  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.459731  6132 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.460451  1511 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:59.404480  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:59.415674  1691 raft_consensus.cc:1240] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:59.403852  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.373152  1538 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:00:59.446798  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:59.462525  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.419236  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:00:59.409569  1509 connection.cc:256] RPC call timeout handler was delayed by -1.0789844219999623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 13:00:59.450039  5942 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:59.463588  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.463735  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.451210  1613 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:00:59.461043  2274 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:59.462826  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.467345  1538 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:59.456399  6045 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.468232  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.466285  1691 raft_consensus.cc:2376] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8. Re-sending same reply.
I20260709 13:00:59.468912  6019 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.469273  6045 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.469561  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.470391  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.441780  1685 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:59.471021  1686 raft_consensus.cc:2376] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10. Re-sending same reply.
I20260709 13:00:59.471735  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.471932  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.472250  1685 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.472651  1686 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:59.473399  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.473928  1686 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:59.444908  5992 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.326898  6112 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.403416  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:59.382584  1443 catalog_manager.cc:5697] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.464872  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:59.354262  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2226) took 2119 ms. Trace:
I20260709 13:00:59.415313  1690 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:59.448171  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 90096.2us
I20260709 13:00:59.449029  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.457432  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.456833  1692 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
W20260709 13:00:59.450531  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 126686us
I20260709 13:00:59.442240  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.470135  1691 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:59.457892  1612 rpcz_store.cc:269] 0709 13:00:58.038494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.038597 (+   103us) service_pool.cc:224] Handling call
0709 13:00:59.334286 (+1295689us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b540026f7d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:00:59.334558 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6777600}
I20260709 13:00:59.463490  1693 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:00:59.457199  5688 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:59.315189  5881 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.389964  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:59.339028  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.475984  2269 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:00:59.476784  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 79782.3us
I20260709 13:00:59.447530  5968 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:59.479075  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:00:59.498605  1537 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:59.477809  5684 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.499987  6112 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:59.500437  6112 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:59.500182  5684 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.500857  6112 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.501248  5881 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.502435  1685 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:00:59.474630  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.418035  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:00:59.464066  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.492947  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.479385  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.486107  1542 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:00:59.448340  1688 rpcz_store.cc:276] 0709 13:00:57.889394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.065726 (+176332us) service_pool.cc:224] Handling call
0709 13:00:58.065985 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.716645 (+650660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.354412 (+637767us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400360e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:59.354780 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478913408}
I20260709 13:00:59.477051  5719 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:59.460189  1545 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:00:59.486951  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:59.477744  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:59.483932  1540 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:00:59.478688  1543 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:00:59.485952  1619 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:00:59.468918  1538 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:00:59.478205  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.508648  1690 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.497067  1614 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:00:59.477897  6014 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:00:59.510933  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 187191us
I20260709 13:00:59.511354  6014 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:59.511700  6014 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:59.512542  6014 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:59.513702  6014 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.514261  1692 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
W20260709 13:00:59.479235  6098 consensus_meta.cc:287] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.564s	user 0.005s	sys 0.007s
I20260709 13:00:59.440375  1539 rpcz_store.cc:276] 0709 13:00:57.234012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.234226 (+   214us) service_pool.cc:224] Handling call
0709 13:00:57.234564 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.439430 (+204866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.439474 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.439970 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.007775 (+567805us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:58.007817 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.360235 (+1352418us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002c2254. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:00:59.360293 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.360352 (+    59us) raft_consensus.cc:1685] finished
0709 13:00:59.360366 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.360605 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470430464,"thread_start_us":567465,"threads_started":1,"wal-append.queue_time_us":744235,"wal-append.run_cpu_time_us":2618,"wal-append.run_wall_time_us":1224374}
I20260709 13:00:59.513934  6100 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:59.526517  1538 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:59.525234  2243 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:59.528420  6117 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:59.529057  6117 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:59.529598  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:59.529974  5684 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.530510  1659 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:59.531019  1543 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:59.531113  6117 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.474573  6070 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.531967  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:59.532902  5719 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:59.533378  5719 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:59.533547  5919 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:59.534133  5919 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:59.513878  5925 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:59.535427  1545 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:59.537922  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:59.476821  1541 rpcz_store.cc:276] 0709 13:00:57.234630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.234768 (+   138us) service_pool.cc:224] Handling call
0709 13:00:57.251039 (+ 16271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.293116 (+ 42077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.293145 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.333703 (+ 40558us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.943325 (+609622us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:58.335069 (+391744us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.417194 (+ 82125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.417306 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.339325 (+922019us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:00:59.353846 (+ 14521us) raft_consensus.cc:1685] finished
0709 13:00:59.353928 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.354079 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61972,"prepare.queue_time_us":115195,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":220711,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":24843,"spinlock_wait_cycles":5958016,"thread_start_us":1003522,"threads_started":3,"wal-append.queue_time_us":922673}
I20260709 13:00:59.541568  5942 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:59.541589  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 97875.8us
I20260709 13:00:59.543526  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:59.544417  2271 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:59.517072  5968 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:00:59.520476  6053 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.537346  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.547188  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:59.533352  6070 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:00:59.569140  1619 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:59.569020  1510 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:00:59.572525  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.570019  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.551818  5942 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:59.575721  1537 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:00:59.575793  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 55259.8us
W20260709 13:00:59.576221  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 44371.8us
W20260709 13:00:59.576807  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 99177.9us
I20260709 13:00:59.576292  5942 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.577646  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:59.577993  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:59.578910  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:00:59.579064  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:59.580148  6017 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:59.580646  6033 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:59.580699  6017 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:00:59.579064  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:00:59.581820  6017 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.583107  1619 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:59.583351  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:00:59.583616  1619 pending_rounds.cc:85] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 7
I20260709 13:00:59.583877  1619 pending_rounds.cc:107] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:59.584087  1616 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:00:59.584154  1619 raft_consensus.cc:2889] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.583061  1613 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:59.584952  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:00:59.585711  1612 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:00:59.586509  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:59.575531  2275 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:00:59.587775  6050 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.589823  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.590430  2277 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:00:59.591041  5688 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:59.592060  5688 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.592368  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.592922  2277 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:00:59.594897  5921 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:59.595357  5921 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:59.595389  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 52082.1us
I20260709 13:00:59.595875  5921 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.598043  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:59.544056  6098 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.601107  6098 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.600906  5968 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.336789  5883 consensus_queue.cc:260] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.604624  6132 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.605223  1544 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:59.605984  5861 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.606788  5941 consensus_queue.cc:1059] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:59.605181  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:59.609480  6050 raft_consensus.cc:2764] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:00:59.610291  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:00:59.610967  6049 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.611135  6050 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:59.611505  6050 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.612017  6050 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.569278  6041 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:59.611488  6049 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.615154  2276 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:00:59.606485  5861 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.621447  2272 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:00:59.622367  2274 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:59.623157  5919 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.624013  6132 consensus_queue.cc:1059] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:59.546080  6100 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:00:59.578999  1660 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:59.534510  5719 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.631414  6050 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:59.633306  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 54388.5us
W20260709 13:00:59.634546  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.551937  6053 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.634922  6009 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.635288  6053 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.637475  2270 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:59.626752  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:00:59.671204  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 93296us
I20260709 13:00:59.675097  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:59.676241  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.679103  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 134690us
I20260709 13:00:59.678418  1690 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:00:59.657222  6117 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:59.669377  5593 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:59.681221  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.571177  5684 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:00:59.691728  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:59.698592  1536 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.699771  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.655442  6009 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:59.677682  6134 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:59.703545  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:59.704998  1544 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:59.708304  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 110351us
I20260709 13:00:59.703668  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:59.708719  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 171504us
I20260709 13:00:59.715037  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.676244  5881 consensus_queue.cc:1059] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:00:59.683046  6117 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:59.716411  2273 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:00:59.718538  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:00:59.721771  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:00:59.701586  6120 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:59.718865  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:59.679884  5879 consensus_queue.cc:1059] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:00:59.739810  1690 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:59.736913  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.741068  1687 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.743561  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:00:59.742444  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:00:59.746568  1692 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.724431  6117 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.756625  1694 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 7: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:00:59.754626  5593 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:59.770936  2270 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:59.758350  1443 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 9 to 12, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:00:59.772825  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:59.777437  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:00:59.800969  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 77157.9us
I20260709 13:00:59.770601  5593 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:59.812863  5593 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.813143  1443 catalog_manager.cc:5697] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 2 to 7, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.755807  6100 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.818212  1536 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:00:59.818778  5674 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:59.819195  5674 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:59.819522  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 345) took 19969 ms (client timeout 15000 ms). Trace:
I20260709 13:00:59.758610  5881 raft_consensus.cc:2764] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:00:59.819571  5674 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.830967  1692 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
W20260709 13:00:59.837909  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.823772  1443 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 3 to 10, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:59.822422  6146 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:00:59.844515  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:00:59.798480  6132 raft_consensus.cc:3055] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:59.821834  5924 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.821708  5842 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:59.878027  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 156304us
I20260709 13:00:59.831980  5621 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:59.752519  6120 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:00:59.859506  1443 catalog_manager.cc:5697] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 4 to 5, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.869314  5593 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:59.754849  6050 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:00:59.874800  6065 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.876734  2271 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:59.892174  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.892510  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 184034us
W20260709 13:00:59.820142  1439 rpcz_store.cc:269] 0709 13:00:39.893812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.989443 (+ 95631us) service_pool.cc:224] Handling call
0709 13:00:59.819260 (+19829817us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:50.115519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:50.116117 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:50.116159 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:00:50.116177 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:50.119081 (+  2904us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:50.119190 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:50.119215 (+    25us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:00:50.121129 (+  1914us) tablet.cc:701] Row locks acquired
0709 13:00:50.121173 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:00:50.121403 (+   230us) write_op.cc:270] Start()
0709 13:00:50.121527 (+   124us) write_op.cc:276] Timestamp: P: 1783602050121331 usec, L: 0
0709 13:00:50.121563 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:00:50.122403 (+   840us) log.cc:844] Serialized 9848 byte log entry
0709 13:00:50.475598 (+353195us) op_driver.cc:464] REPLICATION: finished
0709 13:00:50.476692 (+  1094us) write_op.cc:301] APPLY: starting
0709 13:00:50.476805 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:50.477923 (+  1118us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:50.477994 (+    71us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:50.480002 (+  2008us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:50.480478 (+   476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=50
0709 13:00:50.480538 (+    60us) write_op.cc:312] APPLY: finished
0709 13:00:50.481048 (+   510us) log.cc:844] Serialized 170 byte log entry
0709 13:00:50.481852 (+   804us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:50.482483 (+   631us) write_op.cc:454] Released schema lock
0709 13:00:50.491942 (+  9459us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:50.517616 (+ 25674us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:50.517656 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73240,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":872,"apply.run_cpu_time_us":5199,"apply.run_wall_time_us":36386,"num_ops":25,"prepare.queue_time_us":17895,"prepare.run_cpu_time_us":90942,"prepare.run_wall_time_us":284014,"raft.queue_time_us":26887,"raft.run_cpu_time_us":783,"raft.run_wall_time_us":1553,"replication_time_us":353885,"thread_start_us":314502,"threads_started":4,"wal-append.queue_time_us":304041,"wal-append.run_cpu_time_us":28234,"wal-append.run_wall_time_us":1074028}]]}
I20260709 13:00:59.883810  4765 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:59.875085  6053 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:00:59.888101  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 251421us
I20260709 13:00:59.918715  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:00:59.923138  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:00:59.929134  1691 raft_consensus.cc:2410] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:59.861037  6132 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:00:59.936630  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 175397us
I20260709 13:00:59.884012  5621 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:00:59.942427  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:00:59.952100  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 48623.3us
I20260709 13:00:59.954334  1510 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:00:59.955013  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.958456  2243 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:00:59.964704  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.970086  2272 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:00:59.978066  5860 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.978730  5860 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:59.954370  5621 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.979882  5593 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:00:59.894357  5924 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:00:59.951705  5879 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:59.917411  6065 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:00:59.937979  5942 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:00:59.961401  5898 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:00.006697  1536 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:00.007395  6053 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:00.008973  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 54334.7us
I20260709 13:00:59.993825  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:00:59.997044  5881 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:59.981635  6112 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:00.043237  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:00.005525  5879 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:00.043865  1614 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.057227  1544 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:00.059461  5835 raft_consensus.cc:3055] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:00.059880  5835 raft_consensus.cc:740] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:00.060768  5835 consensus_queue.cc:260] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.061782  5835 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:00.067286  6154 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:01:00.067894  5992 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:00.032526  5881 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:00.067329  6153 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:01:00.112877  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.096606  1687 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:00.012182  6132 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.125208  6070 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.125799  6070 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:00.126886  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 172623us
I20260709 13:01:00.127952  6070 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.128264  1510 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:00.129356  6012 consensus_queue.cc:1059] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:00.130815  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.132938  5879 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:00.133882  6049 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.134171  2270 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:00.130385  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:00.139328  2241 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:00.140376  5879 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:00.140604  5835 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.140924  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:00.141899  6041 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:00.142382  6041 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:00.143359  6041 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:00.145864  2275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 1063) took 3298 ms (client timeout 2148 ms). Trace:
W20260709 13:01:00.146258  5921 consensus_meta.cc:287] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.004s
W20260709 13:01:00.146538  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.146694  2269 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:00.148007  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 177565us
W20260709 13:01:00.148185  6148 log.cc:927] Time spent T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
I20260709 13:01:00.148707  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:00.146297  2275 rpcz_store.cc:269] 0709 13:00:56.847142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.850758 (+  3616us) service_pool.cc:224] Handling call
0709 13:01:00.145652 (+3294894us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54004da654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:00.145778 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5589210880}
I20260709 13:01:00.149534  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:00.150615  6100 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:00.151101  6100 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:00.151194  1585 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:00.151516  6100 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.130422  6012 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:00.152765  5941 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:00.152957  6076 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:00.153177  5941 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:00.153404  6076 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.153678  5941 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.153812  6076 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.152798  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.157367  1544 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:00.157598  5861 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:00.159093  6143 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:01:00.160252  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 1091) took 1012 ms. Trace:
I20260709 13:01:00.161093  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.162961  1536 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.160560  2268 rpcz_store.cc:276] 0709 13:00:59.147323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.147559 (+   236us) service_pool.cc:224] Handling call
0709 13:00:59.147857 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.148273 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.148302 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.148843 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.562754 (+413911us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:59.562804 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.563442 (+   638us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.159971 (+596529us) raft_consensus.cc:1685] finished
0709 13:01:00.159989 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.160104 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1363,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":161,"thread_start_us":413498,"threads_started":1,"wal-append.queue_time_us":622727}
W20260709 13:01:00.163306  6157 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:01:00.079046  5881 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.150462  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:00.142584  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:01:00.168107  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.168512  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:00.169811  2241 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:00.173779  2273 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:01:00.164324  6150 log.cc:927] Time spent T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:01:00.178917  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.178650  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:00.186447  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.066656  6096 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.221s
I20260709 13:01:00.140949  5879 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:00.173955  6049 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:00.196115  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:00.193779  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 119129us
I20260709 13:01:00.196810  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.198693  1687 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:00.200212  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:00.192440  6098 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:00.200482  1686 raft_consensus.cc:1240] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:00.200820  1539 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.202396  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:00.183840  5656 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.205556  1544 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:01:00.235543  1691 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:00.075132  6120 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.146658  5921 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.180253  6070 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:01:00.252101  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:00.201100  6049 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.267277  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:00.268064  2273 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.183560  5861 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:01:00.230213  5992 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:00.268067  2272 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:01:00.274231  1614 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:00.242866  5898 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:00.288631  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.292891  2275 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:00.244462  6065 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:00.271876  6049 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.274923  5992 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:00.312953  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.313109  1660 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:00.301029  2273 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:00.283269  5860 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.308673  5924 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.315876  5992 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:00.333557  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:00.334076  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 183686us
I20260709 13:01:00.343700  5921 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.344286  5921 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.344738  5921 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.311285  5879 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.347481  5882 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.347973  5882 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.346699  6009 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:00.350989  1539 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:00.339849  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:00.359454  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.318176  6122 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:00.312183  6065 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:00.372782  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:00.349171  6126 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:00.350946  6096 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.383491  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:00.379055  6053 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:00.372411  5688 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:00.346135  5674 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:00.390542  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 96254.2us
I20260709 13:01:00.393559  2241 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:00.397131  2276 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:00.385601  6117 consensus_meta.cc:287] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 13:01:00.380817  5861 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.379755  6168 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.408098  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:00.408803  1539 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.411304  6179 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:00.411422  5688 raft_consensus.cc:697] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:00.411791  6179 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.411958  5882 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:00.412161  6179 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.412326  5688 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.413522  5882 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:00.387800  6053 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.389663  5921 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:00.419256  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 66338.9us
I20260709 13:01:00.420760  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:00.421502  2272 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:00.377496  6122 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.424609  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:00.428890  2276 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:00.418511  6053 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.414847  6168 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.407263  6117 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:00.389333  6096 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:00.410387  5861 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.439441  6177 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:00.440865  5861 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.442998  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:00.447232  6172 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:01:00.420271  5684 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:00.448519  5684 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:00.448848  5684 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:00.426605  5921 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:00.456158  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:00.468087  6165 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:01:00.476639  6134 raft_consensus.cc:3055] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:00.477094  6134 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:00.479285  6134 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.480542  6134 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.483489  5941 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:00.485546  5941 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.492276  6168 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:00.496237  5883 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:00.498558  6166 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.140s	user 0.001s	sys 0.001s
I20260709 13:01:00.503808  5593 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:00.504187  5593 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.504496  5593 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.504923  5881 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.505417  6117 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.505734  6187 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:00.506848  6100 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:00.461658  5921 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:00.509608  5921 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.511214  5968 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:00.511561  5968 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:01:00.508787  6155 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.369s	user 0.004s	sys 0.000s
I20260709 13:01:00.512248  5968 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:00.513639  5968 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.452898  5621 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:00.508810  6100 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.508824  6096 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.515654  5621 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.460455  5861 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.523051  5861 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.527659  1613 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.532727  6076 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.535012  1612 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:00.539120  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.539539  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.547497  1619 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:00.548432  6177 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:00.521250  6050 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.455678  6053 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:00.565388  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.556258  1539 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:01:00.572952  1614 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:00.592420  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.611653  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:00.612617  2275 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:00.561395  6076 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:00.565900  6050 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:00.683781  6098 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:00.593660  6179 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:00.721434  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 265302us
I20260709 13:01:00.724967  1614 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:01:00.725409  1614 pending_rounds.cc:85] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 8
I20260709 13:01:00.732499  1614 pending_rounds.cc:107] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:01:00.732788  1614 raft_consensus.cc:2889] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.734436  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:00.736073  1616 raft_consensus.cc:1240] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:01:00.722949  5921 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.746542  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.748863  1616 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:00.749019  1691 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:00.750702  1686 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:00.742482  6053 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.742568  6126 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.752331  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.758559  6126 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.759995  6179 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:00.762905  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.764637  1686 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:00.734025  5593 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.763767  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:00.743203  5992 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.765164  1613 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:00.767575  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:00.770233  1686 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:00.752436  5921 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.772692  6196 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:00.774152  5921 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.779330  6050 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:00.779974  6126 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:00.781141  1613 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:00.744809  6098 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.784934  1686 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:00.784476  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:00.788931  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:00.792136  6076 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:00.797550  6076 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.797582  6182 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:00.798838  6049 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.799919  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:00.805444  5881 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.797488  6177 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.807832  5992 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:00.815259  1686 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:00.812194  5883 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:00.815995  1616 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.816483  1620 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:01:00.816820  1620 pending_rounds.cc:85] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 5
I20260709 13:01:00.817062  1620 pending_rounds.cc:107] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:01:00.817299  1620 raft_consensus.cc:2889] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.818004  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.821444  2268 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:00.823402  1691 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:00.823794  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:00.824549  6182 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:00.824795  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.825158  6182 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:00.826426  1694 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:00.827163  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.827342  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.827800  1689 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:00.827941  1690 raft_consensus.cc:2393] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:00.828488  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.828578  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:00.829463  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.829967  1689 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:00.830983  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:00.831037  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.832149  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.833030  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.833545  5882 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:00.833932  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:00.834520  1687 raft_consensus.cc:2368] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10.
I20260709 13:01:00.835027  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:00.835245  1690 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:00.835330  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.835181  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.837960  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.842033  1688 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:00.835028  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.843359  1694 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 7.
I20260709 13:01:00.848898  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:00.849841  1686 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:00.853524  1620 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:00.814877  6177 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.853777  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:00.853353  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 53539.4us
I20260709 13:01:00.853333  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.860893  1691 raft_consensus.cc:2410] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:01:00.859194  1694 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:00.835153  6049 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.862778  1685 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:00.855676  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.866547  1617 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:00.867162  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:00.867913  1687 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:00.869181  1689 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:00.864074  6126 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.855208  5674 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:00.881628  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.872172  1660 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:00.880155  5593 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:00.883376  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:00.887203  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:00.887594  6132 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.888336  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:00.889133  5992 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.889799  5992 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.890411  5992 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.891204  6182 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.891328  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:00.892877  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:00.893715  5593 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:00.894207  5593 raft_consensus.cc:697] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:00.892843  6126 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.896067  5593 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.897914  6126 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:00.900302  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:00.901162  2276 raft_consensus.cc:2410] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:00.902215  1584 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:00.902756  6151 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.763s	user 0.006s	sys 0.001s
I20260709 13:01:00.902928  2276 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:01:00.902983  5883 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:00.904158  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:00.904934  5883 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.906140  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:00.906878  5883 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:00.907297  5883 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:00.907747  6167 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:00.908543  6112 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:00.908149  5883 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:00.910715  5898 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:00.911332  5898 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.912955  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:00.913715  6182 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:00.914184  6182 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:00.915026  6182 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:00.921792  6184 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.445s	user 0.000s	sys 0.005s
I20260709 13:01:00.949875  1620 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:00.967263  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.968828  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:00.971197  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 99121.5us
I20260709 13:01:00.971640  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:00.972193  1619 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.973909  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:00.976030  1611 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:00.972209  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:00.977566  1620 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.988830  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:00.981755  6126 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.983949  5992 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:00.990931  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:00.995410  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:00.994810  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1902) took 1575 ms. Trace:
I20260709 13:01:00.998241  1613 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:00.998493  6132 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:00.996166  1693 rpcz_store.cc:276] 0709 13:00:59.419862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.485086 (+ 65224us) service_pool.cc:224] Handling call
0709 13:00:59.485389 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.485794 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.485829 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.486285 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.681040 (+194755us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:59.681085 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.681168 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.902076 (+1220908us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:00.993048 (+ 90972us) raft_consensus.cc:1685] finished
0709 13:01:00.993076 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.994754 (+  1678us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1110,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":555908480,"thread_start_us":194349,"threads_started":1,"wal-append.queue_time_us":652660}
W20260709 13:01:01.004698  6171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.010s	sys 0.011s
W20260709 13:01:01.005091  6171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.010s	sys 0.012s
I20260709 13:01:01.004889  6132 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:00.996029  5919 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.985673  6167 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:01:00.993544  5992 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.006457  1619 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:01:01.018810  1660 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:01.023978  6017 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:01.024101  6050 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:01.024500  6017 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:01.024739  6050 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.024775  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:01.025339  6050 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.025573  6017 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.026804  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:01.028359  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:01.028424  5883 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:01.029171  6076 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.029870  6076 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:01.030154  5593 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.030372  5883 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:01.030848  5883 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:01.031653  5883 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.032763  5883 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.034986  6076 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:01.036026  6076 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.021961  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:01.016135  5992 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.034507  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:01.024443  6199 log.cc:927] Time spent T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:01:01.039740  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:01.041323  1619 raft_consensus.cc:2393] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:01.040357  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:01.044549  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:01.045933  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1130) took 1143 ms. Trace:
I20260709 13:01:01.046257  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:01.046299  2270 rpcz_store.cc:276] 0709 13:00:59.902547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.906467 (+  3920us) service_pool.cc:224] Handling call
0709 13:01:00.133874 (+227407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.134546 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.043636 (+909090us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54008d13d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:01.045880 (+  2244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449434880}
I20260709 13:01:01.039347  6112 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.048038  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:01.051755  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:01.052120  1618 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:01.054324  2243 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:01.056432  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:01.058547  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:01.066025  1511 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:01.060735  6012 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.039554  6132 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.047628  6120 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:01.048653  5674 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:01.049117  6167 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:01.068040  6012 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:01.096808  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:01.101075  1615 raft_consensus.cc:1275] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:01:01.102942  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:01.061549  6098 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:01.059744  5924 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.108361  1618 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:01.109241  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:01.108196  1615 pending_rounds.cc:85] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 6
W20260709 13:01:01.109774  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.110935  1615 pending_rounds.cc:107] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 7.7
W20260709 13:01:01.110124  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 51685.2us
I20260709 13:01:01.111224  1615 raft_consensus.cc:2889] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.052556  6112 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.051318  6134 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:01:01.061133  5881 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:01:01.112007  6106 consensus_queue.cc:1059] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:01:01.112018  6098 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.119022  6098 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.111984  5879 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:01.109915  6012 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.112488  5924 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:01.101361  5968 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:01.061820  5919 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:01:01.136545  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:01.115648  6202 log.cc:927] Time spent T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:01.122870  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:01.138924  1618 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.125392  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:01.126268  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:01.143970  1611 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
W20260709 13:01:01.126464  6149 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.955s	user 0.000s	sys 0.007s
I20260709 13:01:01.128901  6177 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:01.130287  1620 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
W20260709 13:01:01.133291  6152 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.973s	user 0.000s	sys 0.016s
I20260709 13:01:01.135440  5861 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:01.135921  6106 raft_consensus.cc:3055] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:01.174633  1620 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:01.150934  1612 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:01.151031  2243 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:01.117837  5674 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:01.106635  6120 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.184939  1611 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:01.122478  5924 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.120329  6167 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 13:01:01.178527  6199 log.cc:927] Time spent T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:01.175370  6134 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:01.211809  1613 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:01.212133  6212 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:01.212517  6212 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:01.213228  6212 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.207152  6134 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:01.214929  6134 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.215863  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1132) took 1048 ms. Trace:
I20260709 13:01:01.216141  6134 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.216246  2268 rpcz_store.cc:276] 0709 13:01:00.167082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.167413 (+   331us) service_pool.cc:224] Handling call
0709 13:01:00.179315 (+ 11902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.822851 (+643536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.215621 (+392770us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54005de8d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:01.215812 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476034816}
I20260709 13:01:01.217866  6197 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:01.218241  6197 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:01.175122  6106 raft_consensus.cc:740] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:01.219213  6197 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.220054  6120 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:01.220531  6197 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.220410  6106 consensus_queue.cc:260] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.221731  6106 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.203059  5881 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:01:01.226749  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 112567us
I20260709 13:01:01.229900  5919 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:01.230736  5919 consensus_queue.cc:1243] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:01.231312  5919 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:01.257800  1618 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:01:01.267279  6120 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:01.268005  6120 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.277514  6112 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:01.284176  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 51688.2us
I20260709 13:01:01.285084  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:01.203291  6053 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:01.214215  6050 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.270432  6120 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:01.322449  5879 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:01:01.341794  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 231857us
I20260709 13:01:01.326052  6053 raft_consensus.cc:697] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:01.321090  5968 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:01:01.280934  5898 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:01.348073  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.281121  5992 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.353961  1511 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:01.358299  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 73315.8us
I20260709 13:01:01.360097  1660 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:01.352280  6041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.019s	sys 0.016s
I20260709 13:01:01.348807  5919 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.365753  1619 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:01.358697  6134 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:01.366808  6041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.019s	sys 0.016s
I20260709 13:01:01.375936  1511 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:01.380415  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.359118  5674 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:01.353516  6112 consensus_queue.cc:1048] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:01:01.389647  1585 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:01.393530  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.394065  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.394418  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.399339  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:01.400436  1542 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:01.403373  1539 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:01.385634  6134 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.390923  6215 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.371820  6012 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.398763  6182 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:01.416925  1537 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:01.411190  1542 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:01.401510  5919 raft_consensus.cc:3055] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:01.411785  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.407668  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:01.398918  5593 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:01:01.415144  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.407070  6041 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:01.408699  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 47544.3us
W20260709 13:01:01.412935  6178 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.008s	sys 0.035s
W20260709 13:01:01.425115  6178 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.008s	sys 0.036s
I20260709 13:01:01.425192  2268 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:01.427561  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:01.428062  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:01.428252  1615 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:01:01.429370  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:01.431700  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.432332  1511 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:01.410722  6134 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.435433  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:01.435523  1539 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:01.439043  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:01.439742  1689 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.410975  6221 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.449535  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:01.441329  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:01.450359  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:01.450501  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:01.453927  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:01.449858  2241 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:01.454432  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:01.419729  6182 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.455127  1691 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:01:01.456363  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:01.463470  6164 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 1.324s	user 0.000s	sys 0.015s
I20260709 13:01:01.467522  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:01.467890  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:01.416752  6215 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.420481  5919 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:01.418744  6214 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:01.430544  6041 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:01.386929  5879 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.478729  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.400877  6053 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.449309  6221 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.481527  1539 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:01.480926  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.484545  1544 raft_consensus.cc:2410] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:01.485615  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:01.488360  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.488907  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:01.489933  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:01.482846  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:01.491972  1536 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:01.468640  6182 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.493151  1537 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:01.476506  6191 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:01.494621  1540 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:01.480507  6041 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.503262  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.480816  6229 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:01.515515  1689 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:01:01.506793  5684 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.520210  5684 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.522868  6191 raft_consensus.cc:697] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:01.523228  2272 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:01.523882  6191 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.525945  5919 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:01.527146  6213 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:01:01.527590  6112 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:01.527964  6112 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:01.528342  6112 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:01.528470  6216 log.cc:927] Time spent T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:01:01.527103  5919 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.486449  6221 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.515206  6120 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.564567  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.566316  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:01.567061  1541 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:01.567463  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.555233  5898 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:01.481091  5674 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:01.586141  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:01.558307  6229 raft_consensus.cc:697] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:01:01.582427  6217 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:01:01.596038  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 163755us
I20260709 13:01:01.595119  2271 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:01.597434  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:01.598018  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:01.599262  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:01.599498  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:01.600945  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:01.601404  1688 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.604044  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:01.604573  1690 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:01.605939  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.606885  2274 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:01:01.607208  2274 pending_rounds.cc:85] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 8
I20260709 13:01:01.607399  2274 pending_rounds.cc:107] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:01:01.607596  2274 raft_consensus.cc:2889] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.609316  1687 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:01:01.609730  1687 pending_rounds.cc:85] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 7
I20260709 13:01:01.609201  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:01.610039  1687 pending_rounds.cc:107] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:01:01.610288  1687 raft_consensus.cc:2889] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.610484  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:01.585984  6196 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.613867  2275 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:01.616791  1688 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:01.617295  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:01.617909  1691 raft_consensus.cc:2368] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8.
I20260709 13:01:01.596038  6227 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.617753  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:01.667414  1611 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.570489  6120 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.654721  6196 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.609771  6012 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:01.692993  1541 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:01.618294  5593 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:01:01.654095  6228 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.665117  1688 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:01.606295  6222 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:01.694626  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.690827  5898 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.696292  5688 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:01.705686  1691 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:01.608407  6214 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:01:01.713382  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.714473  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 244169us
I20260709 13:01:01.704457  5898 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.697337  6227 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:01.710110  6098 consensus_meta.cc:287] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.001s
I20260709 13:01:01.723047  1510 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:01.724118  1660 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:01.722818  6230 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:01:01.724172  5924 consensus_meta.cc:287] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.001s
I20260709 13:01:01.716300  6215 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:01.715626  6178 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:01.705297  6228 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:01.731398  6207 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.625s	user 0.013s	sys 0.007s
W20260709 13:01:01.791951  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 46169.5us
W20260709 13:01:01.730751  6106 consensus_meta.cc:287] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:01:01.728331  6242 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:01.795004  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 49487.4us
I20260709 13:01:01.737900  6122 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:01.727020  6241 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:01.706107  6222 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:01.795122  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 87372.7us
I20260709 13:01:01.800972  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:01.794351  6248 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.796715  6237 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:01:01.805452  6243 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:01:01.747476  6238 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.736791  6098 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.820312  1541 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:01.785238  6041 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.744059  6196 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:01.811280  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.747363  5924 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:01.824314  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 208010us
I20260709 13:01:01.734563  6182 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.802799  6242 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:01.807884  6239 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.831164  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:01.831257  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:01.803375  6215 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:01:01.836531  2269 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:01.824349  6122 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:01.853231  1614 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:01.854837  1538 raft_consensus.cc:2393] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:01.855386  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:01.854754  1615 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:01.857000  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:01.858127  6233 consensus_queue.cc:1059] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:01:01.821357  6238 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.858907  6232 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.859055  6233 raft_consensus.cc:3055] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:01.859405  6233 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:01.859534  6228 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:01.859436  6232 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.860204  6238 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:01.860409  6233 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.802063  6245 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:01:01.837397  6235 log.cc:927] Time spent T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:01:01.862602  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:01.881999  2274 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:01.746330  6229 consensus_queue.cc:237] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.878417  1545 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:01.880115  1536 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:01:01.837945  6236 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:01.835116  6253 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.836229  6242 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.861749  6233 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.835255  5898 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:01.868125  6218 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.378s	user 0.001s	sys 0.000s
I20260709 13:01:01.866271  6212 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.805619  6241 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.807734  6248 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.887768  5688 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.887274  6126 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:01.818472  6214 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:01.838902  6106 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 13:01:01.918222  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 113267us
I20260709 13:01:01.893810  6120 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:01.907722  1541 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:01.838639  6249 consensus_queue.cc:1059] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:01:01.896162  6228 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:01:01.918723  6223 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.939314  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:01.942674  6258 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.923501  6126 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:01.952610  1611 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:01.959425  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.960157  1536 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:01.962766  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:01.964798  6254 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.965291  6254 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.967401  6254 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:01.898411  6253 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.974907  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:01.932826  5688 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.963426  1617 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 16.
I20260709 13:01:01.982811  1541 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:01.988763  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:01.990391  1612 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:01.983109  5924 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:01.956014  6258 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:01.970544  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:01.991292  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 57260.9us
I20260709 13:01:01.995261  1611 raft_consensus.cc:2393] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:01.891937  6134 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.048012  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.054684  1691 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.055943  1690 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:02.059959  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2260) took 1204 ms. Trace:
I20260709 13:01:01.975160  6225 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:01.998600  6098 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.067988  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:01.950034  6223 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.000512  6232 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.084478  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:01:02.067890  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 88738.1us
W20260709 13:01:02.081024  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 280104us
I20260709 13:01:02.083482  1687 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:01.996569  5684 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:01:02.088510  1690 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.058552  6182 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.090965  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.087461  1659 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:02.097088  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.097848  1687 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:02.060658  1616 rpcz_store.cc:276] 0709 13:01:00.845211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.845339 (+   128us) service_pool.cc:224] Handling call
0709 13:01:00.854616 (+  9277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.854857 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:00.943334 (+ 88477us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.048702 (+105368us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.804997 (+756295us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b1800061f60. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:01:01.900886 (+ 95889us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b1800061f60. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb5455 00007f29ebd9d060 00007f29ebdaf716 00007f29ebdc0287 00007f29ebdc0208
0709 13:01:02.049553 (+148667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.049613 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:02.049669 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.049740 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.049868 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":869,"prepare.queue_time_us":135664,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":5271,"raft.queue_time_us":15677,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":7138,"spinlock_wait_cycles":32176256,"thread_start_us":306376,"threads_started":3,"wal-append.queue_time_us":164229}
W20260709 13:01:02.099859  6259 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:01:02.100194  6258 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.072219  6264 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:02.103474  1691 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:01:02.106747  1509 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.110796  1509 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:01.999660  6126 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.113183  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.115664  1690 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:01:02.118505  1687 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:01:02.120437  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.121227  1690 raft_consensus.cc:2393] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:02.105579  6232 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.122094  1694 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:02.154199  6214 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:02.094619  6227 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.156258  6214 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:02.156733  6214 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:02.157826  6134 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.117909  6249 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:02.158557  6261 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:01:02.113063  6258 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:02.156281  6248 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.159834  6258 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:02.156366  6263 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:01:02.160320  6258 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.162073  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.163163  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.163228  1691 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:02.163746  1690 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:02.164527  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.165448  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:02.166404  5593 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:02.112917  5688 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.166484  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:02.167570  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:02.164599  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.168951  1690 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:02.170097  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.170830  1687 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.111931  6098 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.119958  6265 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.159507  6270 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.122057  6260 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.166843  5593 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:02.183290  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:02.186369  1544 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:02.237133  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:02.187605  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.245486  1690 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:02.173936  6126 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.187235  1584 leader_election.cc:400] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8.
I20260709 13:01:02.251500  1584 leader_election.cc:403] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:01:02.255096  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 267330us
W20260709 13:01:02.259096  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 148324us
I20260709 13:01:02.188927  5593 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.180876  5882 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:02.257951  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:02.286393  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:02.112461  6264 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.289114  2275 raft_consensus.cc:2393] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:02.286592  1687 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:02.175207  6248 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:01:02.259932  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:02.292011  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.293395  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.294153  1687 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.293958  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:02.294857  2272 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:02.250136  5898 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.179744  6098 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.254424  6255 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 7. Current term is 8.
I20260709 13:01:02.300984  2273 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:02.301319  6274 consensus_queue.cc:1175] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e12d7b3551014757ba7dda3e83605b83" responder_term: 11 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:02.317054  6240 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:02.306751  6112 consensus_meta.cc:287] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.778s	user 0.011s	sys 0.000s
I20260709 13:01:02.306664  6248 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:02.323101  6248 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.325132  6248 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.307266  1509 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.307920  1687 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:02.186925  6260 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.329007  6260 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:02.329064  1510 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:02.329586  6248 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.330099  6248 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.183091  6265 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.332149  6248 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.332583  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:02.333145  1616 raft_consensus.cc:3060] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.333500  6265 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:02.334547  6221 consensus_meta.cc:287] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.776s	user 0.006s	sys 0.005s
I20260709 13:01:02.335196  1611 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:02.334944  6221 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:02.337025  6221 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:02.337805  1689 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:01:02.308745  5919 consensus_meta.cc:287] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.003s
I20260709 13:01:02.290589  5968 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.338812  1658 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:02.285445  6228 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:02.340678  6229 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:02.344931  6273 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:02.345643  6266 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:02.345881  6260 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:01:02.346120  6266 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.343721  6265 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:02.317420  6240 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:02.344165  2274 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:01:02.352665  1692 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:02.365461  5879 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:02.366106  5879 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:02.370901  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 85612.9us
I20260709 13:01:02.370383  5879 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.371843  6264 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.371892  1509 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:02.374577  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.378324  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.376989  6260 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.383445  6260 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.387636  6260 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:02.396353  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.398548  5835 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.399195  5835 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.400270  1509 leader_election.cc:400] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10.
I20260709 13:01:02.400717  1509 leader_election.cc:403] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:02.402850  5674 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:02.403792  5835 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.349771  6228 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.404867  5674 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10.
I20260709 13:01:02.381191  5879 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:02.410844  6233 consensus_meta.cc:287] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
W20260709 13:01:02.413190  6242 consensus_meta.cc:287] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.000s
I20260709 13:01:02.402406  1509 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.413693  6242 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.319079  5898 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.416810  5898 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:02.343289  5968 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.418026  5879 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.420320  5593 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.421859  5968 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.423027  5593 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.431236  6098 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.340613  6112 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.434502  1545 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:02.433862  6112 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.439687  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.442103  1509 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.443084  6112 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:02.447261  6207 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.014s	sys 0.063s
I20260709 13:01:02.451617  1616 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:02.459574  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.461231  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:02.464016  1509 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.465478  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.364699  6253 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.475608  2241 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:02.483249  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:02.484263  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.180771  6270 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.492880  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:02.460166  5674 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:02.456301  5968 consensus_queue.cc:1059] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:01:02.449873  5879 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:01:02.511615  5879 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:02.511440  6214 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:02.476992  6273 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:02.478966  5835 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:02.513342  6273 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.513689  6273 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.477280  6229 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:02.499305  5593 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.517666  6205 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 1.415s	user 0.007s	sys 0.005s
I20260709 13:01:02.517376  5593 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.517622  1686 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:02.519760  5593 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.524596  6253 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.525183  6253 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:02.527575  6253 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:02.530537  5835 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:02.531454  5835 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:02.530530  6281 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:02.532181  6281 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:02.532549  6281 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.536005  5835 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:02.536816  5835 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.537361  5835 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:02.541752  6249 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.494205  6191 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:02.499526  6240 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.543553  6281 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.549252  6258 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.555882  6191 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.580871  5674 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.581224  6191 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.581463  5879 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.582034  5879 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:02.583141  6276 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:01:02.584098  5879 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.584601  6240 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:02.585302  6232 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.581475  5674 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.588841  5674 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.588874  6242 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.589828  6273 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.590209  6214 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.591562  1541 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:02.592296  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2694) took 1549 ms. Trace:
I20260709 13:01:02.595971  6281 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.592711  1619 rpcz_store.cc:276] 0709 13:01:01.042443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.042559 (+   116us) service_pool.cc:224] Handling call
0709 13:01:01.046081 (+  3522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.367658 (+321577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.592054 (+1224396us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540036d154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:02.592226 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734541056}
I20260709 13:01:02.581382  6229 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.599943  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 422013us
W20260709 13:01:02.601796  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 108960us
I20260709 13:01:02.605821  1659 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:02.608379  1688 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:02.616992  1659 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:02.617602  1619 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:02.617975  6212 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.614228  6112 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:02.607470  6282 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.621043  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:02.602895  6281 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.622627  2276 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:01:02.626936  6281 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.629060  6281 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:02.629525  6281 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.618881  6167 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:01:02.629940  6281 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.630384  6120 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:02.631002  6120 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:02.602880  5882 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:02.622154  6282 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.624267  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:02.636361  1616 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.624992  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:02.608207  6049 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:02.598003  5835 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.626438  6223 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.636855  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1918) took 1039 ms. Trace:
I20260709 13:01:02.625545  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:02.637601  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 172182us
I20260709 13:01:02.637913  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:02.615882  6126 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:02.640537  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:02.604305  5593 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:01:02.604242  6132 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:02.644021  1686 rpcz_store.cc:276] 0709 13:01:01.597675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.597796 (+   121us) service_pool.cc:224] Handling call
0709 13:01:02.636658 (+1038862us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540010a9d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:02.636787 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945386752}
I20260709 13:01:02.660216  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.660913  5882 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.661458  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.603039  6229 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.662914  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.663691  6229 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:02.663753  1509 connection.cc:256] RPC call timeout handler was delayed by -1.1360647980000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:01:02.655550  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:02.615598  5881 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:01:02.645241  6049 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.669485  6049 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.663441  1686 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:02.671341  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.671872  1686 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.647809  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.649747  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.649899  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:02.673026  1689 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:01:02.651613  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.652778  6050 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.652691  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.654878  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 1120) took 1059 ms. Trace:
I20260709 13:01:02.683144  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.632668  6270 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.657095  5835 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.657600  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.689023  1691 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.659127  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.689981  1694 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 16.
I20260709 13:01:02.641954  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2704) took 1044 ms. Trace:
I20260709 13:01:02.692203  1686 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:01:02.693310  1544 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:02.674110  1688 raft_consensus.cc:2376] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8. Re-sending same reply.
I20260709 13:01:02.632109  6120 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.655534  6132 consensus_queue.cc:1243] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer e2a2b76c98ee44ff95e6508c34da0e3d log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:02.753569  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.686753  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.754417  1688 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:02.754863  1689 raft_consensus.cc:2368] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11.
I20260709 13:01:02.755877  1689 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:02.683089  2269 rpcz_store.cc:276] 0709 13:01:01.595376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.595474 (+    98us) service_pool.cc:224] Handling call
0709 13:01:01.595750 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.840887 (+245137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.654658 (+813771us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400660154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:02.654824 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553309440}
I20260709 13:01:02.687708  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.693265  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.690917  1613 rpcz_store.cc:276] 0709 13:01:01.597079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.597354 (+   275us) service_pool.cc:224] Handling call
0709 13:01:01.606058 (+  8704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.606773 (+   715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.606807 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.330864 (+724057us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b2c00010828. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 13:01:02.331218 (+   354us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.557404 (+226186us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:02.557433 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.557508 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.633724 (+ 76216us) raft_consensus.cc:1685] finished
0709 13:01:02.633746 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.641877 (+  8131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":341,"raft.queue_time_us":456,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":17831,"spinlock_wait_cycles":11784448,"thread_start_us":225208,"threads_started":1,"wal-append.queue_time_us":268579}
I20260709 13:01:02.699317  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:02.674391  1616 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:02.758411  1686 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:01:02.763667  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.765282  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 77644us
I20260709 13:01:02.766491  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.767210  1686 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.768165  1584 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:02.770859  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:02.655483  6282 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.775321  1693 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:02.777581  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:02.772534  1685 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:02.774422  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:02.686519  5593 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.775194  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.776968  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:02.780277  1694 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:02.778400  1542 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
W20260709 13:01:02.781608  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.785223  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:02.785936  1544 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:02.697853  6233 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:02.803462  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:02.791590  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:02.792029  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:02.808626  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.810873  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:02.811650  1694 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
W20260709 13:01:02.812894  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 191183us
I20260709 13:01:02.775835  6076 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:02.776404  6049 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.814452  1693 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:01:02.818621  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.788015  6120 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.809713  1685 raft_consensus.cc:3060] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:02.786839  1686 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:01:02.669965  6191 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.788239  6239 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:02.815912  2243 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:02.806285  6233 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:02.787859  6255 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:02.783073  2269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:40644
I20260709 13:01:02.865696  1685 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:02.813019  6282 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:02.826792  6126 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.817883  6226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.310s	user 0.031s	sys 0.047s
I20260709 13:01:02.783852  6196 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.792092  1691 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:02.868446  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:02.860155  2269 raft_consensus.cc:606] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:02.874091  1544 raft_consensus.cc:2468] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:02.887019  6299 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:02.888724  6299 raft_consensus.cc:2804] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:02.889307  6299 raft_consensus.cc:697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:02.823436  6041 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.827371  6258 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.830428  6239 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.891463  1685 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:01:02.860366  6233 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.895048  2241 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:02.875521  6255 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:02.822980  6049 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.895498  6282 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.883397  6226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.378s	user 0.031s	sys 0.048s
I20260709 13:01:02.874346  5835 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:01:02.894727  6239 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.875726  6300 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:02.962666  6245 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.963203  6289 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:02.963307  6245 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.965613  6245 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.901998  6041 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:02.882582  6126 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.966205  6270 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:02.990851  6270 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:02.982419  6196 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:02.993395  6196 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.996328  6258 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.996801  6258 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:02.998677  6258 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.999635  6126 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:02.896245  5921 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:01:02.952395  6299 consensus_queue.cc:237] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.004194  5921 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:03.005730  5921 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:03.006135  5921 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.012043  6049 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:02.982791  1584 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.894s (SENT) [suppressed 28 similar messages]
I20260709 13:01:03.006526  5921 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:03.033823  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.036777  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.983049  6281 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:02.983717  6041 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:02.951625  6282 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:03.035610  6297 log.cc:927] Time spent T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:01:03.040199  6305 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:03.043140  6041 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.992343  6255 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.097507  6239 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.083825  6076 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.109727  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 126957us
I20260709 13:01:03.104473  6191 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:03.084467  6305 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.120150  6240 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:03.127516  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:03.130324  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:03.129480  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.132097  1691 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:03.126801  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 310907us
I20260709 13:01:03.133561  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.135020  1542 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:03.136772  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.138069  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.138790  1613 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:03.119077  6076 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:03.139635  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1912) took 1659 ms. Trace:
I20260709 13:01:03.141206  6076 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:03.139986  1539 rpcz_store.cc:276] 0709 13:01:01.480475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.484455 (+  3980us) service_pool.cc:224] Handling call
0709 13:01:01.484737 (+   282us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:01.714159 (+229422us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:01.895791 (+181632us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.104521 (+208730us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.111875 (+  7354us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.112898 (+  1023us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:02.149510 (+ 36612us) log.cc:844] Serialized 52 byte log entry
0709 13:01:02.149681 (+   171us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:02.149859 (+   178us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.174540 (+ 24681us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.175459 (+   919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.175527 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.302578 (+127051us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b1800423400. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:01:02.656357 (+353779us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b1800423400. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:01:03.027902 (+371545us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b1800423400. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:01:03.139448 (+111546us) raft_consensus.cc:1685] finished
0709 13:01:03.139468 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.139586 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68085,"prepare.queue_time_us":567419,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":147,"raft.queue_time_us":177233,"raft.run_cpu_time_us":523,"raft.run_wall_time_us":26176,"spinlock_wait_cycles":33095808,"thread_start_us":548656,"threads_started":3,"wal-append.queue_time_us":305175}
I20260709 13:01:03.143111  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.145004  2275 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:03.145979  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:03.146191  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.147055  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:03.147745  2270 raft_consensus.cc:2410] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:03.139115  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1915) took 1544 ms. Trace:
I20260709 13:01:03.151191  2268 raft_consensus.cc:2393] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:03.148751  1692 rpcz_store.cc:276] 0709 13:01:01.594248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.594368 (+   120us) service_pool.cc:224] Handling call
0709 13:01:03.138972 (+1544604us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54000b13d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:03.139067 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689521408}
I20260709 13:01:03.177816  1692 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:03.153618  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.181193  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.182116  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.183938  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:03.184509  1611 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:03.185250  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.186012  1612 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:03.186345  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.128789  6245 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.196233  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.184019  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.188179  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.202972  1613 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:03.203130  1544 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 8.
I20260709 13:01:03.188882  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:03.190208  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:03.190557  6112 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:03.190769  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.207739  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:03.208099  1614 raft_consensus.cc:2393] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:01:03.207934  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 312867us
I20260709 13:01:03.180922  6292 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:03.192435  6214 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:03.193041  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.192952  6233 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:03.194092  6284 raft_consensus.cc:3055] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:03.195266  6308 log.cc:927] Time spent T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:03.196091  6239 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.196688  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.217761  1693 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:03.217839  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.197335  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.198956  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.199251  2243 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:03.209578  6214 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:03.199956  6302 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
I20260709 13:01:03.200351  6282 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:03.205087  2268 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:03.202272  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.187062  1616 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
W20260709 13:01:03.191548  6307 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:03.209079  1536 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:01:03.238873  1536 pending_rounds.cc:85] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 7
I20260709 13:01:03.214056  6292 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:03.209784  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.209980  2241 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:03.245535  1619 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:03.211594  6284 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:03.213351  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.250976  1537 raft_consensus.cc:1240] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:03.251098  1692 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:03.215855  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.252434  1686 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:03.216419  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.131672  6240 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:03.225368  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.273357  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.239219  1536 pending_rounds.cc:107] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:01:03.274013  1536 raft_consensus.cc:2889] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:03.209739  1691 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:01:03.241428  2243 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.243664  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:03.216156  5882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.011s	sys 0.010s
I20260709 13:01:03.213156  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.279619  1542 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:01:03.253808  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.280773  1686 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:03.257494  6222 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.258730  5992 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.259467  6233 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:03.261620  6292 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.238997  6244 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:03.263958  6284 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.258595  5656 raft_consensus.cc:2804] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:03.269074  5921 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.271505  6305 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:03.271847  6132 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:03.225147  6214 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:03.272552  6258 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.209225  6245 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.287053  6313 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:03.287645  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 1918) took 1679 ms (client timeout 2112 ms). Trace:
W20260709 13:01:03.288586  5882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.011s	sys 0.011s
W20260709 13:01:03.297039  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.302656  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:03.337121  1544 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:03.294059  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:03.291595  6282 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.293490  6244 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.334061  2276 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:01:03.329699  1538 rpcz_store.cc:269] 0709 13:01:01.571454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.571619 (+   165us) service_pool.cc:224] Handling call
0709 13:01:03.250370 (+1678751us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540025dad4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:03.250553 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593516800}
I20260709 13:01:03.342757  1542 raft_consensus.cc:2393] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:03.328670  6284 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:03.356900  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.329113  5992 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:03.329382  6313 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:01:03.366955  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 228596us
I20260709 13:01:03.354749  6244 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:03.403321  2273 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:03.328047  6132 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:03.385185  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 231603us
I20260709 13:01:03.333436  6258 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.364355  6300 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:03.389667  6240 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:03.410957  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.416637  1691 raft_consensus.cc:1217] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Deduplicated request from leader. Original: 6.7->[8.8-9.9]   Dedup: 8.8->[9.9-9.9]
I20260709 13:01:03.416786  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.417178  1691 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:01:03.417481  1689 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:03.403614  6313 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.396502  1544 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:03.399376  1686 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:03.405231  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:03.408396  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.429601  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.407666  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:03.459335  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.459620  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.460044  1692 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:03.461905  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.462495  1686 raft_consensus.cc:2376] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10. Re-sending same reply.
I20260709 13:01:03.460150  2271 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:03.466606  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.467217  1538 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:03.468168  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.468755  1544 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:03.470786  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.403514  5992 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:03.484681  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:03.486438  1538 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:03.409060  6041 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:03.474411  6320 log.cc:927] Time spent T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:01:03.500502  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:03.510696  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.414948  6300 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.513722  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:03.527143  2277 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:03.515913  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:03.516942  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.528606  2272 raft_consensus.cc:2410] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:03.529561  2268 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:03.523312  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.530287  1692 raft_consensus.cc:2376] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10. Re-sending same reply.
I20260709 13:01:03.524103  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:03.531771  2271 raft_consensus.cc:2393] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:03.533147  1544 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:03.535723  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 123682us
I20260709 13:01:03.538740  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.550567  1691 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:03.555315  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.519586  5921 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:03.521329  6240 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.526449  5656 raft_consensus.cc:697] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:03.577188  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.574121  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.578894  1691 raft_consensus.cc:2393] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:03.581503  1692 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:03.558182  6222 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:03.580597  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 64374us
W20260709 13:01:03.579665  6311 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:01:03.596553  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 188940us
I20260709 13:01:03.599326  2272 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:03.589450  6319 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:01:03.586932  6222 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:03.609964  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.607261  6219 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:03.576732  6240 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:03.627321  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.629011  6323 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:01:03.631448  6076 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:03.631937  2243 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:03.633526  2243 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.611013  6339 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:01:03.635406  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.634369  2243 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.608935  6322 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:03.651293  6322 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.651938  2277 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:03.653841  1613 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:01:03.657199  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 49492us
I20260709 13:01:03.668200  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.668771  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:03.669641  1616 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.668956  1619 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:01:03.616151  6222 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:03.640056  6318 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:01:03.653231  6179 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:03.695250  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 158711us
I20260709 13:01:03.670800  6053 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:03.670578  5921 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:03.669883  6258 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.636821  5656 consensus_queue.cc:237] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.614622  6239 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:01:03.672230  6132 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.702586  1616 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:03.702061  1511 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.682909  6245 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.631963  6076 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:03.703634  6053 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.703536  5921 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.703264  5992 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:03.719488  6333 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:03.700788  6339 consensus_queue.cc:1059] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:01:03.727087  6041 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:03.700819  5924 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:01:03.728807  6240 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:03.734232  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.735503  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:03.736243  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.736716  6300 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:03.737612  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.739675  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.740780  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:01:03.742365  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 45525.2us
I20260709 13:01:03.742882  6338 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:03.742974  6337 consensus_queue.cc:1059] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:03.743851  5924 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:01:03.744122  6306 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.737s	user 0.000s	sys 0.001s
I20260709 13:01:03.744415  6339 raft_consensus.cc:3055] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:03.802286  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.745762  6017 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.773416  6313 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.748857  2275 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:03.749396  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.752794  6322 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.753383  2273 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:03.753670  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.814284  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.706169  6335 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:01:03.774269  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.819010  1687 raft_consensus.cc:2393] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:03.774617  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.816483  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:03.775074  6281 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:03.807679  6284 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:03.820322  6281 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:03.804051  5924 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:03.820638  6284 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:03.821213  6281 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.822261  6281 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.822962  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.823643  1619 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:03.821244  5924 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.825449  5924 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:03.775914  6076 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:03.778689  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:03.827188  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 48579.2us
I20260709 13:01:03.778733  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.828397  1545 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:03.829253  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.780004  1544 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:03.831408  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.831950  1544 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:03.818642  6294 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:01:03.832882  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.833945  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.758507  6214 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:03.834851  6126 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:03.835407  6126 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:03.836387  6214 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:03.836768  6301 log.cc:927] Time spent T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.854s	user 0.000s	sys 0.013s
I20260709 13:01:03.807158  6233 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.836563  6126 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.837555  6233 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.839134  6266 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.839452  6233 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.782612  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f61c89956d24976b4d464550172cd55"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:03.840221  1538 raft_consensus.cc:606] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:03.840548  1538 raft_consensus.cc:614] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:03.785252  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.798760  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.806370  1611 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:03.841354  1689 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:03.746196  1685 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:03.808298  1691 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:01:03.718253  6053 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.807256  5992 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.814131  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.760726  6241 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:03.814843  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.801800  6339 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:03.788838  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.830356  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:03.841348  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 74663.5us
I20260709 13:01:03.849388  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.851287  1658 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:03.851493  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.843624  6179 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:03.840627  6270 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:03.848178  2276 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:03.805305  6338 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:03.860962  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.862522  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.863790  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.865370  1544 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:01:03.846164  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:03.788211  5921 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:03.873977  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.859253  1687 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:03.850206  6182 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:03.848089  6294 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:03.872279  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:03.856627  6282 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:03.844834  6284 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:03.867159  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.858251  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.875077  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:03.897324  1540 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:03.870754  6299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.000s	sys 0.032s
I20260709 13:01:03.876650  6076 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:03.850365  6070 consensus_queue.cc:1059] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:01:03.878953  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.879184  6339 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.880324  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:03.880856  6310 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.770s	user 0.000s	sys 0.002s
I20260709 13:01:03.881006  5656 raft_consensus.cc:2764] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:03.866827  6248 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:03.872874  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:03.892268  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.918619  1611 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:01:03.918941  1611 pending_rounds.cc:85] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 8
I20260709 13:01:03.919070  1611 pending_rounds.cc:107] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:03.856216  6254 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:03.898804  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 63785.6us
I20260709 13:01:03.900329  1616 raft_consensus.cc:2393] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:03.847400  5992 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.903718  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.921490  1545 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 17: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:03.904726  1538 raft_consensus.cc:2410] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:03.921904  1509 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:03.922214  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 49377.6us
W20260709 13:01:03.899567  6299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.000s	sys 0.032s
I20260709 13:01:03.905864  6339 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.907734  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.907923  6240 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:03.910965  6294 raft_consensus.cc:3055] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:03.930075  6294 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:03.931118  5992 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.930951  6294 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.925534  6070 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:03.932019  6070 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:03.932150  6294 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.932881  6070 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.888425  6182 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:03.920203  6254 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.934894  6182 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.934964  6254 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.935935  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.936506  1538 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:03.937296  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:03.937624  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.894098  6233 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:03.943092  6246 raft_consensus.cc:3055] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:03.943048  6240 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:03.943622  6246 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:03.944478  6246 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:03.945143  6240 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.925397  6241 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:03.919199  1611 raft_consensus.cc:2889] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:03.946382  1614 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:03.920567  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.947656  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.948158  1687 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:03.923384  1509 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:03.949364  1509 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:03.917701  1540 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:03.951020  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:03.951785  1540 raft_consensus.cc:2410] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:03.952003  6313 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:03.952244  6273 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.952817  6273 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:03.953315  6273 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:03.923683  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:03.953663  6273 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.926972  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:03.954005  6273 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:03.954228  1545 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.954391  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:03.928501  6228 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:03.883162  6338 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:03.937738  1538 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:03.945654  6246 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:03.950094  1509 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:03.957755  1687 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
I20260709 13:01:03.953516  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 909) took 2144 ms. Trace:
I20260709 13:01:03.958276  2241 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:03.958644  1537 rpcz_store.cc:276] 0709 13:01:01.809553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.836806 (+ 27253us) service_pool.cc:224] Handling call
0709 13:01:03.250664 (+1413858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.251559 (+   895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.953348 (+701789us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540025dad0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:03.953464 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3250411776}
I20260709 13:01:03.953455  1540 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:01:03.911962  1619 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:03.922784  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.962072  1545 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:03.957310  2243 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.917224  6248 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:03.973196  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.974241  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.974964  1692 raft_consensus.cc:2376] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10. Re-sending same reply.
I20260709 13:01:03.975600  1540 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:03.977187  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.978793  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:03.979511  1694 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:03.981207  2277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:40644
I20260709 13:01:03.981956  2277 raft_consensus.cc:606] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:03.982335  2277 raft_consensus.cc:614] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:03.982960  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.983342  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.984097  2275 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:03.984828  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:03.985983  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:03.987126  6249 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:03.967168  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.989517  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:03.989826  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:03.990056  1619 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.990216  2243 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:03.991300  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:03.992182  1509 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:03.993147  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.989377  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:03.998188  2241 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:04.001194  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:04.002522  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.003692  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.004525  1620 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:04.006297  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:03.965947  6244 consensus_meta.cc:287] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.006s
I20260709 13:01:04.016816  1537 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:04.018162  1509 leader_election.cc:400] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11.
I20260709 13:01:04.019017  1509 leader_election.cc:403] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:03.964255  5656 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:03.967996  6270 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:04.085086  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 57115.3us
I20260709 13:01:04.086099  1614 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:03.988576  6248 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:04.054773  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.072772  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2730) took 1405 ms. Trace:
I20260709 13:01:04.073933  1616 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:04.072541  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:04.024819  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:04.093633  1688 rpcz_store.cc:276] 0709 13:01:02.667710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.770892 (+103182us) service_pool.cc:224] Handling call
0709 13:01:02.771177 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.771489 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.771525 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.808795 (+ 37270us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.101375 (+292580us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:03.101433 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.101533 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.880150 (+778617us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:04.021706 (+141556us) raft_consensus.cc:1685] finished
0709 13:01:04.021733 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.072710 (+ 50977us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18440960,"thread_start_us":219310,"threads_started":1,"wal-append.queue_time_us":255903}
I20260709 13:01:04.082790  1612 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:03.987876  6313 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:04.087317  1509 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:04.087376  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 59785.5us
I20260709 13:01:04.020306  6214 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:04.087329  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.112316  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:04.026227  1617 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:04.089463  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.113667  1620 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:04.000239  6281 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:04.013907  6300 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:03.970873  6132 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:04.103369  1509 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:04.105031  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:04.106789  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:03.950183  6182 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.075759  6191 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:04.085484  5835 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:04.141742  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.987654  6249 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.129961  1619 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:04.025223  6299 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.135174  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.004000  6315 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:01:04.209607  1618 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:04.015271  6335 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:04.013732  5861 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:01:04.140497  6219 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:04.138413  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2270) took 1964 ms. Trace:
I20260709 13:01:04.140525  6334 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.101964  6287 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:01:04.141523  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:04.090873  5881 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:03.987911  6177 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:01:04.108856  6346 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11.
I20260709 13:01:04.153095  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:04.072237  6245 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:01:04.208158  1620 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:04.134092  1612 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:01:04.210028  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.310546  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:04.212090  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.120584  6270 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 15 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:04.145984  5835 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.072665  6185 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:04.133633  6132 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:04.214280  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.324148  1619 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:01:04.031999  6244 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.217607  1541 rpcz_store.cc:276] 0709 13:01:02.173629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.174014 (+   385us) service_pool.cc:224] Handling call
0709 13:01:02.183215 (+  9201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.592268 (+409053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.138196 (+1545928us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400281c54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:04.138356 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938601344}
I20260709 13:01:04.101630  6337 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:01:04.140825  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:04.165786  6307 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:04.150590  5656 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:04.333523  5656 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:04.333922  5656 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.334267  6293 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.334800  6293 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.087069  6196 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:04.307904  1538 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:04.311394  1620 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:01:04.348519  1540 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:04.318831  1614 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:01:04.320326  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 167271us
I20260709 13:01:04.349135  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:04.207489  6299 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:04.142186  6345 consensus_queue.cc:1059] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.200s
I20260709 13:01:04.347874  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:04.360977  1541 raft_consensus.cc:2393] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:04.319710  6335 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.349984  1538 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:04.151516  6191 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.354233  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:04.355014  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.321008  5835 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:04.359822  1617 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:01:04.350018  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.327241  6132 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.365928  1613 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 17: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:04.368034  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:04.370966  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 1908) took 2869 ms (client timeout 2190 ms). Trace:
W20260709 13:01:04.439747  1543 rpcz_store.cc:269] 0709 13:01:01.479386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.479775 (+   389us) service_pool.cc:224] Handling call
0709 13:01:04.328929 (+2849154us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54002c1354. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:04.348475 (+ 19546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1840051968}
I20260709 13:01:04.332113  6070 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:04.440984  5921 consensus_meta.cc:287] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.002s
I20260709 13:01:04.441075  6070 raft_consensus.cc:697] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:01:04.441529  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.441628  5921 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.442265  6070 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.373426  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:04.444132  1538 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
W20260709 13:01:04.374321  2274 consensus_meta.cc:287] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 13:01:04.444916  2274 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:04.309799  6312 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:01:04.289878  6053 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.447240  6053 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:04.362113  6222 consensus_meta.cc:287] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.002s
I20260709 13:01:04.448110  6222 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.450201  6222 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:04.359606  6299 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:04.453606  6360 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
W20260709 13:01:04.456880  6363 log.cc:927] Time spent T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:01:04.459964  6244 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:04.462983  1691 raft_consensus.cc:2368] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 13. Current term is 14.
W20260709 13:01:04.466663  6357 log.cc:927] Time spent T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 13:01:04.468405  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 924) took 1068 ms. Trace:
W20260709 13:01:04.469136  6356 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:01:04.468731  1542 rpcz_store.cc:276] 0709 13:01:03.400226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.400331 (+   105us) service_pool.cc:224] Handling call
0709 13:01:03.411762 (+ 11431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.521435 (+109673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.521464 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.554595 (+ 33131us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.785473 (+230878us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b18004d1280. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb9450d1 00007f29ebd60a0f
0709 13:01:03.917022 (+131549us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:03.964944 (+ 47922us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.020851 (+ 55907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.020957 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.468137 (+447180us) raft_consensus.cc:1685] finished
0709 13:01:04.468232 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.468355 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61349,"prepare.queue_time_us":47656,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":7900,"raft.queue_time_us":234157,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":2449,"spinlock_wait_cycles":146299904,"thread_start_us":240595,"threads_started":2,"wal-append.queue_time_us":507503}
I20260709 13:01:04.470208  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:04.382789  1688 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:04.383519  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:04.385622  6239 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.389878  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.391467  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:04.366803  6350 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.445s	user 0.000s	sys 0.001s
I20260709 13:01:04.314898  5881 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.346922  6293 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:04.480377  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:04.481536  2272 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:01:04.481928  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 55156.4us
I20260709 13:01:04.357527  6126 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.405886  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.427790  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:04.435452  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 83957.4us
I20260709 13:01:04.346983  6185 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:01:04.357026  6353 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
I20260709 13:01:04.356869  5924 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:04.352614  6366 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:04.474398  2275 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:04.470679  1615 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:04.361111  6214 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:01:04.478497  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.503799  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.436177  6049 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:04.499743  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:04.472244  6355 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
I20260709 13:01:04.486240  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.510607  1691 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:04.510732  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.511111  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.511750  1620 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:04.507099  2277 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:04.511943  1693 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:04.504622  1614 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:04.392875  6335 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.483233  6219 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:01:04.526465  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.000s
I20260709 13:01:04.499562  6293 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.526758  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.010s	sys 0.000s
W20260709 13:01:04.513357  1690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.024s
I20260709 13:01:04.505841  6053 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.532354  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:04.530143  1690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.012s	sys 0.024s
I20260709 13:01:04.530221  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.484658  6239 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.516158  6049 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:04.501645  6126 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.535744  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:04.554401  1545 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.534587  6122 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.492842  6270 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.534979  6182 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:04.510996  6366 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.526098  5656 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.565523  1545 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:04.567837  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:04.529819  6293 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:04.574057  6342 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:04.535808  6053 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.576123  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 925) took 1175 ms. Trace:
I20260709 13:01:04.568403  1545 raft_consensus.cc:606] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:04.568272  2241 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:04.580961  1545 raft_consensus.cc:614] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:04.579124  1536 rpcz_store.cc:276] 0709 13:01:03.400489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.400594 (+   105us) service_pool.cc:224] Handling call
0709 13:01:03.400925 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:03.587224 (+186299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.587268 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:03.603803 (+ 16535us) log.cc:844] Serialized 52 byte log entry
0709 13:01:03.788307 (+184504us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:03.788342 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.788406 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.575724 (+787318us) raft_consensus.cc:1685] finished
0709 13:01:04.575750 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.575874 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":184987,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":334968,"threads_started":2,"wal-append.queue_time_us":256261}
I20260709 13:01:04.562321  6249 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:04.575286  6339 consensus_meta.cc:287] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.002s
I20260709 13:01:04.618315  1545 raft_consensus.cc:1275] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:04.623348  5881 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:04.624110  2277 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:04.627044  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:04.630035  2241 leader_election.cc:400] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 13. Current term is 14.
I20260709 13:01:04.630342  2241 leader_election.cc:403] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:01:04.630741  6049 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.632557  1690 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:04.633708  6321 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.633813  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:04.639354  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:04.639988  1539 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:04.641345  1685 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:04.634186  6321 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.644678  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:04.647085  5656 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:04.648151  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.651419  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:04.651584  6247 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:04.652005  1539 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.646890  2277 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.645087  6299 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:04.646221  6017 consensus_meta.cc:287] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.831s	user 0.004s	sys 0.004s
W20260709 13:01:04.583986  6361 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 13:01:04.661074  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 224290us
I20260709 13:01:04.656987  2273 raft_consensus.cc:1240] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:04.661132  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 221886us
W20260709 13:01:04.650504  6362 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260709 13:01:04.584168  5898 raft_consensus.cc:2804] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:04.652050  6247 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.684953  1539 raft_consensus.cc:2410] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:04.671756  6076 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:01:04.686609  6126 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:04.687019  5921 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:04.688148  1585 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:04.688848  6182 consensus_queue.cc:1059] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:04.692508  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:04.693261  6244 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:04.662756  6106 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.694700  6373 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:01:04.569145  6185 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.700310  2275 raft_consensus.cc:1240] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:04.678534  6254 consensus_meta.cc:287] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.003s
I20260709 13:01:04.659080  6375 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.694362  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:04.672094  6281 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:01:04.677738  6380 raft_consensus.cc:3055] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:04.684162  6228 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:04.662961  6273 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.000s
I20260709 13:01:04.714586  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:04.708079  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:04.719583  5898 raft_consensus.cc:697] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:04.577873  6219 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.571861  6214 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.722289  2277 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:01:04.695379  6191 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:04.663203  5881 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:01:04.735598  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:04.736853  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:04.745723  1692 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:04.730561  6228 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:04.738106  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:04.748692  1688 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.739192  6239 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:04.741777  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:04.752615  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:04.745621  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:04.751912  2241 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:04.757591  1690 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:04.732896  6076 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:04.759526  2277 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:04.728026  6380 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:04.737293  6367 consensus_queue.cc:1059] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:04.760797  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:04.767870  1690 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:04.714332  6106 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.744279  5921 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:04.743430  5656 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 13. Current term is 14.
I20260709 13:01:04.748018  6335 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:04.755743  6228 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.729012  6254 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.762815  6240 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:04.743141  6017 consensus_queue.cc:1048] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:01:04.783921  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:04.762207  6076 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.730211  6375 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.758379  6366 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:04.763124  6321 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:04.740793  6273 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.816780  1687 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:01:04.794428  6126 raft_consensus.cc:3055] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:04.795640  1688 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:01:04.818110  1542 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:04.800931  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:04.819108  1539 raft_consensus.cc:2410] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:04.804152  2270 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:04.758272  5835 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.785187  5921 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:04.791744  6287 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:04.814303  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:04.827283  1690 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
W20260709 13:01:04.814765  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.810880  6076 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:04.808353  6246 consensus_meta.cc:287] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.000s
I20260709 13:01:04.822589  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:04.812366  6293 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:04.772644  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:04.817739  6126 raft_consensus.cc:740] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:04.831493  6375 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:04.804512  6367 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:01:04.833180  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:04.812824  6240 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:04.812736  6053 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:04.834558  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 142119us
I20260709 13:01:04.861778  1540 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
W20260709 13:01:04.834019  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 145930us
I20260709 13:01:04.864187  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:04.839793  1689 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:04.827625  5921 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:04.825753  6382 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:01:04.865444  6254 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:04.865883  6226 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:04.871421  6226 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:04.871877  6226 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.873792  6226 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:04.866267  2273 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:04.866812  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:04.856626  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 84035.3us
I20260709 13:01:04.829309  6287 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:04.879307  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:04.885304  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:04.886111  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:04.865926  1585 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:04.806202  5898 consensus_queue.cc:237] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.859452  6281 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:04.827961  6132 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:04.901731  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.886972  6287 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.881299  6299 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:04.902815  6182 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:04.915558  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 1131) took 1179 ms. Trace:
I20260709 13:01:04.915900  2276 rpcz_store.cc:276] 0709 13:01:03.733448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.737369 (+  3921us) service_pool.cc:224] Handling call
0709 13:01:04.912832 (+1175463us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b540046e6d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:04.912983 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128814464}
I20260709 13:01:04.899051  6247 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:04.905063  6294 consensus_meta.cc:287] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.972s	user 0.012s	sys 0.000s
I20260709 13:01:04.922008  6293 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:04.910866  6375 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.931928  2271 raft_consensus.cc:2410] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:04.932751  6392 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:04.933195  6392 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:04.933537  6392 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.935473  6196 raft_consensus.cc:3055] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:04.935881  6196 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:04.936712  6196 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.937901  6196 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.938875  6258 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:04.939250  6258 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:04.939937  6258 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.940869  6258 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.944904  6394 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:04.945542  6394 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:04.937152  6386 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:01:04.930181  6182 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:04.955013  6381 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:01:04.955107  6182 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.955778  6182 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:04.957630  6385 log.cc:927] Time spent T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:01:04.961791  6384 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:01:04.962841  6293 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:04.966826  6293 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:04.966862  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:04.914394  6254 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.972584  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.973191  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:04.973805  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.974104  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:04.989945  1616 raft_consensus.cc:2410] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:04.975973  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:04.980847  1692 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:04.971020  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:04.991598  1618 raft_consensus.cc:3060] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.992781  1614 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:04.993320  1614 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:04.992594  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 167492us
I20260709 13:01:04.993607  1620 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:04.994521  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:04.995111  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:04.996419  1658 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:04.881197  6126 consensus_queue.cc:260] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:04.969780  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.007000  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.829500  6380 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.929469  6389 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:04.997126  6334 consensus_meta.cc:287] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.704s	user 0.002s	sys 0.009s
I20260709 13:01:05.022035  1510 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:05.031639  1658 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:05.033026  6391 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:05.033481  6391 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:05.034444  6391 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.997697  1614 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.037072  1614 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.967868  5835 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:05.040305  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.042543  6313 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:05.042701  2243 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:05.043884  6313 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:05.053866  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1949) took 1087 ms. Trace:
I20260709 13:01:05.054363  1689 rpcz_store.cc:276] 0709 13:01:03.966075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.966941 (+   866us) service_pool.cc:224] Handling call
0709 13:01:05.053677 (+1086736us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54001603d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:05.053800 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956035328}
I20260709 13:01:05.056211  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2293) took 1232 ms. Trace:
I20260709 13:01:05.056689  1537 rpcz_store.cc:276] 0709 13:01:03.823415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.084210 (+260795us) service_pool.cc:224] Handling call
0709 13:01:04.084453 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.220651 (+136198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.220695 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:04.220749 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:04.220793 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.055924 (+835131us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400282154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:05.056006 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.056146 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312669056}
W20260709 13:01:05.058863  2270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45390 (request call id 1151) took 1861 ms (client timeout 1858 ms). Trace:
W20260709 13:01:05.059355  2270 rpcz_store.cc:269] 0709 13:01:03.197622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.198753 (+  1131us) service_pool.cc:224] Handling call
0709 13:01:05.058626 (+1859873us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54006504d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:05.058783 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3644939648}
I20260709 13:01:05.069435  6177 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.075186  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 1128) took 1342 ms. Trace:
I20260709 13:01:05.075618  2274 rpcz_store.cc:276] 0709 13:01:03.732564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.735228 (+  2664us) service_pool.cc:224] Handling call
0709 13:01:05.075015 (+1339787us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b540075fb54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:05.075129 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183708544}
I20260709 13:01:05.077770  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 2278) took 1171 ms. Trace:
I20260709 13:01:05.078203  1613 rpcz_store.cc:276] 0709 13:01:03.912635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.920327 (+  7692us) service_pool.cc:224] Handling call
0709 13:01:05.077564 (+1157237us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54003a1454. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:05.077709 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962897280}
I20260709 13:01:05.093503  6106 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:05.070097  6177 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:05.107223  6177 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:05.147117  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 281100us
I20260709 13:01:04.997242  6246 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:05.186090  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 140614us
W20260709 13:01:05.186834  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 141393us
I20260709 13:01:05.017239  6120 raft_consensus.cc:2764] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:05.006237  6293 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.211763  2241 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:05.217882  1618 raft_consensus.cc:2468] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:05.224834  6182 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:05.262454  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 54899.8us
W20260709 13:01:05.281563  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 69890.1us
I20260709 13:01:05.281781  6106 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:05.284394  6106 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:05.285233  6106 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:05.281595  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 78259.3us
I20260709 13:01:05.286454  6315 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:05.286952  6315 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.288015  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:05.288784  6315 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:05.289299  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:05.291932  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:05.292408  1544 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:05.294883  6264 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.295336  6264 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.296291  5656 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:05.296574  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:05.297165  1613 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:05.297413  6300 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:05.296976  5656 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.297830  6300 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.298364  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:05.298898  1536 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:05.299723  6300 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:05.302752  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:05.303956  6315 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:05.307585  6388 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:01:05.308053  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.297233  6264 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:05.308634  2277 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:05.310689  2277 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:05.313838  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:05.314389  1620 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:05.316011  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:05.317322  1544 raft_consensus.cc:2468] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:05.189146  6378 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:05.044404  6313 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:04.930898  6240 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.261384  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:05.023423  6389 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:05.207938  6248 consensus_meta.cc:287] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.099s	user 0.007s	sys 0.005s
I20260709 13:01:05.318854  1510 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:05.317834  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:05.258080  6273 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:04.997071  6254 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:05.045832  6266 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:05.048344  6334 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:05.227480  5921 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.321777  2277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:40644
I20260709 13:01:05.204193  6366 raft_consensus.cc:2804] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:05.202872  6246 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.342659  6313 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.328792  6322 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.382459  6322 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:04.992058  6375 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.211014  6359 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.347800  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:05.321516  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:05.350658  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:05.386348  6294 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:05.353153  2241 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:05.386709  6294 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.387172  6294 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.387236  6359 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.389695  6359 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:05.205533  6335 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.140s
I20260709 13:01:05.259621  6126 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:05.357542  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:05.336407  6378 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:05.258790  6364 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.154s
I20260709 13:01:05.354837  6315 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:05.376549  6366 raft_consensus.cc:697] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:05.347504  6389 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.381584  6246 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.392005  6375 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:05.392409  6070 raft_consensus.cc:2804] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:05.393177  6322 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:05.393357  6132 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:05.355579  1615 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:05.248561  6392 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:05.354610  6371 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:05.199453  1585 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:05.368335  1614 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:05.373253  6053 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.409017  6244 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.004s	sys 0.008s
I20260709 13:01:05.405800  6378 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.353910  6248 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:05.456369  6248 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:05.321645  6293 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:05.457350  6258 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.003s
I20260709 13:01:05.459237  6293 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:05.441975  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.405758  6315 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.460672  6315 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:05.463056  5921 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:05.466933  6366 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:01:05.468209  6285 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:01:05.449116  6244 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.004s	sys 0.009s
I20260709 13:01:05.446102  6070 raft_consensus.cc:697] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:05.472522  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 889) took 1498 ms. Trace:
W20260709 13:01:05.450611  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 251199us
I20260709 13:01:05.476847  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.478106  2270 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:05.473044  1687 rpcz_store.cc:276] 0709 13:01:03.974145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.980160 (+  6015us) service_pool.cc:224] Handling call
0709 13:01:03.980538 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:04.817291 (+836753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.472259 (+654968us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54003502d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:05.472459 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922199808}
I20260709 13:01:05.446113  6371 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:05.447611  6053 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:05.511890  6228 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.000s
I20260709 13:01:05.532313  6228 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.533229  6122 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:05.533849  6122 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.534487  6228 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:05.512014  6254 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:05.506127  6371 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:05.510241  6378 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.513057  6182 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:05.538465  6378 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:05.516716  6287 consensus_meta.cc:287] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.004s
I20260709 13:01:05.539179  6287 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.541401  6287 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:05.541595  5656 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:05.529182  6380 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.482573  6293 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:05.477396  6132 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:05.471405  6070 consensus_queue.cc:237] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.514194  6392 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:05.538292  6294 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:05.481055  6076 consensus_meta.cc:287] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.001s
I20260709 13:01:05.479849  6273 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:05.542831  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.560243  2277 raft_consensus.cc:606] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:05.560643  1584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.086s	sys 0.198s
I20260709 13:01:05.477551  6270 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 13:01:05.560990  1584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.086s	sys 0.198s
I20260709 13:01:05.543556  6053 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:05.544164  6315 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.549383  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45390 (request call id 1156) took 1437 ms. Trace:
W20260709 13:01:05.554975  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 167479us
W20260709 13:01:05.553552  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 274110us
I20260709 13:01:05.562937  2241 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:05.557682  6185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.010s	sys 0.020s
I20260709 13:01:05.562582  2271 rpcz_store.cc:276] 0709 13:01:04.111971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.112085 (+   114us) service_pool.cc:224] Handling call
0709 13:01:05.549151 (+1437066us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54004a5e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:05.549307 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878373120}
I20260709 13:01:05.565047  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:05.565212  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 671561us
I20260709 13:01:05.566644  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:05.556198  6378 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:05.559235  6132 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:05.576439  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:05.560737  6254 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:05.578133  2268 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:05.572613  1658 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:05.591332  1658 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:05.594578  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:05.597584  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:05.598600  1538 raft_consensus.cc:2410] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:05.599057  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:01:05.564924  6185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.011s	sys 0.020s
I20260709 13:01:05.579833  1544 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 15: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:01:05.580335  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 232566us
I20260709 13:01:05.582716  6294 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:05.587648  6378 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.588853  1536 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:05.605630  6182 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:05.555052  6293 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:05.603034  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2726) took 1313 ms. Trace:
I20260709 13:01:05.603477  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.603569  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:05.634140  2270 raft_consensus.cc:2410] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:05.604511  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:05.573808  6364 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.607172  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:05.633600  1617 rpcz_store.cc:276] 0709 13:01:04.289420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.289631 (+   211us) service_pool.cc:224] Handling call
0709 13:01:04.352930 (+ 63299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.380431 (+ 27501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.589076 (+1208645us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b54001a36d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:05.602965 (+ 13889us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85339904}
I20260709 13:01:05.573562  6053 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:05.561048  6076 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.570721  6273 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:05.600906  6266 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.603874  6254 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.601027  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:05.623099  5656 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:01:05.628557  6378 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:05.632315  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.638726  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:05.604346  6240 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:05.624462  6182 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.660194  1543 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:05.659701  6098 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:05.666244  6240 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.642191  6400 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:05.671578  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:05.670701  6240 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:05.686353  6122 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.689440  6122 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:05.692940  6226 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.661053  6132 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:05.697999  6076 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:05.699062  2272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 1129) took 1966 ms (client timeout 1875 ms). Trace:
I20260709 13:01:05.668289  6182 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:05.706077  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.699487  2272 rpcz_store.cc:269] 0709 13:01:03.732890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.736005 (+  3115us) service_pool.cc:224] Handling call
0709 13:01:05.698869 (+1962864us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400881dd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:05.698997 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586893184}
I20260709 13:01:05.692051  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:05.705183  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.710201  2268 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
W20260709 13:01:05.711181  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.712637  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:05.713239  1543 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:05.713739  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:05.715113  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:05.715734  1694 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:05.784621  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:05.785266  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 93282.4us
I20260709 13:01:05.786067  1509 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:05.787053  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:05.787653  1689 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.791512  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:05.670091  6398 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:05.670269  6053 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:05.700800  6417 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:01:05.813803  1689 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:05.815521  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:05.793156  2268 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:05.818451  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:05.819793  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:05.793128  1509 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:05.794302  6335 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:05.796384  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.692184  6400 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:05.700934  6378 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:05.797480  6248 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:05.857733  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1157) took 1745 ms. Trace:
W20260709 13:01:05.855553  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 68552.1us
I20260709 13:01:05.858134  2275 rpcz_store.cc:276] 0709 13:01:04.112226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.511821 (+399595us) service_pool.cc:224] Handling call
0709 13:01:04.529201 (+ 17380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.722572 (+193371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.857532 (+1134960us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540062dc54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:05.857684 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389862144}
I20260709 13:01:05.858593  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.799712  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.800096  6178 raft_consensus.cc:3055] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:05.801009  2273 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:05.801919  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.679452  6098 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:05.851292  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.671494  6392 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:01:05.851883  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:05.854293  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:05.783924  5924 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:01:05.783481  6322 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:01:05.799160  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:05.943060  1618 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.801033  6285 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.947206  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.947871  2272 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:05.859179  2268 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:05.939945  2271 raft_consensus.cc:2410] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:05.860606  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:05.941457  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:05.952768  1690 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:05.785012  6214 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.892104  1692 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:05.893038  1688 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:05.957625  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.850958  6076 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.959175  1584 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:05.812728  6334 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:05.851156  6335 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.960757  2268 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:05.969293  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:05.980660  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:05.980870  1688 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.981243  1692 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:01:05.970620  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:05.971280  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 261729us
I20260709 13:01:05.972163  2275 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:05.783735  6219 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.168s
I20260709 13:01:05.854252  6398 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:06.021224  1614 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.021128  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:05.888715  6178 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:06.020624  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:05.984266  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.005118  1585 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:06.005903  1688 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:06.026984  2276 raft_consensus.cc:2393] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 15: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:05.988884  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:05.991066  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.029152  1620 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:05.947642  6285 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:06.031262  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.035655  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.036609  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.037222  1616 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 17: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:06.037851  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:06.038338  1616 raft_consensus.cc:2376] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11. Re-sending same reply.
I20260709 13:01:06.039043  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:05.851796  6053 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.041344  6053 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.042441  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:05.967710  6282 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.951614  6228 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:01:05.886624  6378 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.043175  1611 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:06.017956  1618 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
W20260709 13:01:06.052250  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.082429  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.043784  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:05.942306  6366 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:01:05.944293  6248 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.025404  6244 consensus_queue.cc:1059] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.127s
I20260709 13:01:05.984171  6334 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.020738  6196 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.221812  1612 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
W20260709 13:01:06.156103  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 362948us
I20260709 13:01:06.029203  6273 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:05.970207  6399 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.226308  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.044065  6285 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.987601  6335 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:06.234329  6415 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 13:01:06.151947  6266 raft_consensus.cc:2764] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:01:06.187523  6322 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.244081  6322 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.244472  6322 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.113248  6282 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.223903  6254 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:06.252652  6282 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.158839  6258 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:06.253542  6258 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.255663  6258 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:06.235860  6399 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.257472  6399 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:05.977345  6214 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.259591  2241 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.260269  6214 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:06.225018  6196 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.261148  6196 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:06.264705  6419 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:01:06.264983  5898 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:06.111353  6246 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.000s
I20260709 13:01:06.265632  6246 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.266932  1687 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 15: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:06.176613  6372 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.268301  6372 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.265632  5898 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:01:06.276209  6098 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.276664  6335 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.278823  6335 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.279613  6335 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.280579  6380 consensus_meta.cc:287] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.001s
W20260709 13:01:06.284138  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 57893.9us
I20260709 13:01:06.103241  6132 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:06.226511  6413 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.562s	user 0.001s	sys 0.000s
I20260709 13:01:06.314188  1511 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:06.187350  6392 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.316743  1542 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:06.316633  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.321161  2270 raft_consensus.cc:3060] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEARNER]: Advancing to term 11
W20260709 13:01:06.284485  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 423899us
W20260709 13:01:06.317474  6182 consensus_meta.cc:287] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.522s	user 0.004s	sys 0.004s
I20260709 13:01:06.270285  6372 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:05.985493  6076 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.324935  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:06.310639  6264 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.311254  6321 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.329358  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:06.331192  5898 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:06.332033  6423 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:06.331856  6299 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:06.320484  6246 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:06.338201  6240 consensus_meta.cc:287] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.651s	user 0.005s	sys 0.001s
W20260709 13:01:06.339490  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 375272us
I20260709 13:01:06.318567  6214 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.339465  5861 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:06.325770  6126 consensus_meta.cc:287] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.931s	user 0.007s	sys 0.003s
I20260709 13:01:06.311506  6273 consensus_queue.cc:1059] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:06.373371  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:06.268076  6398 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.315807  6335 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:01:06.407475  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 181635us
I20260709 13:01:06.410378  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:06.415213  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:06.427636  2270 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:06.372012  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:06.340355  6182 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 13:01:06.432255  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 60600.7us
I20260709 13:01:06.348205  6264 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.440464  1614 raft_consensus.cc:1275] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:06.441833  1612 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:06.442991  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.443734  1611 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:06.362977  6240 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:06.454257  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 449127us
I20260709 13:01:06.343474  1660 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.353227  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:01:06.343688  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 379143us
I20260709 13:01:06.354799  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:06.456511  1687 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 17: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:06.347635  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:06.186142  6178 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.361131  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:06.320685  6019 consensus_queue.cc:1059] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:01:06.325959  6424 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.342371  6228 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:06.362633  5861 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:06.494378  1690 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:06.453413  6070 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:06.376848  6340 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:06.377640  6273 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:06.379742  6076 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.380364  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:06.514735  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 92921.9us
W20260709 13:01:06.515717  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 135387us
I20260709 13:01:06.516487  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:06.383363  6248 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:06.350014  6321 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.383991  6391 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.372570  6214 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.189450  6400 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.544910  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 987) took 1573 ms. Trace:
I20260709 13:01:06.387377  6334 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:06.388089  6427 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:06.379137  1691 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:06.547648  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:06.545349  1615 rpcz_store.cc:276] 0709 13:01:04.971506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.972989 (+  1483us) service_pool.cc:224] Handling call
0709 13:01:06.544745 (+1571756us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54002170d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:06.544858 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849417600}
I20260709 13:01:06.548056  1691 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:06.548358  1541 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:01:06.356389  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:06.475952  1689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.017s	sys 0.033s
I20260709 13:01:06.458086  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:01:06.549661  1689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.018s	sys 0.033s
I20260709 13:01:06.550299  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:06.475369  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:06.550791  2243 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:06.551097  1688 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:06.478101  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 130524us
I20260709 13:01:06.465463  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:06.457808  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 114400us
I20260709 13:01:06.555635  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.556438  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:06.556787  2276 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:01:06.457018  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 106622us
I20260709 13:01:06.458523  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:06.554984  1612 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:06.490762  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:06.558328  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:06.496428  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:06.559128  1611 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.499023  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:06.376169  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:06.456079  6399 raft_consensus.cc:3055] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:06.509997  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40644 (request call id 2) took 1174 ms. Trace:
I20260709 13:01:06.560340  1693 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:06.560552  2277 rpcz_store.cc:276] 0709 13:01:05.320064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.321637 (+  1573us) service_pool.cc:224] Handling call
0709 13:01:06.494276 (+1172639us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540046e6d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd9f853 00007f29f0d6d60a 00007f29ea2f37d4 00007f29ea2f3762 00007f29ea2f3691 00007f29ea2f360c 00007f29ea2f28c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:06.494345 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458023168}
I20260709 13:01:06.521613  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:06.484802  6428 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.487797  6430 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.501024  5861 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.493662  6228 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:06.526430  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:06.528733  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:06.529369  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:06.548079  6389 consensus_meta.cc:287] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.110s	user 0.003s	sys 0.007s
I20260709 13:01:06.529451  6246 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:06.529570  1659 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:06.544981  6053 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:06.537547  6315 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:06.541648  1686 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:06.596451  6450 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:06.601091  6450 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.603523  6450 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:06.604442  6450 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:06.605008  6450 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.605623  6450 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:06.458244  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 487542us
I20260709 13:01:06.607206  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:06.609831  1618 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:06.610049  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.567112  5898 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:01:06.610998  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.512774  6424 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:06.611857  6424 raft_consensus.cc:697] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:06.586248  6389 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.612738  6424 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.558641  1692 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.614805  1614 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:06.561985  2274 raft_consensus.cc:2410] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:06.578392  6427 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:06.556809  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:06.619272  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 62525us
I20260709 13:01:06.619483  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:06.619927  1660 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.554554  2241 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.564136  1688 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
W20260709 13:01:06.565248  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 106795us
I20260709 13:01:06.621601  6076 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:06.513602  6273 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:06.568243  2269 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:06.556037  6106 consensus_queue.cc:1048] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 13:01:06.569425  6444 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:06.569793  6334 raft_consensus.cc:3055] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:06.570386  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:06.570364  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:06.571575  6372 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.571060  1691 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.639115  1611 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:06.641520  1691 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.525575  6322 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.523900  6126 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.566372  6399 raft_consensus.cc:740] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:06.524124  6366 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:06.487408  6392 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:01:06.523698  6070 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:06.545034  6132 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.583570  2243 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:06.660275  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 76768.5us
I20260709 13:01:06.633172  6405 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.661914  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:06.535243  1545 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:01:06.586290  1543 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 15: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:01:06.660272  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 102634us
I20260709 13:01:06.637247  6315 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:06.592337  6390 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.594460  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 64957us
I20260709 13:01:06.595127  6437 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:06.582326  6285 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.595723  6246 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.576848  6430 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.385226  6378 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.582764  6228 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:06.509696  6371 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.974s	user 0.009s	sys 0.001s
I20260709 13:01:06.577692  6239 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.616909  6321 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.620437  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.624280  1688 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:01:06.625006  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 70528.6us
I20260709 13:01:06.626590  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:06.636021  1615 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.597097  6446 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.618535  6427 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.633005  6273 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.647464  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:06.650574  1693 raft_consensus.cc:2393] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 14: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:06.625793  6411 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.658038  1692 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:06.637038  6389 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.662426  1545 pending_rounds.cc:85] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 10
I20260709 13:01:06.593859  6436 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:06.633580  6266 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.638229  6334 raft_consensus.cc:740] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:06.663129  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:06.599541  6053 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.644352  6248 raft_consensus.cc:2764] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:06.676338  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:06.651497  6126 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.659922  6372 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.694182  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.732842  1618 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:06.733975  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.694932  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:06.736022  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:06.737270  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:01:06.696655  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 70123.7us
I20260709 13:01:06.740432  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.703641  1611 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 17: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:06.666544  6335 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.671865  6264 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.675706  6300 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:06.672044  6182 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:06.666642  6132 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:06.729583  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 53328.6us
I20260709 13:01:06.682830  6430 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.685889  6315 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:06.687388  2275 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:06.666114  6312 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:06.707583  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:06.793421  1692 raft_consensus.cc:2410] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:06.695894  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:06.672370  6405 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.744900  1618 raft_consensus.cc:2393] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:01:06.710707  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 44488.2us
I20260709 13:01:06.711547  1545 pending_rounds.cc:107] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:06.715404  6454 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.717085  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:06.717526  6453 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:06.681110  1691 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:06.749861  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:06.785028  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:06.675943  6390 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:06.782127  6449 log.cc:927] Time spent T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:06.689546  6451 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.808642  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:06.808871  1618 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:06.795907  1545 raft_consensus.cc:2889] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:06.796074  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:06.732641  6126 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.810051  1692 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:06.732273  6389 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:06.702909  6427 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.702916  6437 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:06.797065  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.798565  1543 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.718655  6053 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.698768  6446 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:06.829159  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:06.689935  6239 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:06.711500  6258 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.823932  1692 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:06.792884  6312 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.687937  6240 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:06.832250  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:06.696065  6371 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.862104  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:06.862789  1545 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.716532  6196 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.793890  6300 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:06.817204  6389 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:06.846212  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:06.720795  6334 consensus_queue.cc:260] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.706146  6432 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 13:01:06.749557  6372 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.864892  1618 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:06.711906  6294 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:01:06.828475  6437 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:06.877645  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 91579.1us
I20260709 13:01:06.876772  1692 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:06.879554  1688 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.881263   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:06.711477  6399 consensus_queue.cc:260] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.863705  6312 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.724655  6070 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.882036  1537 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:06.891993  6371 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:06.892272  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 950) took 1542 ms (client timeout 1585 ms). Trace:
I20260709 13:01:06.892603  6459 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
W20260709 13:01:06.892755  1537 rpcz_store.cc:269] 0709 13:01:05.349780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.350372 (+   592us) service_pool.cc:224] Handling call
0709 13:01:06.892096 (+1541724us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540014cb54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:06.892210 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3438217472}
I20260709 13:01:06.894095  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:06.896346  1545 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
W20260709 13:01:06.896623  6447 log.cc:927] Time spent T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:01:06.897290  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:06.897789  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:06.832898  6446 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.715396  6436 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.816712  6378 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:01:06.900537  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 89010.5us
I20260709 13:01:06.881574  6240 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.914831  2269 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:06.898350  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:06.917670  1545 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:06.885496  6437 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.892025  6372 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:06.924943  1614 raft_consensus.cc:3055] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:06.812469  6454 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.906173  6285 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.927868  1614 raft_consensus.cc:740] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:06.932041  1614 consensus_queue.cc:260] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.920694  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:06.817617  6453 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:06.945535  6463 log.cc:927] Time spent T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:01:06.945825  6405 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:06.948333  6456 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:01:06.951617  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:06.952893  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 905) took 1063 ms. Trace:
I20260709 13:01:06.953262  1689 rpcz_store.cc:276] 0709 13:01:05.889480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.891027 (+  1547us) service_pool.cc:224] Handling call
0709 13:01:05.891350 (+   323us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:01:06.550161 (+658811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.550201 (+    40us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:01:06.557086 (+  6885us) log.cc:844] Serialized 104 byte log entry
0709 13:01:06.642489 (+ 85403us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:06.665818 (+ 23329us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.672883 (+  7065us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.683433 (+ 10550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.683497 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.952684 (+269187us) raft_consensus.cc:1685] finished
0709 13:01:06.952703 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.952840 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85228,"prepare.queue_time_us":104932,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":5858,"raft.queue_time_us":181436,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":33356,"thread_start_us":663372,"threads_started":2,"wal-append.queue_time_us":213996}
I20260709 13:01:06.960450  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:06.962659  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:06.964787  1689 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.965276  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:06.931501  6399 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.975694  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:06.977010  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:06.888684  6315 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.826180  6451 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:06.980603  6246 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:06.986156  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 245773us
I20260709 13:01:06.964497  6434 raft_consensus.cc:3055] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:06.938551  6372 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:01:06.990661  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.974843  6465 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:01:07.018394  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:06.973515  6228 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 13:01:07.020572  6464 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:01:07.021039  6473 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.021255  6293 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:06.931373  6300 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.027721  1688 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:07.032567  6366 consensus_queue.cc:1059] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:07.033030  6453 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:06.992697  6132 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:07.037384  1660 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:07.040580  1691 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 15: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:01:07.039803  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 323794us
I20260709 13:01:07.017788  6246 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.041466  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:07.042528  6470 consensus_queue.cc:1059] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:01:07.028967  6390 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:07.026274  6258 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.045082  6228 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:07.017627  6434 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:06.989897  6273 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:07.036837  6367 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:01:07.054116  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:07.049695  6436 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:07.053704  1660 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:07.057783  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 944) took 1766 ms. Trace:
I20260709 13:01:07.061643  1542 rpcz_store.cc:276] 0709 13:01:05.290929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.291946 (+  1017us) service_pool.cc:224] Handling call
0709 13:01:05.292204 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.317232 (+1025028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.057548 (+740316us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400354b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:07.057726 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350124416}
I20260709 13:01:07.067327  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:07.041060  6196 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:07.099093  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:07.040975  6239 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:07.111938  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 58321.2us
I20260709 13:01:07.083429  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:07.053455  6394 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:07.121047  5861 consensus_meta.cc:287] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.005s
I20260709 13:01:07.063174  6132 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:07.065809  6258 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:07.123670  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:07.101363  6285 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:07.164214  6285 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:07.165223  6285 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.166038  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:07.167135  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:07.167734  1542 raft_consensus.cc:2393] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:07.168347  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:07.051297  6434 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.162303  5861 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.163012  6436 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.191239  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.255432  6436 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.118484  6246 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:07.251417  6435 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.254240  5861 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:07.199687  6454 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:07.100139  6312 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.264861  1543 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:07.140146  6470 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.113487  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:07.333214  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:07.400755  1688 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:07.339530  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:07.063338  6450 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.376777  1542 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:07.170250  6196 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:07.377220  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.019s	sys 0.046s
I20260709 13:01:07.404775  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:07.405390  6450 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:07.406138  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.019s	sys 0.046s
I20260709 13:01:07.409871  1543 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:07.401881  1612 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:07.405454  1619 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:07.372916  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:07.420147  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 306694us
I20260709 13:01:07.425428  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:07.457839  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:07.458843  6466 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
W20260709 13:01:07.460503  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 340330us
I20260709 13:01:07.462051  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:07.395393  6076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.043s	sys 0.073s
I20260709 13:01:07.377686  6434 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.474192  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:07.371151  6435 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.118235  6478 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.536s
W20260709 13:01:07.468269  6076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.044s	sys 0.073s
I20260709 13:01:07.419273  6436 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:07.461503  6254 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:07.461902  6246 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:07.479611  6391 consensus_meta.cc:287] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.923s	user 0.010s	sys 0.001s
I20260709 13:01:07.469542  6394 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.504566  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:07.498888  1509 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:07.479725  6132 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:07.516652  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:07.524175  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:07.517640  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:07.519673  1613 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:01:07.525444  1613 pending_rounds.cc:85] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 11
I20260709 13:01:07.525766  1613 pending_rounds.cc:107] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:01:07.526074  1613 raft_consensus.cc:2889] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:07.481467  6258 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:07.532498  1619 raft_consensus.cc:2393] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:07.534585  1620 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:01:07.401214  6266 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.018s	sys 0.014s
W20260709 13:01:07.542941  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44135.3us
I20260709 13:01:07.535867  6465 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:07.537410  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:07.538144  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:07.540077  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:07.542098  1541 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:07.541958  1618 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.002s
I20260709 13:01:07.516077  5924 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:07.547886  5924 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.550107  5924 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:07.550808  6402 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.739s	user 0.007s	sys 0.011s
I20260709 13:01:07.552147  6458 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.516454  6405 raft_consensus.cc:3055] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:07.546329  1618 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.000s	sys 0.002s
I20260709 13:01:07.487293  6476 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:07.554266  2274 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 16: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:01:07.533668  6321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.006s	sys 0.022s
I20260709 13:01:07.556100  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:07.461655  6470 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:07.542559  6372 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:07.547891  6474 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.510s	user 0.000s	sys 0.002s
I20260709 13:01:07.561439  1620 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:01:07.568398  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:07.569070  1620 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:07.570214  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:07.546511  6378 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:07.541745  6132 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:07.564281  1541 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:07.564584  6435 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:07.547005  6451 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:07.552831  6458 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.574062  1620 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 15: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:01:07.687371  2241 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.050s	sys 0.099s
W20260709 13:01:07.785753  2241 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.063s	sys 0.113s
I20260709 13:01:07.785971  6258 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:07.786052  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 879674us
I20260709 13:01:07.628726  6471 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:01:07.554626  6465 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:07.561182  6321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.007s	sys 0.023s
W20260709 13:01:07.640674  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.542647  6266 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.018s	sys 0.014s
I20260709 13:01:07.593151  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:07.803682  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:07.804410  1688 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:07.557221  6405 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:01:07.562361  6126 consensus_meta.cc:287] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.000s
W20260709 13:01:07.545429  6427 consensus_meta.cc:287] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.002s
I20260709 13:01:07.772984  6378 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:07.565351  6372 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:07.771152  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1945) took 1025 ms. Trace:
I20260709 13:01:07.813481  1541 rpcz_store.cc:276] 0709 13:01:06.745324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.556734 (+811410us) service_pool.cc:224] Handling call
0709 13:01:07.564068 (+  7334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.770820 (+206752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.771086 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.792503  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1948) took 1046 ms. Trace:
W20260709 13:01:07.795646  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.800690  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:07.816681  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:07.818270  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:07.819176  1620 raft_consensus.cc:2393] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:07.805972  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 917) took 1268 ms. Trace:
I20260709 13:01:07.819608  1685 rpcz_store.cc:276] 0709 13:01:06.537644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.572099 (+ 34455us) service_pool.cc:224] Handling call
0709 13:01:06.572478 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.696475 (+123997us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:06.785329 (+ 88854us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.901086 (+115757us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.901129 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:06.901175 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.805793 (+904618us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400161054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:07.805832 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.805928 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16017,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":3255,"raft.queue_time_us":28726,"spinlock_wait_cycles":284584320,"thread_start_us":188942,"threads_started":2,"wal-append.queue_time_us":248539}
W20260709 13:01:07.821192  6443 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.276s	user 0.004s	sys 0.011s
I20260709 13:01:07.821981  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:07.823199  6132 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:07.828480  6178 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.764786  6426 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.788532  6437 consensus_meta.cc:287] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.850s	user 0.008s	sys 0.010s
W20260709 13:01:07.841063  6446 consensus_meta.cc:287] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.928s	user 0.010s	sys 0.000s
I20260709 13:01:07.840968  6405 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:07.841950  6446 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:07.815584  6126 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:07.843374  1541 raft_consensus.cc:1240] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:07.843817  6446 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:07.844167  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1949) took 1097 ms. Trace:
I20260709 13:01:07.844638  1541 rpcz_store.cc:276] 0709 13:01:06.746372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.830381 (+1084009us) service_pool.cc:224] Handling call
0709 13:01:07.843160 (+ 12779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.843848 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.844082 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.846598  1541 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:07.847354  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1954) took 1063 ms. Trace:
I20260709 13:01:07.847779  1541 rpcz_store.cc:276] 0709 13:01:06.784412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.845504 (+1061092us) service_pool.cc:224] Handling call
0709 13:01:07.846402 (+   898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.847096 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.847299 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.562057  6473 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:07.777719  6430 consensus_meta.cc:287] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.977s	user 0.005s	sys 0.012s
I20260709 13:01:07.822623  1685 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.831924  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:07.806128  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:07.849066  6434 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:07.849088  2276 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:07.850883  6465 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:07.852797  6428 consensus_meta.cc:287] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 1.270s	user 0.007s	sys 0.010s
W20260709 13:01:07.815907  6070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.018s	sys 0.026s
I20260709 13:01:07.844110  6126 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:07.811148  6312 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:07.856906  1541 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:07.813467  6427 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:07.858948  1540 rpcz_store.cc:276] 0709 13:01:06.746102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.775106 (+1029004us) service_pool.cc:224] Handling call
0709 13:01:07.792049 (+ 16943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.792201 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.792225 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.792263 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:07.792291 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.792342 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.792437 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:07.804975  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.003s	sys 0.014s
I20260709 13:01:07.814987  6372 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:07.854559  6399 consensus_meta.cc:287] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.882s	user 0.006s	sys 0.012s
I20260709 13:01:07.863165  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:07.870070  1689 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
W20260709 13:01:07.872191  1511 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.006s	sys 0.015s
I20260709 13:01:07.870901  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:07.903019  1511 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.006s	sys 0.015s
I20260709 13:01:07.903324  1620 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:07.904208  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:07.905184  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:07.903364  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 935738us
I20260709 13:01:07.875705  6246 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:07.875349  6273 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:07.913537  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1955) took 1556 ms. Trace:
I20260709 13:01:07.882439  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1958) took 1019 ms. Trace:
W20260709 13:01:07.920429  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.003s	sys 0.019s
I20260709 13:01:07.920680  1541 rpcz_store.cc:276] 0709 13:01:06.863347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.855862 (+992515us) service_pool.cc:224] Handling call
0709 13:01:07.856517 (+   655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.882170 (+ 25653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.882377 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.857807  6437 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:07.922435  1536 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:07.920470  1690 rpcz_store.cc:276] 0709 13:01:06.357170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.358154 (+   984us) service_pool.cc:224] Handling call
0709 13:01:07.913338 (+1555184us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54003246d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:07.913482 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41776000}
W20260709 13:01:07.861421  6400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.007s	sys 0.018s
W20260709 13:01:07.877316  6070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.018s	sys 0.026s
I20260709 13:01:07.873327  6430 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.878738  6428 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.924173  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 957) took 1300 ms. Trace:
I20260709 13:01:07.930204  1540 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:07.934518  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:07.935782  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:07.924173  1511 leader_election.cc:336] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.504s (SENT)
I20260709 13:01:07.946302  1620 raft_consensus.cc:2368] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11.
I20260709 13:01:07.947127  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:07.925151  1685 raft_consensus.cc:2468] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:07.944434  1615 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:01:07.947595  1620 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:07.945930  1539 rpcz_store.cc:276] 0709 13:01:06.623531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.059083 (+435552us) service_pool.cc:224] Handling call
0709 13:01:07.059416 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.059601 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:07.059898 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.922108 (+862210us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.923882 (+  1774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.923926 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:07.923969 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.924025 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.924122 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1431,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":10252,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":15259,"spinlock_wait_cycles":25783168,"thread_start_us":861637,"threads_started":1}
I20260709 13:01:07.917851  6246 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:07.950634  1509 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:07.933576  6400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.008s	sys 0.019s
I20260709 13:01:07.970080  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:07.875408  6434 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.856935  6426 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:07.976683  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:07.976881  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:07.982138  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:07.970686  6244 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.014s	sys 0.017s
I20260709 13:01:07.989511  1511 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:07.975700  6246 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.881289  6473 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.976402  1687 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:07.988049  2270 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.969983  6126 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.986997  6467 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:07.990490  6244 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.015s	sys 0.017s
I20260709 13:01:07.922369  6378 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:07.986420  1544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.010s	sys 0.013s
I20260709 13:01:07.976454  6446 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.004635  6446 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:07.976258  6273 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.006816  6273 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:08.009207  6273 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:07.975968  6479 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:08.000865  6470 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:08.010008  6479 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.012998  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:07.979445  5924 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 13:01:08.028967  6398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.318s	user 0.002s	sys 0.031s
W20260709 13:01:08.029451  6398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.002s	sys 0.031s
W20260709 13:01:08.030215  1544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.011s	sys 0.014s
I20260709 13:01:07.992344  6432 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:07.992285  6454 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.038170  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:08.038899  1540 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:08.035496  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:08.039678  1620 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:08.036929  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:08.040999  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:08.041221  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:08.042049  6426 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:08.042073  6428 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:08.042898  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:08.043728  1539 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:08.046067  1619 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:08.048867  1690 raft_consensus.cc:2410] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:08.050758  1692 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:08.051453  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1965) took 1404 ms. Trace:
I20260709 13:01:08.051787  1692 rpcz_store.cc:276] 0709 13:01:06.647475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.889724 (+242249us) service_pool.cc:224] Handling call
0709 13:01:08.050365 (+1160641us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b5800003698. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:01:08.050533 (+   168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.051137 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.051377 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11890560}
I20260709 13:01:08.052744  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:08.044245  1694 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 16.
I20260709 13:01:08.053494  1541 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:08.038735  6479 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.036064  6391 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:08.043411  6432 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.059671  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:07.998891  6436 consensus_queue.cc:1059] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:01:08.060842  1692 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:01:08.061313  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.011s	sys 0.035s
I20260709 13:01:08.060091  1694 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:01:08.065340  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.012s	sys 0.035s
I20260709 13:01:08.067086  2241 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:08.062574  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:08.068882  6427 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:08.069322  1620 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:01:08.036474  6126 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:08.064843  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:08.074630  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:08.075145  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:08.075765  1539 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:08.076694  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:08.056224  6428 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:08.062723  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:08.081794  1509 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.564s (SENT) [suppressed 30 similar messages]
I20260709 13:01:08.073577  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:08.077381  1539 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:08.069609  1658 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:08.064149  6432 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:08.084592  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:08.095306  1541 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.096155  1539 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:08.085507  1540 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:08.092357  6258 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:08.092867  6437 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:08.097546  1539 raft_consensus.cc:1240] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:08.087601  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:08.125131  1611 raft_consensus.cc:2410] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:08.132332  1692 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:08.070382  6483 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:08.063555  6391 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:08.140007  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.123476  6434 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:08.142964  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:08.076467  6287 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:01:08.098433  6446 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.146301  1541 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:08.151582  6498 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:08.156975  6334 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.158039  6098 raft_consensus.cc:3055] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:08.069705  6070 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.135439  6483 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.146025  6430 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:08.127521  6427 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:01:08.141350  6437 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:08.150713  6258 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.078262  6185 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:08.187278  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:08.181778  6098 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:08.186661  6483 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.190764  6258 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.188650  6437 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:08.205508  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 125003us
I20260709 13:01:08.194554  6185 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:01:08.201282  6491 log.cc:927] Time spent T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:01:08.207540  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:08.204828  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 960) took 1569 ms. Trace:
I20260709 13:01:08.186455  6070 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:08.216614  6493 log.cc:927] Time spent T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:01:08.217828  6070 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:08.219563  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.180559  6428 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:08.218528  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 964) took 1577 ms. Trace:
I20260709 13:01:08.207470  6437 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:08.221635  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 963) took 1581 ms. Trace:
I20260709 13:01:08.228698  1543 rpcz_store.cc:276] 0709 13:01:06.640765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.416089 (+775324us) service_pool.cc:224] Handling call
0709 13:01:07.416778 (+   689us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:07.484403 (+ 67625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.484432 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:07.499398 (+ 14966us) log.cc:844] Serialized 52 byte log entry
0709 13:01:07.993944 (+494546us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:07.994008 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.994095 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.218276 (+224181us) raft_consensus.cc:1685] finished
0709 13:01:08.218297 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.218475 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69085,"raft.queue_time_us":75800,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":13479,"thread_start_us":446616,"threads_started":1,"wal-append.queue_time_us":546254}
I20260709 13:01:08.211916  2241 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:08.209195  6185 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.233207  6098 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.210335  6473 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.202728  6372 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:08.234635  6497 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:08.210898  1544 rpcz_store.cc:276] 0709 13:01:06.635144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.376523 (+741379us) service_pool.cc:224] Handling call
0709 13:01:07.397677 (+ 21154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.397932 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:07.398269 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.203483 (+805214us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.203747 (+   264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.203807 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:08.203871 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.203950 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.204754 (+   804us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":950,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":5155,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7441,"spinlock_wait_cycles":2226048,"thread_start_us":802349,"threads_started":2,"wal-append.queue_time_us":695589}
I20260709 13:01:08.239863  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:08.229519  1542 rpcz_store.cc:276] 0709 13:01:06.640553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.408216 (+767663us) service_pool.cc:224] Handling call
0709 13:01:07.408637 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.477580 (+ 68943us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:07.477931 (+   351us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.067676 (+589745us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.099948 (+ 32272us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.100081 (+   133us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:08.202555 (+102474us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.202782 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.202853 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.221440 (+ 18587us) raft_consensus.cc:1685] finished
0709 13:01:08.221459 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.221580 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110586,"prepare.queue_time_us":1053,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2812,"raft.queue_time_us":71911,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":15927,"thread_start_us":690298,"threads_started":2,"wal-append.queue_time_us":665438}
I20260709 13:01:08.212834  6287 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.257296  1685 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 15: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:08.242604  6070 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:08.240708  6126 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:08.221261  6246 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:08.267020  6070 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.268093  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 1007) took 2305 ms. Trace:
I20260709 13:01:08.268796  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 919) took 1730 ms. Trace:
I20260709 13:01:08.273900  1687 rpcz_store.cc:276] 0709 13:01:06.538233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.550095 (+ 11862us) service_pool.cc:224] Handling call
0709 13:01:08.268649 (+1718554us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540011b2d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:08.268747 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3277778816}
I20260709 13:01:08.264374  6214 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.272921  6391 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.265877  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 1022) took 1465 ms. Trace:
W20260709 13:01:08.284031  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.360s	user 0.014s	sys 0.037s
W20260709 13:01:08.284317  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.360s	user 0.014s	sys 0.038s
I20260709 13:01:08.285091  6258 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:08.290967  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 51188.6us
I20260709 13:01:08.291994  2241 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:08.292131  6434 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.293133  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:08.293247  6322 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:08.295300  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1971) took 1210 ms. Trace:
I20260709 13:01:08.295651  1689 rpcz_store.cc:276] 0709 13:01:07.085030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.085160 (+   130us) service_pool.cc:224] Handling call
0709 13:01:08.295154 (+1209994us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54001603d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:08.295254 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990738816}
I20260709 13:01:08.296962  1689 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:08.297178  6455 raft_consensus.cc:2804] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:08.297765  6455 raft_consensus.cc:697] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:08.298027  1689 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:08.273684  1617 rpcz_store.cc:276] 0709 13:01:05.962578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.963489 (+   911us) service_pool.cc:224] Handling call
0709 13:01:06.021780 (+ 58291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.022126 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:06.043266 (+ 21140us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.319349 (+276083us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b18003ebf00. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:01:07.636722 (+1317373us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b18003ebf00. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a 00007f29ebdafa2a
0709 13:01:07.995481 (+358759us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.033557 (+ 38076us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.033687 (+   130us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:08.033726 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.033799 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.267907 (+234108us) raft_consensus.cc:1685] finished
0709 13:01:08.267923 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.268030 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44346,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":2499,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":10935,"spinlock_wait_cycles":125394048,"thread_start_us":230653,"threads_started":1,"wal-append.queue_time_us":2095980}
I20260709 13:01:08.298579  6455 consensus_queue.cc:237] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.299759  1617 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:01:08.300319  6489 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.760s	user 0.000s	sys 0.001s
I20260709 13:01:08.301044  1617 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 15 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:08.301800  6287 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:08.302196  6287 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.302511  6287 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:08.277886  1612 rpcz_store.cc:276] 0709 13:01:06.800367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.413966 (+613599us) service_pool.cc:224] Handling call
0709 13:01:07.414288 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:07.486807 (+ 72519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.486837 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:07.499847 (+ 13010us) log.cc:844] Serialized 52 byte log entry
0709 13:01:07.994444 (+494597us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:07.994494 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.265457 (+270963us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b54001711d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:08.265523 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.265569 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:08.265584 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.265818 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3222,"raft.queue_time_us":7708,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":12113,"spinlock_wait_cycles":147532032,"thread_start_us":437534,"threads_started":1,"wal-append.queue_time_us":535977}
I20260709 13:01:08.305644  1687 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:08.278767  6070 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.311702  6287 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.313995  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:08.312799   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:08.263892  6372 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.302515  6446 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:08.342779  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 255192us
I20260709 13:01:08.343598  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:08.348017  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:08.350654  2269 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 17: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:08.325685  6053 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.353585  1659 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:08.358873  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:08.360381  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:08.346076  6446 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:08.260540  6432 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.350220  6471 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:08.362354  1658 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:08.365686  1537 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:01:08.369041  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:08.360517  6372 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:08.378661  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:08.356947  6053 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.375659  6442 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.398026  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1209) took 1843 ms. Trace:
I20260709 13:01:08.398505  6372 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:08.366350  6429 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.377228  6364 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.377365  6473 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:01:08.381172  6406 consensus_queue.cc:1059] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:08.385891  6258 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.387465  6432 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.361974  6454 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:08.398422  2271 rpcz_store.cc:276] 0709 13:01:06.554270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.554376 (+   106us) service_pool.cc:224] Handling call
0709 13:01:06.577447 (+ 23071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.721501 (+144054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.721531 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.721571 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:06.721600 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.397821 (+1676221us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54006f6dd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:08.397862 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.397973 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330802560}
I20260709 13:01:08.399024  5881 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:08.399072  6372 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:08.410146  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:01:08.411547  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 352) took 20152 ms (client timeout 15000 ms). Trace:
I20260709 13:01:08.385668  6437 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.378937  6428 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.473464  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:08.474184  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:08.487365  1689 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:01:08.478134  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 85901.1us
I20260709 13:01:08.490866  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:08.490952  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:08.473285  5881 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:08.483459  6294 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.483098  6258 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.639077  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:08.599296  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:08.587283  1690 raft_consensus.cc:2368] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 16. Current term is 17.
I20260709 13:01:08.485453  6364 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.642877  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.644167  1544 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:08.599229  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:08.649114  1689 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:08.637346  1511 leader_election.cc:336] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.834s (SENT)
I20260709 13:01:08.645586  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:08.650816  1543 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.645952  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:08.640789  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.532136  6391 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.661823  1511 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.858s (SENT)
I20260709 13:01:08.662366  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:08.585481  6428 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.647023  6244 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.700172  6244 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.702209  6244 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.701989  6372 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:08.474854  6483 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:08.734620  6510 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
I20260709 13:01:08.737422  6437 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.469010  6446 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:08.657759  6442 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.657284  6246 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:08.783311  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 121510us
I20260709 13:01:08.726173  6432 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:08.800640  1511 leader_election.cc:336] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.892s (SENT)
W20260709 13:01:08.802007  1511 leader_election.cc:336] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.899s (SENT)
I20260709 13:01:08.802536  1511 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:08.805148  6428 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:08.820286  6518 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:01:08.822340  6185 consensus_meta.cc:287] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 13:01:08.824142  6483 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:08.824759  6483 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.825207  6483 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:08.726711  6391 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.832576  6391 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.647557  6294 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.834967  6294 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:08.835987  6185 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.838560  6185 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:08.740998  6364 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.844411  6364 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.848634  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:08.853008  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:08.657258  6258 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:08.482045  1443 rpcz_store.cc:269] 0709 13:00:48.259335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.267467 (+  8132us) service_pool.cc:224] Handling call
0709 13:01:08.411480 (+20144013us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:00.340396 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:00.459094 (+118698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:00.466831 (+  7737us) write_op.cc:435] Acquired schema lock
0709 13:01:00.466856 (+    25us) tablet.cc:662] Decoding operations
0709 13:01:00.467975 (+  1119us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:00.468059 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:00.468088 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:01:00.469011 (+   923us) tablet.cc:701] Row locks acquired
0709 13:01:00.469069 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:01:00.469236 (+   167us) write_op.cc:270] Start()
0709 13:01:00.469373 (+   137us) write_op.cc:276] Timestamp: P: 1783602060469175 usec, L: 0
0709 13:01:00.469404 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:01:00.470095 (+   691us) log.cc:844] Serialized 4063 byte log entry
0709 13:01:00.901402 (+431307us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29e8c9b0ac 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b
0709 13:01:01.730171 (+828769us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:02.508549 (+778378us) op_driver.cc:464] REPLICATION: finished
0709 13:01:02.631005 (+122456us) write_op.cc:301] APPLY: starting
0709 13:01:02.631101 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:02.994115 (+363014us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:02.994155 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:03.269710 (+275555us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:03.270148 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:01:03.270228 (+    80us) write_op.cc:312] APPLY: finished
0709 13:01:03.291218 (+ 20990us) log.cc:844] Serialized 97 byte log entry
0709 13:01:03.320303 (+ 29085us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:03.335452 (+ 15149us) write_op.cc:454] Released schema lock
0709 13:01:03.359510 (+ 24058us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:03.388249 (+ 28739us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:03.391544 (+  3295us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4687988,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":122164,"apply.run_cpu_time_us":21927,"apply.run_wall_time_us":745079,"cfile_cache_hit":38,"cfile_cache_hit_bytes":39653,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":98116,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":10,"prepare.queue_time_us":302012,"prepare.run_cpu_time_us":26235,"prepare.run_wall_time_us":690556,"raft.queue_time_us":558736,"raft.run_cpu_time_us":9700,"raft.run_wall_time_us":116097,"replication_time_us":2038991,"spinlock_wait_cycles":24599808,"thread_start_us":1303671,"threads_started":4,"wal-append.queue_time_us":573569,"wal-append.run_cpu_time_us":107704,"wal-append.run_wall_time_us":3331605}]]}
I20260709 13:01:08.917923  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:08.782932  5881 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.918949  6391 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:08.942991  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 140993us
W20260709 13:01:08.944000  1511 leader_election.cc:336] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.936s (SENT)
I20260709 13:01:08.949420  1689 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:08.957083  1543 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:08.961575  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:08.945570  6334 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.946170  6483 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:08.945894  6391 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:08.971489  6185 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.982950  6434 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.004s
I20260709 13:01:09.002079  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:08.995520  6434 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:09.005940  6070 consensus_meta.cc:287] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.698s	user 0.005s	sys 0.005s
I20260709 13:01:09.013918  6244 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.015095  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.016156  6521 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:09.016436  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.016887  6521 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.017464  6244 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:09.019389  6244 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:09.020473  6391 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:08.995431  6185 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.026407  6411 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:09.026887  6411 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.026995  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.007514  6483 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:09.027684  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43404 (request call id 1017) took 2362 ms (client timeout 2446 ms). Trace:
I20260709 13:01:09.025765  6521 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:09.032893  1611 rpcz_store.cc:269] 0709 13:01:06.665104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.744475 (+ 79371us) service_pool.cc:224] Handling call
0709 13:01:09.027513 (+2283038us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400140ad4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.027615 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3048433408}
I20260709 13:01:09.034358  1611 raft_consensus.cc:1240] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:09.027130  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2318) took 2387 ms (client timeout 2036 ms). Trace:
I20260709 13:01:09.008875  6258 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:09.034819  1536 rpcz_store.cc:269] 0709 13:01:06.640024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.845937 (+205913us) service_pool.cc:224] Handling call
0709 13:01:09.026923 (+2180986us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000b0ed4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.027048 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2394700672}
I20260709 13:01:09.037128  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2321) took 1205 ms. Trace:
I20260709 13:01:09.037628  1611 rpcz_store.cc:276] 0709 13:01:07.831514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.033896 (+1202382us) service_pool.cc:224] Handling call
0709 13:01:09.034185 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.036776 (+  2591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.037051 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:09.024271  6070 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:09.039855  6457 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 2.339s	user 0.013s	sys 0.020s
I20260709 13:01:09.042814  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 921) took 2489 ms. Trace:
I20260709 13:01:09.044584  6411 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.043224  1686 rpcz_store.cc:276] 0709 13:01:06.553431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.599286 (+ 45855us) service_pool.cc:224] Handling call
0709 13:01:06.599669 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:06.600094 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:06.601147 (+  1053us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.684697 (+ 83550us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:06.685180 (+   483us) log.cc:844] Serialized 52 byte log entry
0709 13:01:06.685293 (+   113us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:06.685318 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.685370 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.039217 (+2353847us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:09.042385 (+  3168us) raft_consensus.cc:1685] finished
0709 13:01:09.042522 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.042711 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3205932,"prepare.queue_time_us":1396,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":13478,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":1640211,"spinlock_wait_cycles":19691648,"thread_start_us":73594,"threads_started":1,"wal-append.queue_time_us":98901}
I20260709 13:01:09.045841  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:09.045954  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52956 (request call id 1969) took 2396 ms (client timeout 3094 ms). Trace:
W20260709 13:01:09.046478  1691 rpcz_store.cc:269] 0709 13:01:06.649224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.808327 (+159103us) service_pool.cc:224] Handling call
0709 13:01:09.045687 (+2237360us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540011add4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.045862 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531138944}
I20260709 13:01:09.046913  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:09.047362  1692 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:09.047658  1686 raft_consensus.cc:2393] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 15: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:09.048434  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:09.049256  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:09.049597  6429 consensus_meta.cc:287] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.004s
I20260709 13:01:09.055176  6429 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:09.050382  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:09.060556  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:09.061105  2268 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.067337  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.068414  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.068890  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:09.069092  2272 raft_consensus.cc:2393] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:09.069473  1545 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:09.070463  1543 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:09.074167  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:09.074826  1543 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:09.076195  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.077539  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:09.078363  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:09.078986  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:09.097492  1611 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:09.080709  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:09.080858  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.075922  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:09.083210  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:09.098232  1539 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:01:09.098742  1694 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.105203  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:09.106012  1543 raft_consensus.cc:2410] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:09.107479  2271 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:09.106645  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:09.106606  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:09.111925  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.112677  1544 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:09.113411  1536 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:09.113488  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:09.090040  1584 connection.cc:256] RPC call timeout handler was delayed by -1.6593264790000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 13:01:09.090418  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 83812.1us
I20260709 13:01:09.114916  1658 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:09.087486  6429 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:09.076216  1545 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:09.119807  1545 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:09.053860  6411 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:09.119035  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.065686  6498 consensus_queue.cc:1059] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:01:09.125195  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.127262  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:09.075119  6294 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:01:09.120486  1545 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.135233  2274 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:09.135449  1545 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.061897  6483 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.132910  1686 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:01:09.133963  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:09.131628  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:09.136904  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:09.138346  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:09.111369  6454 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:09.109364  6432 consensus_queue.cc:1059] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:01:09.090827  6273 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:09.111883  6070 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:09.151974  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2298) took 3165 ms. Trace:
I20260709 13:01:09.160024  1613 rpcz_store.cc:276] 0709 13:01:05.986545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.986702 (+   157us) service_pool.cc:224] Handling call
0709 13:01:05.987030 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.526517 (+1539487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.151777 (+1625260us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001117d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:09.151925 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3523488640}
W20260709 13:01:09.151515  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2743) took 2513 ms (client timeout 2116 ms). Trace:
I20260709 13:01:09.147132  1694 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:09.158612  2275 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:09.160815  1615 rpcz_store.cc:269] 0709 13:01:06.638374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.695677 (+ 57303us) service_pool.cc:224] Handling call
0709 13:01:09.151317 (+2455640us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400068954. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.151430 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561608960}
I20260709 13:01:09.161145  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.161351  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.124558  6334 consensus_queue.cc:1059] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:01:09.131265  6429 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.163642  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.164512  1694 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:09.165300  1611 raft_consensus.cc:2393] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:09.164376  6372 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.124722  6258 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:09.171792  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:09.173925  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.189275  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.190718  1694 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:01:09.191700  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.192229  1689 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:09.192962  1694 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
W20260709 13:01:09.193094  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 59171.6us
I20260709 13:01:09.194373  2241 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:09.196960  6434 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:09.197355  6434 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:09.198978  1691 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:09.150902  6185 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:09.197686  6434 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.201447  2241 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:09.200531  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.171175  6372 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.400255  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:09.401991  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:01:09.374107  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.405238  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:09.405525  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.358086  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.204257  6070 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:09.194933  6126 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:09.191859  6521 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:09.266119  6529 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:09.420168  6521 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:09.419018  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.391364  1612 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:09.383180  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:09.356830  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 1956) took 2561 ms (client timeout 2116 ms). Trace:
I20260709 13:01:09.209003  6429 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:09.289196  6446 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:09.429787  1537 rpcz_store.cc:269] 0709 13:01:06.795558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.896995 (+101437us) service_pool.cc:224] Handling call
0709 13:01:09.356189 (+2459194us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000f1754. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.356533 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3373902720}
I20260709 13:01:09.434223  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:09.434314  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:09.282519  6512 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.938s	user 0.002s	sys 0.014s
I20260709 13:01:09.435148  1537 raft_consensus.cc:3060] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:09.423771  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:09.438335  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.179908  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.444298  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 1024) took 1910 ms. Trace:
I20260709 13:01:09.447456  1612 rpcz_store.cc:276] 0709 13:01:07.531476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.305220 (+773744us) service_pool.cc:224] Handling call
0709 13:01:09.389717 (+1084497us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d7efc0 00007f29f0d69929 00007f29f0d693d2 00007f29ea2e0bd4
0709 13:01:09.390233 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.425015 (+ 34782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.441240 (+ 16225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24024320}
I20260709 13:01:09.438431  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:09.448203  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:09.448771  1536 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.449132  1613 raft_consensus.cc:2376] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15. Re-sending same reply.
I20260709 13:01:09.449445  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.450311  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:09.450968  1619 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:09.450814  6244 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.452162  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.452973  1619 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
W20260709 13:01:09.209708  6534 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:01:09.454870  1541 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:09.268427  6462 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:09.455592  6462 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:09.444010  6406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.000s	sys 0.014s
I20260709 13:01:09.455938  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:09.456319  6406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.000s	sys 0.014s
I20260709 13:01:09.457108  1541 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:09.457228  6462 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:09.458001  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:09.416052  6182 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:09.294231  6471 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:09.459295  6471 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.459203  6182 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:09.460659  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 52273.4us
I20260709 13:01:09.461808  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:09.462033  6182 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:09.266989  6527 log.cc:927] Time spent T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:01:09.339989  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 231896us
I20260709 13:01:09.453056  6372 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:09.451897  6244 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:09.291673  6535 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:01:09.471449  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.360148  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:09.471668  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.477757  1611 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.483584  2268 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:01:09.486327  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:09.471130  6540 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.269101  6483 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:09.487888  6070 raft_consensus.cc:697] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:09.487679  6540 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:09.488957  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2753) took 1913 ms. Trace:
I20260709 13:01:09.489094  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2769) took 1085 ms. Trace:
I20260709 13:01:09.489578  6070 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.490589  6540 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:09.493224  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.495417  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:09.497862  1658 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:09.497954  6442 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:09.498502  6442 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.498823  1691 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.498909  6442 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:09.499569  2276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45390 (request call id 1176) took 1962 ms (client timeout 1560 ms). Trace:
I20260709 13:01:09.491128  1612 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:09.470283  6462 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.501775  1619 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
W20260709 13:01:09.499981  2276 rpcz_store.cc:269] 0709 13:01:07.536848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.537894 (+  1046us) service_pool.cc:224] Handling call
0709 13:01:09.499169 (+1961275us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54004d53d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.499333 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698554752}
I20260709 13:01:09.202819  6530 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.489580  1690 rpcz_store.cc:276] 0709 13:01:08.403442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.403563 (+   121us) service_pool.cc:224] Handling call
0709 13:01:09.488521 (+1084958us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b5400400e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.488839 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227246976}
I20260709 13:01:09.334432  1440 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:09.507169  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.508536  1440 catalog_manager.cc:5697] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 4 to 7, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.505167  6182 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.266534  6389 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.511312  6182 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:09.512408  6389 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.513744  6182 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:09.275449  6458 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:09.489462  1693 rpcz_store.cc:276] 0709 13:01:07.575745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.575892 (+   147us) service_pool.cc:224] Handling call
0709 13:01:07.761623 (+185731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.761948 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.761977 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.255529 (+493552us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b2c0009d728. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 13:01:08.255904 (+   375us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.346130 (+ 90226us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:08.346166 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.346261 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.281926 (+935665us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:09.488375 (+206449us) raft_consensus.cc:1685] finished
0709 13:01:09.488407 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.488668 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40892,"spinlock_wait_cycles":16449792,"thread_start_us":89906,"threads_started":1,"wal-append.queue_time_us":88419}
I20260709 13:01:09.470911  6364 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.520987  6364 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:09.522459  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:09.462682  6391 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.467352  6440 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:09.527823  6521 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:09.527981  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1162) took 3686 ms. Trace:
W20260709 13:01:09.529218  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 169516us
I20260709 13:01:09.530464  6540 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:09.531059  6540 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:09.531858  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.532877  2274 raft_consensus.cc:2410] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:09.532279  6540 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:09.537259  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.536933  6440 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.537652  5924 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:09.537901  2272 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:09.529438  1537 raft_consensus.cc:2468] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:09.530323  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:09.535626  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:09.536082  1615 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:09.538636  1613 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.538131  5924 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:09.550076  6391 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.550841  6098 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.552142  6472 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:09.552716  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.553697  1693 raft_consensus.cc:2410] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:09.559917  1440 catalog_manager.cc:5697] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 7 to 8, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.507231  6470 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:09.563233  6470 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:09.564507  6470 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.464740  6126 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:09.527848  6244 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:09.609371  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 123212us
I20260709 13:01:09.625052  6544 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:09.625674  6228 raft_consensus.cc:3055] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:09.625775  6544 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:09.549978  5924 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:09.648584  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.626292  6228 raft_consensus.cc:740] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:09.651580  6228 consensus_queue.cc:260] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:09.652899  6228 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.652493  6434 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:09.655921  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48380.9us
I20260709 13:01:09.678740  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:09.683465  6472 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.133940  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 603686us
I20260709 13:01:10.039562  1694 raft_consensus.cc:1240] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:09.827589  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 103877us
W20260709 13:01:09.864893  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.992192  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.918130  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2762) took 2154 ms. Trace:
I20260709 13:01:09.684028  2271 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:09.842972  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.133845  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:10.134325  1611 consensus_meta.cc:287] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.594s	user 0.013s	sys 0.004s
I20260709 13:01:10.140113  1611 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:01:09.758955  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1173) took 2799 ms. Trace:
I20260709 13:01:09.975770  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1213) took 1608 ms. Trace:
I20260709 13:01:09.688974  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 1018) took 3011 ms. Trace:
I20260709 13:01:09.842228  1536 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:10.142220  1693 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:09.881608  1691 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:10.143471  1613 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:09.866240  2274 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:09.653848  1440 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 7 to 8, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:09.694581  2275 consensus_meta.cc:287] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.006s
W20260709 13:01:09.990722  1545 consensus_meta.cc:287] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.010s
W20260709 13:01:10.040402  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2776) took 1627 ms (client timeout 1723 ms). Trace:
I20260709 13:01:09.692378  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2773) took 1287 ms. Trace:
I20260709 13:01:10.146814  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2766) took 1088 ms. Trace:
I20260709 13:01:09.528409  2273 rpcz_store.cc:276] 0709 13:01:05.813946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.957366 (+143420us) service_pool.cc:224] Handling call
0709 13:01:05.957620 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.967960 (+ 10340us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:06.025162 (+ 57202us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.280294 (+255132us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b180039ab40. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a 00007f29ebdafa2a
0709 13:01:06.426903 (+146609us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.426964 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:06.427012 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.052292 (+1625280us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b180039ab40. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c862a6 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419
0709 13:01:09.498408 (+1446116us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5400570154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:09.498477 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.500585 (+  2108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9398,"prepare.queue_time_us":57068,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":23693,"raft.queue_time_us":637,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3583,"spinlock_wait_cycles":37580032,"thread_start_us":145642,"threads_started":1,"wal-append.queue_time_us":427646,"wal-append.run_cpu_time_us":33151,"wal-append.run_wall_time_us":1307176}
W20260709 13:01:10.143653  1612 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.003s	sys 0.010s
W20260709 13:01:10.152508  1612 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.003s	sys 0.011s
I20260709 13:01:09.685946  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.143478  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 933) took 1140 ms. Trace:
I20260709 13:01:10.141925  2269 rpcz_store.cc:276] 0709 13:01:08.313676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.313781 (+   105us) service_pool.cc:224] Handling call
0709 13:01:09.922245 (+1608464us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54006702d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.922509 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54252416}
I20260709 13:01:09.763072  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 926) took 1974 ms. Trace:
I20260709 13:01:10.154722  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2779) took 1088 ms. Trace:
I20260709 13:01:10.147487  1611 rpcz_store.cc:276] 0709 13:01:09.052077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.382344 (+330267us) service_pool.cc:224] Handling call
0709 13:01:10.140801 (+758457us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.141449  2270 rpcz_store.cc:276] 0709 13:01:06.959525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.961802 (+  2277us) service_pool.cc:224] Handling call
0709 13:01:06.962159 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.996414 (+1034255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.758459 (+1762045us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004a5e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:09.758798 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2358525824}
W20260709 13:01:10.131683  6446 consensus_meta.cc:287] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.002s
I20260709 13:01:10.157364  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2770) took 1742 ms. Trace:
I20260709 13:01:10.147320  1686 rpcz_store.cc:276] 0709 13:01:08.404521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.048205 (+643684us) service_pool.cc:224] Handling call
0709 13:01:09.691972 (+643767us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400161054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.692203 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46818176}
I20260709 13:01:10.155355  1613 rpcz_store.cc:276] 0709 13:01:09.056076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.449932 (+393856us) service_pool.cc:224] Handling call
0709 13:01:10.144162 (+694230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.158047  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2784) took 1434 ms. Trace:
I20260709 13:01:09.712167  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:10.161887  1693 rpcz_store.cc:276] 0709 13:01:08.403747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.684065 (+1280318us) service_pool.cc:224] Handling call
0709 13:01:10.134105 (+450040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.142843 (+  8738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.146342 (+  3499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.155138  1687 rpcz_store.cc:276] 0709 13:01:07.788448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.275308 (+486860us) service_pool.cc:224] Handling call
0709 13:01:08.275704 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.305984 (+ 30280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.738108 (+1432124us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b540012ff54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:09.762911 (+ 24803us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68307328}
I20260709 13:01:10.154348  1691 rpcz_store.cc:276] 0709 13:01:09.002581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.401132 (+398551us) service_pool.cc:224] Handling call
0709 13:01:10.143424 (+742292us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:09.758423  6543 log.cc:927] Time spent T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:01:10.017469  6454 raft_consensus.cc:3055] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:10.018357  5881 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:10.146468  1689 rpcz_store.cc:269] 0709 13:01:08.412713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.004399 (+591686us) service_pool.cc:224] Handling call
0709 13:01:10.040008 (+1035609us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400124b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:10.040216 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390493952}
I20260709 13:01:10.172920  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.163664  2275 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:10.137198  1692 rpcz_store.cc:276] 0709 13:01:07.763233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.136274 (+373041us) service_pool.cc:224] Handling call
0709 13:01:09.047194 (+910920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.047753 (+   559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.917677 (+869924us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b540011add0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:09.917932 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064644480}
W20260709 13:01:10.174985  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 713337us
I20260709 13:01:09.725039  5924 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.758816  6531 raft_consensus.cc:3055] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:09.765139  6287 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:09.765348  6440 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:09.789213  6434 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:10.171311  1694 rpcz_store.cc:276] 0709 13:01:08.712307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.766362 (+1054055us) service_pool.cc:224] Handling call
0709 13:01:09.891056 (+124694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.141511 (+250455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.146416 (+  4905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.180013  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45390 (request call id 1186) took 1065 ms. Trace:
I20260709 13:01:10.180058  1613 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:10.181249  1440 catalog_manager.cc:5697] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 4 to 5, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:10.184013   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:10.185081  1658 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:10.185346  6471 consensus_meta.cc:287] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.725s	user 0.001s	sys 0.011s
W20260709 13:01:10.185474  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2736) took 3575 ms (client timeout 1758 ms). Trace:
I20260709 13:01:10.185768  1509 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.145833  6391 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:09.765956  6364 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:10.174834  6454 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:10.192183  2275 rpcz_store.cc:276] 0709 13:01:09.114953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.115905 (+   952us) service_pool.cc:224] Handling call
0709 13:01:10.179939 (+1064034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.200183  1693 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:01:10.195516  1616 rpcz_store.cc:269] 0709 13:01:06.610238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.611300 (+  1062us) service_pool.cc:224] Handling call
0709 13:01:08.304114 (+1692814us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c80a22 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:01:09.685660 (+1381546us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800010898. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80e9c 00007f29e8c80a5b 00007f29f1b99c09 00007f29f0cf3ee0 00007f29f0dbd0ab 00007f29f0dbd131 00007f29f0d6b0a0 00007f29f0d6a984 00007f29ea2e56d4 00007f29ea2e5662
0709 13:01:10.185378 (+499718us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36107904}
I20260709 13:01:10.142802  1618 rpcz_store.cc:276] 0709 13:01:06.677130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.913548 (+236418us) service_pool.cc:224] Handling call
0709 13:01:06.913915 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.018793 (+104878us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:07.556127 (+537334us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.055624 (+499497us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.058506 (+  2882us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.058655 (+   149us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:08.058708 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.687903 (+1629195us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b180047a700. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c862a6 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419
0709 13:01:09.688490 (+   587us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001121d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:09.688536 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.688597 (+    61us) raft_consensus.cc:1685] finished
0709 13:01:09.688611 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.688794 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":521982,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":616,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":2291,"spinlock_wait_cycles":245907712,"thread_start_us":982631,"threads_started":2,"wal-append.queue_time_us":626447,"wal-append.run_cpu_time_us":2132,"wal-append.run_wall_time_us":1022650}
I20260709 13:01:10.190045  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:10.199580  6541 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:10.200122  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 934) took 1197 ms. Trace:
I20260709 13:01:10.200212  6258 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.203114  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2763) took 2402 ms (client timeout 2125 ms). Trace:
I20260709 13:01:10.203855  6478 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:10.204500  6519 raft_consensus.cc:3055] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:10.206983  6366 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:01:10.206741  6442 consensus_meta.cc:287] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
I20260709 13:01:10.207175  6126 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:10.211445  6389 consensus_meta.cc:287] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.001s
I20260709 13:01:10.211828  1658 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:10.225669  1689 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:09.684201  6472 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.215869  1687 rpcz_store.cc:276] 0709 13:01:09.002892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.186450 (+1183558us) service_pool.cc:224] Handling call
0709 13:01:10.196311 (+  9861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.199754 (+  3443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.199782 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.199838 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:10.199874 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.199933 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.200046 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.218536  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.188865  6531 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:01:10.217968  1685 rpcz_store.cc:269] 0709 13:01:07.792257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.977413 (+185156us) service_pool.cc:224] Handling call
0709 13:01:10.163515 (+2186102us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002e40d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:10.194531 (+ 31016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616212736}
I20260709 13:01:10.221844  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2785) took 1218 ms. Trace:
I20260709 13:01:10.227308  6106 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:10.227680  1538 raft_consensus.cc:2410] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:10.231283  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 935) took 1228 ms. Trace:
I20260709 13:01:10.231122  1693 rpcz_store.cc:276] 0709 13:01:08.999724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.176219 (+1176495us) service_pool.cc:224] Handling call
0709 13:01:10.199865 (+ 23646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.212740 (+ 12875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.218092 (+  5352us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.231805  1689 rpcz_store.cc:276] 0709 13:01:09.003202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.193320 (+1190118us) service_pool.cc:224] Handling call
0709 13:01:10.224670 (+ 31350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.229751 (+  5081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.231239 (+  1488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:09.764345  6544 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.235837  1691 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:10.236546  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 931) took 1234 ms. Trace:
I20260709 13:01:10.236948  1691 rpcz_store.cc:276] 0709 13:01:09.002229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.175698 (+1173469us) service_pool.cc:224] Handling call
0709 13:01:10.221535 (+ 45837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.236295 (+ 14760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.236491 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.199211  6471 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.225682  6440 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:10.221024  6519 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:10.242957  1611 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.239955  6254 raft_consensus.cc:2804] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:10.247027  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 61371.3us
I20260709 13:01:10.238090  6106 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:10.253127  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.255070  1509 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.256762  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.257853  6334 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:10.258632  6334 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:10.258941  1616 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:10.259574  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2764) took 1208 ms. Trace:
I20260709 13:01:10.259861  1616 rpcz_store.cc:276] 0709 13:01:09.051592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.219948 (+1168356us) service_pool.cc:224] Handling call
0709 13:01:10.251878 (+ 31930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.259331 (+  7453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.259507 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.262035  1613 raft_consensus.cc:1240] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:01:10.229585  6442 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.224086  6258 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.264524  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2761) took 1214 ms. Trace:
I20260709 13:01:10.263257  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:10.266211  1613 rpcz_store.cc:276] 0709 13:01:09.050488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.217107 (+1166619us) service_pool.cc:224] Handling call
0709 13:01:10.244459 (+ 27352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.264359 (+ 19900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.264488 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.267279  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:10.267706  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2332) took 1778 ms (client timeout 1624 ms). Trace:
I20260709 13:01:10.268035  1613 raft_consensus.cc:2393] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:10.268425  1537 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:01:10.268098  1538 rpcz_store.cc:269] 0709 13:01:08.489405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.490604 (+  1199us) service_pool.cc:224] Handling call
0709 13:01:10.267432 (+1776828us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54000596d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:10.267619 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3871654784}
I20260709 13:01:10.269052  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:10.263569  6254 raft_consensus.cc:697] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:10.270040  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:10.270973  1542 raft_consensus.cc:2410] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:01:10.275269  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 298880us
I20260709 13:01:10.277529  6126 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:10.249580  6437 consensus_queue.cc:1059] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:01:10.277946  6017 raft_consensus.cc:3055] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:10.278362  6017 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:10.278455  6437 consensus_queue.cc:1243] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:10.277966  6531 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.279399  1440 catalog_manager.cc:5697] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 7, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:10.280316  1689 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:10.280604  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 91613.5us
I20260709 13:01:10.267598  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.279569  6017 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.283957  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1974) took 1166 ms. Trace:
I20260709 13:01:10.284675  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:10.284969  1687 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:10.284818  1689 rpcz_store.cc:276] 0709 13:01:09.117669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.232399 (+1114730us) service_pool.cc:224] Handling call
0709 13:01:10.263775 (+ 31376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.280873 (+ 17098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.283905 (+  3032us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.287482  1690 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 16: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:01:10.287911  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.288455  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:10.283535  1509 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:10.280436  6531 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:10.289188  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 940) took 1284 ms. Trace:
I20260709 13:01:10.262647  6389 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:10.291277  1685 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:10.293334  1687 rpcz_store.cc:276] 0709 13:01:09.004371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.229538 (+1225167us) service_pool.cc:224] Handling call
0709 13:01:10.263493 (+ 33955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.285414 (+ 21921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.289140 (+  3726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.294165  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 938) took 1288 ms. Trace:
I20260709 13:01:10.278146  6126 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:10.294459  1694 rpcz_store.cc:276] 0709 13:01:09.003901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.197469 (+1193568us) service_pool.cc:224] Handling call
0709 13:01:10.233534 (+ 36065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.285058 (+ 51524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.285083 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.291755 (+  6672us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:10.291779 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.291815 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.291878 (+    63us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.308893  1693 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:10.309989  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1975) took 1192 ms. Trace:
I20260709 13:01:10.310369  1685 rpcz_store.cc:276] 0709 13:01:09.117891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.233200 (+1115309us) service_pool.cc:224] Handling call
0709 13:01:10.249654 (+ 16454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.296345 (+ 46691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.309948 (+ 13603us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:10.294929  6228 consensus_meta.cc:287] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.004s
I20260709 13:01:10.311784  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1973) took 1194 ms. Trace:
I20260709 13:01:10.312021  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:10.312175  1693 rpcz_store.cc:276] 0709 13:01:09.117414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.234813 (+1117399us) service_pool.cc:224] Handling call
0709 13:01:10.275869 (+ 41056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.311609 (+ 35740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.311744 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.313441  1691 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:10.313969  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1976) took 1195 ms. Trace:
I20260709 13:01:10.311359  6244 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:01:10.314448  6462 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.001s
W20260709 13:01:10.315128  6530 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.000s
I20260709 13:01:10.314330  1691 rpcz_store.cc:276] 0709 13:01:09.118104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.244114 (+1126010us) service_pool.cc:224] Handling call
0709 13:01:10.285189 (+ 41075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.313771 (+ 28582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.313926 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.317651  1536 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:10.307390  6470 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.320273  1440 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 8 to 9, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:10.311363  6285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.442s	user 0.043s	sys 0.046s
I20260709 13:01:10.263970  6454 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.330574  1616 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:10.318284  6334 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:10.337791  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 146466us
I20260709 13:01:10.338584  1615 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:10.270915  6254 consensus_queue.cc:237] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.341825  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2781) took 1278 ms. Trace:
I20260709 13:01:10.342253  1616 rpcz_store.cc:276] 0709 13:01:09.063177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.292321 (+1229144us) service_pool.cc:224] Handling call
0709 13:01:10.317977 (+ 25656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.341551 (+ 23574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.341771 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:10.330446  6285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.534s	user 0.043s	sys 0.046s
I20260709 13:01:10.309757  6389 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.345654  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:10.324218  6434 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:10.346978  1616 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.324417  6530 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.332676  6228 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:10.349752  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.349675  6228 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.352200  6228 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:10.357131  6179 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.357223  1617 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:01:10.357877  6179 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.353293  6440 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:01:10.360549  6179 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:10.360853  6364 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.361492  6364 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
W20260709 13:01:10.367322  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 85860.5us
I20260709 13:01:10.371564  6106 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:10.371872  6442 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:10.372992  6472 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:10.345534  1440 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.378712  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.380164  1611 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
W20260709 13:01:10.376178  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 108831us
I20260709 13:01:10.382321  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:10.388458  2275 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.392019  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:10.416158  2270 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:10.385715  6454 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.416615  1537 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:10.383610  6228 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.419257  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2313) took 2830 ms. Trace:
I20260709 13:01:10.387322  6437 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.422499  1509 leader_election.cc:400] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 16. Current term is 17.
W20260709 13:01:10.424852  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.419905  6017 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.420879  1620 rpcz_store.cc:276] 0709 13:01:07.492464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.195328 (+702864us) service_pool.cc:224] Handling call
0709 13:01:08.195745 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.196699 (+   954us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:08.205392 (+  8693us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.408303 (+1202911us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b1800253ba0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a 00007f29ebdafa2a
0709 13:01:09.609225 (+200922us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.613391 (+  4166us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.627573 (+ 14182us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:09.851729 (+224156us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.135181 (+283452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.146068 (+ 10887us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.310440 (+164372us) raft_consensus.cc:1685] finished
0709 13:01:10.310457 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.322924 (+ 12467us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28338,"prepare.queue_time_us":621720,"prepare.run_cpu_time_us":594,"prepare.run_wall_time_us":2776,"raft.queue_time_us":166406,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":33383,"spinlock_wait_cycles":2894720,"thread_start_us":305845,"threads_started":3,"wal-append.queue_time_us":1208707}
I20260709 13:01:10.434125  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.385422  6334 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:10.437525  6334 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.379340  6470 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.441941  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:10.442935  6226 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:10.443346  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:10.443528  6470 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:10.443475  6226 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:10.445263  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:10.444926  6226 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.420644  6541 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:10.447346  6389 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:10.447480  6437 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.415851  6126 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.449594  6437 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:10.431519  1509 leader_election.cc:403] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.451126  5924 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 16. Current term is 17.
W20260709 13:01:10.432852  6335 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:01:10.432718  6547 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:10.433126  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.452698  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 968) took 1378 ms. Trace:
W20260709 13:01:10.451393  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 101766us
W20260709 13:01:10.451380  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 69622.9us
I20260709 13:01:10.453076  1545 rpcz_store.cc:276] 0709 13:01:09.074042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.075885 (+  1843us) service_pool.cc:224] Handling call
0709 13:01:09.076115 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.387294 (+1311179us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:10.390721 (+  3427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.399453 (+  8732us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:10.420235 (+ 20782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.431103 (+ 10868us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.452627 (+ 21524us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6717,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"thread_start_us":181910,"threads_started":1}
I20260709 13:01:10.482103  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2754) took 1411 ms. Trace:
I20260709 13:01:10.490929  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 936) took 1487 ms. Trace:
I20260709 13:01:10.491364  1692 rpcz_store.cc:276] 0709 13:01:09.003477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.180558 (+1177081us) service_pool.cc:224] Handling call
0709 13:01:10.180960 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.181234 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:10.337595 (+156361us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.490518 (+152923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.490585 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:10.490642 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.490738 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.490873 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155550,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":121,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":283109,"threads_started":2,"wal-append.queue_time_us":143153}
I20260709 13:01:10.487118  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:10.495435  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:10.496932  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 939) took 1492 ms. Trace:
I20260709 13:01:10.501583  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2775) took 1432 ms. Trace:
I20260709 13:01:10.502096  1613 rpcz_store.cc:276] 0709 13:01:09.054847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.270001 (+1215154us) service_pool.cc:224] Handling call
0709 13:01:10.270364 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.270655 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.276323 (+  5668us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.292491 (+ 16168us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.484620 (+192129us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:10.484676 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.484771 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.486509 (+  1738us) raft_consensus.cc:1685] finished
0709 13:01:10.486532 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.487484 (+   952us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":171191,"threads_started":1,"wal-append.queue_time_us":175687}
I20260709 13:01:10.507287  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:10.461917  6228 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.508690  1541 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:10.509152  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2762) took 1446 ms. Trace:
W20260709 13:01:10.511643  1540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.001s	sys 0.005s
W20260709 13:01:10.512135  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.002s	sys 0.005s
I20260709 13:01:10.512373  1616 raft_consensus.cc:2410] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:10.481726  6541 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:10.512987  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2338) took 1123 ms. Trace:
W20260709 13:01:10.514493  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 123937us
I20260709 13:01:10.515072  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.516888  1611 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:01:10.518195  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.518838  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.519132  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.511479  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.511160  1618 rpcz_store.cc:276] 0709 13:01:09.051054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.218146 (+1167092us) service_pool.cc:224] Handling call
0709 13:01:10.244374 (+ 26228us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:10.283917 (+ 39543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.283943 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:10.320976 (+ 37033us) log.cc:844] Serialized 52 byte log entry
0709 13:01:10.491051 (+170075us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:10.491355 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.491566 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.491635 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.496771 (+  5136us) raft_consensus.cc:1685] finished
0709 13:01:10.496797 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.496972 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9725,"prepare.queue_time_us":152,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":12563,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":17149,"thread_start_us":137404,"threads_started":1,"wal-append.queue_time_us":155721}
I20260709 13:01:10.524219  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.525946  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.526160  5881 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:10.527148  6434 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:10.527541  6434 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:10.528406  6434 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.528932  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1229) took 1036 ms. Trace:
I20260709 13:01:10.526734  2276 raft_consensus.cc:2393] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:10.529299  2271 rpcz_store.cc:276] 0709 13:01:09.492877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.493653 (+   776us) service_pool.cc:224] Handling call
0709 13:01:09.494095 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.137980 (+643885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.528709 (+390729us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54004c95d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:10.528860 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371588864}
I20260709 13:01:10.530958  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:10.533537  1585 connection.cc:256] RPC call timeout handler was delayed by -1.0241939200000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:01:10.533996  1585 connection.cc:256] RPC call timeout handler was delayed by -1.0203752370000529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
I20260709 13:01:10.533740  6106 consensus_queue.cc:1059] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:10.534158  6405 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.487114  1619 rpcz_store.cc:276] 0709 13:01:09.048607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.541855 (+493248us) service_pool.cc:224] Handling call
0709 13:01:09.625499 (+ 83644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.625931 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:09.882547 (+256616us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.379181 (+496634us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.389636 (+ 10455us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.389757 (+   121us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:10.389776 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.389816 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.454255 (+ 64439us) raft_consensus.cc:1685] finished
0709 13:01:10.454276 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.459716 (+  5440us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5165,"prepare.queue_time_us":613484,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":22117,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":54279,"thread_start_us":590784,"threads_started":2,"wal-append.queue_time_us":467218}
I20260709 13:01:10.461752  6437 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:01:10.549161  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.551051  1613 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:10.551990  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:10.552666  6565 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:01:10.553058  1510 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.553237  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.553987  1613 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:01:10.519578  1440 catalog_manager.cc:5697] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:10.553306  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.515574  6440 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:10.556902  2243 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.516358  1540 rpcz_store.cc:276] 0709 13:01:09.390279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.390551 (+   272us) service_pool.cc:224] Handling call
0709 13:01:09.391225 (+   674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.391720 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:09.473367 (+ 81647us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.512577 (+1039210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.512645 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:10.512704 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.512790 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.512923 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":161043,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":292,"thread_start_us":1059734,"threads_started":2,"wal-append.queue_time_us":941298}
I20260709 13:01:10.559830  2275 raft_consensus.cc:2468] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:10.534538  6264 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:01:10.522346  6285 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:10.562071  1616 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:10.562690  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:10.564254  1539 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.565002  6228 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:10.562955  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:10.497329  1686 rpcz_store.cc:276] 0709 13:01:09.004130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.194300 (+1190170us) service_pool.cc:224] Handling call
0709 13:01:10.207512 (+ 13212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.207892 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:10.336810 (+128918us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.493997 (+157187us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.494499 (+   502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.494564 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:10.494619 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.494672 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.496885 (+  2213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138661,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":317,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":194,"spinlock_wait_cycles":28544,"thread_start_us":274884,"threads_started":2,"wal-append.queue_time_us":146786}
I20260709 13:01:10.563009  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.548954  6098 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:10.566862  1618 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:10.550369  6541 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:10.562450  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.572463  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.574244  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:10.575474  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.563158  6285 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:10.599767  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 84289.7us
W20260709 13:01:10.608933  6412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.005s	sys 0.019s
W20260709 13:01:10.618980  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 66020us
I20260709 13:01:10.557783  6179 raft_consensus.cc:3055] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:10.572427  1613 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
W20260709 13:01:10.690042  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.571979  6558 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.608970  6312 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:10.678099  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:10.680791  1539 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:10.678267  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:10.692337  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.693570  6179 raft_consensus.cc:740] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:10.694072  6312 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:10.694541  6312 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.694850  6446 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:10.694792  6179 consensus_queue.cc:260] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.695943  6179 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.696380  6446 consensus_queue.cc:1059] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:10.697342  6446 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:10.697672  6446 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:10.698957  6248 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:10.699077  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:10.699222  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.699855  1540 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:10.700436  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.700821  6475 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:10.701032  1613 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:10.701253  6475 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:10.701702  6475 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.701920  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.693554  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:10.703436  1618 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:10.689527  6285 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:10.689759  6412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.005s	sys 0.019s
I20260709 13:01:10.705132  1618 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:10.705379  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:10.706310  1510 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.707446  6273 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:10.702291  6519 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.709102  1618 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:01:10.691066  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 132695us
I20260709 13:01:10.699399  6248 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:10.702804  1613 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:01:10.685000  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.563297  6544 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:10.717855  6248 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.718137  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 1026) took 3180 ms. Trace:
I20260709 13:01:10.722904  1617 rpcz_store.cc:276] 0709 13:01:07.537828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.338097 (+800269us) service_pool.cc:224] Handling call
0709 13:01:08.338391 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.357795 (+2019404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.599876 (+242081us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b540024b154. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:10.718086 (+118210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4632533248}
I20260709 13:01:10.709348  6258 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:10.735409  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 187280us
I20260709 13:01:10.739926  6389 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:10.740371  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.741133  6389 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:10.741490  6462 consensus_queue.cc:1059] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:10.741941  6389 consensus_queue.cc:1243] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer e2a2b76c98ee44ff95e6508c34da0e3d log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:10.742659  6462 raft_consensus.cc:3055] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:10.742853  6244 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.743093  6462 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:10.743608  6244 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:10.744215  5924 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.744388  6546 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:10.744856  6546 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:10.744905  5924 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.747311  6471 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:10.748862  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2775) took 2336 ms. Trace:
I20260709 13:01:10.749312  1690 rpcz_store.cc:276] 0709 13:01:08.412401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.649444 (+1237043us) service_pool.cc:224] Handling call
0709 13:01:10.748643 (+1099199us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400305054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:10.748794 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251730688}
I20260709 13:01:10.756946  6364 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:10.692250  6053 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:10.758285  6053 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.759110  2277 raft_consensus.cc:1240] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: [9.9-10.10]
I20260709 13:01:10.759421  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.758785  6053 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.760023  2272 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:01:10.744024  6462 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.764686  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.743994  6244 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:10.766829  6558 consensus_queue.cc:1059] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:01:10.742481  6389 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:10.770969  6017 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.724505  6531 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.719543  6273 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:10.698585  6446 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:10.807411  6446 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.807991  6053 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:10.813694  5924 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:10.805749  6017 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.818063  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.818543  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.819908  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:10.820521  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 285928us
W20260709 13:01:10.823998  6556 log.cc:927] Time spent T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.150s	user 0.000s	sys 0.012s
I20260709 13:01:10.818487  6519 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.803953  6531 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:10.827719  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.829385  6017 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:10.824012  6244 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.831400  6244 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.833182  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:10.835443  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.835938  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.836354  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.836658  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.836979  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.837023  6364 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:10.837634  6364 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.838079  6364 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:10.835114  6429 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:10.838591  1511 leader_election.cc:336] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.520s (SENT)
I20260709 13:01:10.845568  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.846305  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2756) took 1797 ms. Trace:
I20260709 13:01:10.848421  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1188) took 1312 ms. Trace:
I20260709 13:01:10.851848  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.850989  2274 rpcz_store.cc:276] 0709 13:01:09.532461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.533572 (+  1111us) service_pool.cc:224] Handling call
0709 13:01:09.534002 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.144521 (+610519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.842802 (+698281us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400672354. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:10.844485 (+  1683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763116288}
I20260709 13:01:10.854920  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:10.855495  6546 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.856002  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:10.856424  6470 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:10.856967  6546 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.857074  6470 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:10.857438  6471 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:10.857955  6471 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.858477  6471 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.863015  6273 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.864140  1619 raft_consensus.cc:1240] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:10.865631  1619 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:10.865571  6434 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.843185  6531 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.848506  1612 rpcz_store.cc:276] 0709 13:01:09.049171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.508300 (+459129us) service_pool.cc:224] Handling call
0709 13:01:09.508846 (+   546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.533957 (+ 25111us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:10.156848 (+622891us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.377023 (+220175us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.417326 (+ 40303us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.421124 (+  3798us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:10.421355 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.421524 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.421582 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.846161 (+424579us) raft_consensus.cc:1685] finished
0709 13:01:10.846176 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.846265 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24911,"prepare.queue_time_us":691971,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":26103,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":4120,"thread_start_us":818422,"threads_started":2,"wal-append.queue_time_us":312013}
I20260709 13:01:10.853147  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:10.873903  1619 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:10.874308  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 168039us
I20260709 13:01:10.827155  6541 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.881515  6475 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.882579  1618 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:10.883476  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.884294  2274 raft_consensus.cc:2393] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:10.884305  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.884842  2277 raft_consensus.cc:1240] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:10.858026  6470 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:10.879185  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 51673.3us
I20260709 13:01:10.892181  2272 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:10.893745  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2782) took 1826 ms. Trace:
I20260709 13:01:10.894124  1616 rpcz_store.cc:276] 0709 13:01:09.067622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.547338 (+1479716us) service_pool.cc:224] Handling call
0709 13:01:10.558781 (+ 11443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.562362 (+  3581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.893591 (+331229us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b540036e054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:10.893699 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7251840}
W20260709 13:01:10.900400  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 205734us
I20260709 13:01:10.850241  6312 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:10.902187  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 79969.4us
I20260709 13:01:10.906860  6312 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:10.907905  2270 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 16: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:10.908644  6439 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:10.898475  6389 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:10.909693  6389 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.911725  6389 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:10.898945  6577 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:10.914693  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2758) took 1865 ms. Trace:
I20260709 13:01:10.915027  1615 rpcz_store.cc:276] 0709 13:01:09.049709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.610620 (+560911us) service_pool.cc:224] Handling call
0709 13:01:09.682886 (+ 72266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.343714 (+660828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.914485 (+570771us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54000e1d54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:10.914623 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507265792}
I20260709 13:01:10.915141  2243 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:10.920678  6264 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:10.921072  6264 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.920984  6399 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:10.921573  6264 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.922996  6577 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:10.923523  6335 raft_consensus.cc:3055] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:10.923939  6335 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:10.924376  6462 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.924827  6335 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.926209  6335 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.917055  6540 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:01:10.928942  6196 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:10.929250  6196 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:10.929896  6471 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:10.929980  6196 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.931411  6196 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.935619  6017 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:10.936856  6548 consensus_queue.cc:1059] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:10.937552  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:10.937752  6548 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:10.938450  6548 consensus_queue.cc:1243] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 13.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:01:10.940830  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.941685  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.950876  1614 raft_consensus.cc:3060] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.954923  6471 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:10.951056  6391 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:10.957255  6391 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:10.958977  6391 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.961549  6440 consensus_queue.cc:1059] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:10.962710  6478 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.963276  6478 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.966126  6478 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:10.957397  6547 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:10.967036  6547 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:10.967754  6547 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.968958  6547 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.939424  6548 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:01:10.972965  6264 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.974303  6475 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:10.975404  1616 raft_consensus.cc:3055] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:10.979053  1616 raft_consensus.cc:740] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:10.979748  1616 consensus_queue.cc:260] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:10.980611  1616 raft_consensus.cc:3060] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.918430  6578 consensus_queue.cc:1059] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:01:10.989068  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 150485us
I20260709 13:01:10.991530  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:10.992455  1616 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:10.992585  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:11.001832  1659 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:11.003497  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:11.004781  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:11.005546  2270 raft_consensus.cc:2410] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:11.004807  6526 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.006820  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:11.007526  2270 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 17: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:01:11.011278  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 66720us
I20260709 13:01:11.017658  2272 raft_consensus.cc:2393] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:11.019558  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:11.020890  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.024729  2273 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 17: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:11.031004  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:11.024657  1614 raft_consensus.cc:1275] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:01:11.032644  1614 pending_rounds.cc:85] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 9
I20260709 13:01:11.019906  1659 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:11.034461  1691 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:11.034691  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:11.035842  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:11.036337  1690 raft_consensus.cc:2376] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10. Re-sending same reply.
I20260709 13:01:11.037411  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:11.037708  1691 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:11.038035  1690 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:11.038873  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:11.039430  1692 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.039381  6053 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:11.040863  6053 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:11.040681  6248 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.041206  6053 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:11.032892  1614 pending_rounds.cc:107] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:01:11.042886  1614 raft_consensus.cc:2889] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.043399  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:11.044275  6248 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:11.044647  1694 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:11.046159  6412 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:11.046469  5881 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.043535  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 1019) took 4333 ms. Trace:
I20260709 13:01:11.042083  6053 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:11.054586  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.055183  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.052028  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 64596.1us
I20260709 13:01:11.052557  1616 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:11.056824  1613 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:11.055580  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.048323  1614 rpcz_store.cc:276] 0709 13:01:06.710077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.924514 (+214437us) service_pool.cc:224] Handling call
0709 13:01:06.924809 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.305724 (+1380915us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b180022ee40. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebde0646 00007f29ebd1a58e 00007f29ebd9bf9e 00007f29ebd9d7de 00007f29ebda7b49 00007f29ebda8416 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4
0709 13:01:10.938119 (+2632395us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b58004bf8d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd010aa 00007f29ebd83447 00007f29ebd9bfe7 00007f29ebd9d7de 00007f29ebda7b49 00007f29ebda8416 00007f29ebda4d8f 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4
0709 13:01:11.043321 (+105202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.043488 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5967343360}
I20260709 13:01:11.059907  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.038873  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.061797  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:11.064244  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.037760  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:11.037421  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:11.067191  2243 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:11.068094  6530 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:11.068523  6530 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.068846  6530 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.069713  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.072579  6578 consensus_queue.cc:1243] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:11.073225  6578 raft_consensus.cc:3055] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:11.073607  6578 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:11.074215  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.074858  6178 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.075259  1544 raft_consensus.cc:1240] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:11.075353  6178 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.075970  6462 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.051565  6440 raft_consensus.cc:3055] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:11.076493  6462 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:11.078605  6462 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:11.079432  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:11.070318  1537 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:11.075011  1541 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:11.076843  6440 raft_consensus.cc:740] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:11.032635  6446 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:11.084838  1542 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:11.085860  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:11.063586  6471 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.052232  6558 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.049844  6053 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.091140  1540 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:11.098889  6526 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.051421  6364 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:11.100211  1585 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:11.104362  1659 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:11.105098  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:11.047003  5881 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.046623  6391 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.118224  6391 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:11.118729  1613 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:11.120046  5881 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:11.108402  1544 raft_consensus.cc:2393] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 17: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:11.108124  1692 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:11.107012  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.121479  1618 raft_consensus.cc:1240] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:11.112500  6478 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.112243  6446 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.113076  6240 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.116284  6364 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:11.115825  6440 consensus_queue.cc:260] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.130141  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:11.121994  6405 consensus_meta.cc:287] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.004s
I20260709 13:01:11.131708  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.132248  1543 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:11.132382  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:11.133024  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:11.133348  6264 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:11.133600  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:11.134160  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:11.134663  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.134943  6429 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:01:11.136619  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.163902  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:11.164191  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.164695  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.142371  1539 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:11.130716  1659 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:11.129746  1541 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:11.143738  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:11.144739  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 44586.6us
I20260709 13:01:11.150849  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:11.169596  1612 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.155153  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:11.172634  1545 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:11.174898  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:11.175705  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:11.159705  6178 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:11.181777  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 189315us
W20260709 13:01:11.182467  1511 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.564s (SENT)
I20260709 13:01:11.176309  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:11.182859  1511 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:11.183020  1542 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.183643  6273 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.160293  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:11.184877  1511 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.646s (SENT)
I20260709 13:01:11.102236  6285 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:11.186259  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:11.186849  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.185938  1687 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:11.188443  1541 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
W20260709 13:01:11.190449  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 59824.1us
I20260709 13:01:11.191438  6558 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.193009  1544 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:11.193102  6442 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:11.195798  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.196557  1539 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:11.193261  6364 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.199695  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.174795  6391 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.074512  6578 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.214320  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:11.200582  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.200539  1541 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:11.207494  1660 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:11.212116  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:11.218195  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:11.213265  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.220014  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.221889  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.221838  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:11.224231  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:11.226145  1694 raft_consensus.cc:2393] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:11.195778  6412 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.231127  1545 raft_consensus.cc:2468] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:11.232209  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:11.235253  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:11.233076  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.233755  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.234232  1543 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 13: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:11.236091  1541 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
W20260709 13:01:11.237002  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 81911.2us
I20260709 13:01:11.237176  1692 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:11.201768  6558 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.238631  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.239133  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:11.232108  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:11.235370  2270 raft_consensus.cc:2376] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11. Re-sending same reply.
I20260709 13:01:11.245380  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.214905  6440 raft_consensus.cc:3060] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.145452  6240 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.246174  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:11.250927  1694 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:11.243687  2273 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:01:11.248121  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:11.251736  1616 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.199992  6546 consensus_queue.cc:1059] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:01:11.249591  1618 raft_consensus.cc:2410] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:11.254810  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:11.217360  6254 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.245234  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:11.249022  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:11.252153  1585 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:11.247725  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.199821  6273 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:01:11.259656  1688 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 8.
I20260709 13:01:11.261482  6246 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.262001  6246 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:11.243058  6126 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.263373  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:11.263574  6126 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:11.264006  6126 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.264415  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.265125  1615 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:11.266429  1685 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:11.247625  6531 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.209980  6364 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:11.264448  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:11.242718  6478 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:11.258898  1617 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:11.224416  6264 consensus_queue.cc:1048] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:01:11.265851  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:11.257550  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 72692.5us
I20260709 13:01:11.241869  6577 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:11.273994  1692 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 14. Ops: []
I20260709 13:01:11.247259  6558 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:11.290117  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.293071  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:11.294869  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.296442  1614 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:11.298005  1658 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:11.294366  1693 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:01:11.301635  1615 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:01:11.302129  1615 pending_rounds.cc:85] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 6
I20260709 13:01:11.302407  1615 pending_rounds.cc:107] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:01:11.302724  1615 raft_consensus.cc:2889] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.280342  6578 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.308719  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:11.310509  6470 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:01:11.322674  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 71531.6us
I20260709 13:01:11.325181  1691 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:01:11.255482  6098 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:01:11.326769  1617 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:01:11.333364  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.349529  1686 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:11.350906  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 98798.8us
I20260709 13:01:11.360674  1616 raft_consensus.cc:2410] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:11.364665  1693 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:11.308281  6429 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:11.368662  1660 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:11.308990  6228 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.322088  6472 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:11.369897  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 65974us
I20260709 13:01:11.349555  6547 raft_consensus.cc:2804] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:11.372185  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 49628.8us
I20260709 13:01:11.326093  6531 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:11.380767  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.390254  1686 raft_consensus.cc:1240] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 13:01:11.393404  6602 raft_consensus.cc:3055] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:11.395184  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.393865  6602 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:01:11.394321  1511 leader_election.cc:336] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.758s (SENT)
I20260709 13:01:11.370838  6429 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.376134  6053 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:11.406059  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.408254  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.405599  2271 pending_rounds.cc:85] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 11
I20260709 13:01:11.424921  2271 pending_rounds.cc:107] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:01:11.425182  2271 raft_consensus.cc:2889] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.425091  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.439934  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.444176  6478 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:11.446026  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 73304.7us
W20260709 13:01:11.448500  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.452490  1542 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:11.409314  6429 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.454098  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.459021  1545 raft_consensus.cc:2410] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:11.376444  6577 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.404301  6547 raft_consensus.cc:697] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:11.455453  1541 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:01:11.465696  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.467562  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:11.463449  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:11.464154  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 99435.9us
I20260709 13:01:11.435580  6053 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:11.437662  6446 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:11.474480  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.475082  1542 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
W20260709 13:01:11.476632  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.464354  6285 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:11.476891  1543 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:11.479204  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:11.479776  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 98734.4us
I20260709 13:01:11.481266  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:11.485517  1511 leader_election.cc:336] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.116s (SENT)
I20260709 13:01:11.485965  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:11.482291  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:11.494990  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:11.497628  2272 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:11.502738  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:11.505968  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:11.486444  6590 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:01:11.601616  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:11.602309  1539 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:11.602381  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 96473.6us
I20260709 13:01:11.607419  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.480607  6471 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:11.616288  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 110954us
I20260709 13:01:11.658807  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:11.659999  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 56040.4us
I20260709 13:01:11.496364  6391 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.506170  6541 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:11.681988  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 62571.1us
I20260709 13:01:11.509228  6442 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:11.688371  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.650996  6285 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:11.694489  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 476505us
I20260709 13:01:11.670949  6531 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.478084  6602 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.643813  6240 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:11.670693  6017 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.701431  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:11.718237  1542 raft_consensus.cc:2410] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:01:11.683475  6530 consensus_meta.cc:287] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
W20260709 13:01:11.688745  6599 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.381s	user 0.002s	sys 0.000s
I20260709 13:01:11.688975  6462 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:01:11.670419  6546 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:01:11.682734  6558 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:11.726478  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.687784  6442 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:11.727972  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.710135  1612 consensus_meta.cc:287] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.002s
I20260709 13:01:11.711971  1545 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:11.696623  6053 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:11.715004  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 476752us
I20260709 13:01:11.735353  2241 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:11.716794  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 231258us
W20260709 13:01:11.705683  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44870.8us
W20260709 13:01:11.720129  6606 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
W20260709 13:01:11.720799  6598 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:01:11.721462  6608 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:01:11.722429  6530 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.748447  6530 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:11.749276  6577 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:11.756750  6613 log.cc:927] Time spent T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:11.758224  6471 raft_consensus.cc:1064] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
W20260709 13:01:11.729961  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.737902  1612 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:11.732915  1660 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:11.763660  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:11.743434  1545 raft_consensus.cc:1240] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:11.769457  1539 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:11.688344  6547 consensus_queue.cc:237] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.728668  6442 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.729449  6602 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.797720  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:11.798689  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:11.800034  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.010s
W20260709 13:01:11.801198  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.011s
W20260709 13:01:11.808774  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.835839  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.839498  1511 leader_election.cc:336] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.139s (SENT)
I20260709 13:01:11.740696  6546 consensus_queue.cc:1243] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer e2a2b76c98ee44ff95e6508c34da0e3d log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:11.718825  6312 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:01:11.840090  1511 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:11.723933  6179 consensus_queue.cc:1059] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:01:11.725566  6017 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.724265  6258 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:01:11.857393  1539 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:11.832818  6610 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:11.860960  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:11.760756  6471 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:11.840637  6612 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.840821  6478 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:11.841590  6611 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.839059  6623 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:11.907910  1660 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:11.865454  5881 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.038s	sys 0.062s
W20260709 13:01:11.869086  6434 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.003s	user 0.006s	sys 0.014s
W20260709 13:01:11.940605  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 203471us
I20260709 13:01:11.875507  6462 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:11.943856  1539 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 15. Current term is 16. Ops: [14.9-15.10]
I20260709 13:01:11.947613  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:11.945289  2241 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:11.940296  5881 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.038s	sys 0.062s
I20260709 13:01:11.953249  2275 raft_consensus.cc:2410] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:01:11.900267  6603 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.954782  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:11.957957  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 120199us
I20260709 13:01:11.940236  6053 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:11.953008  6610 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.993688  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:11.996941  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 49396.5us
I20260709 13:01:11.998271  1537 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:12.000509  6244 raft_consensus.cc:3055] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:12.000607  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:12.001060  6434 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:12.001538  6434 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:11.967025  6612 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:11.991742  6335 consensus_meta.cc:287] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 1.043s	user 0.013s	sys 0.000s
I20260709 13:01:12.003533  1539 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:11.947701  6623 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.006511  6617 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:12.006974  6126 consensus_meta.cc:287] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.743s	user 0.004s	sys 0.007s
I20260709 13:01:11.969475  6053 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:12.033174  6634 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:12.033686  6634 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.035622  6634 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:12.035804  6440 consensus_meta.cc:287] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.783s	user 0.008s	sys 0.001s
I20260709 13:01:12.036614  1538 raft_consensus.cc:2410] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:01:12.036693  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2755) took 4275 ms (client timeout 1564 ms). Trace:
I20260709 13:01:12.010339  6442 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:12.026273  6614 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:01:11.994707  6610 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.963076  6228 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:01:12.000949  6244 raft_consensus.cc:740] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:12.025182  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.039167  1688 rpcz_store.cc:269] 0709 13:01:07.761380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.805929 (+ 44549us) service_pool.cc:224] Handling call
0709 13:01:12.036435 (+4230506us) spinlock_profiling.cc:243] Waited 3.32 s on lock 0x7b54001ac7d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:12.036588 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7631252352}
I20260709 13:01:12.037575  6053 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.037680  5881 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:12.070199  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:12.050743  6610 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.077986  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:12.080435  1692 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:12.082129  1688 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:01:12.082492  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 283867us
I20260709 13:01:12.078224  6254 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.038102  6126 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.068482  5881 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.112388  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:12.143811  2273 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:12.143949  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:12.113585  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.037577  6434 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.086870  1694 raft_consensus.cc:2393] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:12.102216  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:12.087594  1618 raft_consensus.cc:3055] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.145186  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:12.087208  6578 consensus_meta.cc:287] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.000s
W20260709 13:01:12.112260  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 2329) took 1559 ms (client timeout 1535 ms). Trace:
I20260709 13:01:12.146341  2277 raft_consensus.cc:1275] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:12.147584  2276 raft_consensus.cc:1240] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:12.081661  6472 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:12.150766  2268 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:12.081486  6405 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.151280  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:12.150496  1618 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:12.152894  1611 rpcz_store.cc:269] 0709 13:01:10.528147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.550634 (+ 22487us) service_pool.cc:224] Handling call
0709 13:01:12.087286 (+1536652us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54001a45d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:12.087455 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899112704}
I20260709 13:01:12.087713  6617 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.159615  6615 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 13:01:12.162283  6621 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:01:12.162760  6405 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:12.163789  6624 log.cc:927] Time spent T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:12.164986  6405 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:12.165271  6625 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:01:12.154511  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:12.156605  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:12.166590  1614 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.110913  6017 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:12.145638  5881 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.174904  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 957) took 1041 ms. Trace:
I20260709 13:01:12.176354  1689 rpcz_store.cc:276] 0709 13:01:11.124696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.124827 (+   131us) service_pool.cc:224] Handling call
0709 13:01:11.164427 (+ 39600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.198624 (+ 34197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.198656 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.215778 (+ 17122us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.801617 (+585839us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:11.801666 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.801750 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.166343 (+364593us) raft_consensus.cc:1685] finished
0709 13:01:12.166365 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.166476 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16359,"raft.queue_time_us":28179,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":69,"thread_start_us":546549,"threads_started":1,"wal-append.queue_time_us":620796}
I20260709 13:01:12.156457  1618 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.192487  1618 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:12.198392  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 96303.2us
I20260709 13:01:12.085752  6244 consensus_queue.cc:260] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.191242  6179 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:12.204011  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:12.194725  6258 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.149971  6254 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.209414  6405 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:12.210000  6405 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.210773  6126 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:12.211926  6405 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:12.214843  6632 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:01:12.215806  6631 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 13:01:12.217243  6633 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:01:12.220448  1614 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 16.
I20260709 13:01:12.224045  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 1172) took 1012 ms. Trace:
I20260709 13:01:12.224401  2272 rpcz_store.cc:276] 0709 13:01:11.211772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.211892 (+   120us) service_pool.cc:224] Handling call
0709 13:01:12.223887 (+1011995us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54006185d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:12.223990 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352737152}
I20260709 13:01:12.225333  6642 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.225806  6642 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.227758  6642 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:12.228711  6635 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:12.232323  6179 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.232789  6179 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.234655  6179 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:12.235172  6179 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.166692  6472 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:12.205453  6391 consensus_meta.cc:287] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.004s
I20260709 13:01:12.244517  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:12.177151  6617 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.255565  6639 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:12.243768  6258 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.255982  6639 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:12.256319  6639 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.257310  6258 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:12.263711  6618 log.cc:927] Time spent T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:01:12.264477  6442 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:12.265225  6623 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:12.267148  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.268875  6429 consensus_meta.cc:287] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.798s	user 0.004s	sys 0.005s
I20260709 13:01:12.269281  6429 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:12.272011  6472 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:12.275206  2273 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:12.246601  6391 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.289459  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:12.296677  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:12.325255  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:12.325958  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 121986us
I20260709 13:01:12.326608  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:12.327410  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:12.327648  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:12.331055  1584 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:12.285319  6472 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.324746  6623 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:12.294211  6391 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.346745  1585 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:12.331970  6644 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.333480  6547 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:12.346148  6642 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.331674  6017 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.352105  6541 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:12.353866  6602 consensus_meta.cc:287] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 13:01:12.355681  6547 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.360014  6623 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:12.365844  6623 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.366300  6623 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:12.367873  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.368535  6610 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.373291  6246 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:12.373502  6617 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:12.380327  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2792) took 1184 ms. Trace:
I20260709 13:01:12.399406  6526 raft_consensus.cc:3055] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:12.398345  1687 rpcz_store.cc:276] 0709 13:01:11.195466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.288615 (+ 93149us) service_pool.cc:224] Handling call
0709 13:01:11.308457 (+ 19842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.464470 (+156013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.464497 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.470051 (+  5554us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.658556 (+188505us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:11.658596 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.379931 (+721335us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b540010a4d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:12.379988 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.380048 (+    60us) raft_consensus.cc:1685] finished
0709 13:01:12.380062 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.380270 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25946,"raft.queue_time_us":73428,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":987,"spinlock_wait_cycles":143714176,"thread_start_us":221270,"threads_started":2,"wal-append.queue_time_us":479766}
I20260709 13:01:12.363863  6541 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.400188  6541 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.400636  6053 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.349656  6391 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.403183  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1237) took 1401 ms. Trace:
I20260709 13:01:12.403558  2275 rpcz_store.cc:276] 0709 13:01:11.002233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.002425 (+   192us) service_pool.cc:224] Handling call
0709 13:01:12.403001 (+1400576us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b5400586bd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:12.403131 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2181828864}
I20260709 13:01:12.404125  6391 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:12.384121  6254 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:12.404462  2273 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:12.405436  2274 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:01:12.405786  2274 pending_rounds.cc:85] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 11
I20260709 13:01:12.406028  2274 pending_rounds.cc:107] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:01:12.406245  2274 raft_consensus.cc:2889] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.356271  6472 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.407027  6622 raft_consensus.cc:3055] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:12.407375  6622 raft_consensus.cc:740] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:12.408203  6622 consensus_queue.cc:260] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.384617  2241 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:12.388967  6639 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.392135  6364 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:12.399783  6526 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:12.360313  6429 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:12.416460  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:12.429850  1691 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:12.381734  6547 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.426330  1618 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
W20260709 13:01:12.427832  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.431505  1618 pending_rounds.cc:85] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 5
I20260709 13:01:12.432279  1692 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:12.408205  6472 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:12.433296  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:12.433815  1687 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:12.434787  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 50227.6us
I20260709 13:01:12.434865  1685 raft_consensus.cc:1275] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:12.435604  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:12.436518  6629 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:12.431780  1618 pending_rounds.cc:107] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:01:12.437655  1618 raft_consensus.cc:2889] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.437660  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:12.439181  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:12.449280  1692 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:12.450083  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:12.450968  6429 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:12.451898  6639 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:12.425733  6053 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:12.456774  6541 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.428211  6622 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.462852  6429 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:12.463558  5881 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.463806  6429 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.465452  5881 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:12.467079  6623 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.463724  1687 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:12.471307  1659 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:12.476524  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 145543us
I20260709 13:01:12.478749  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:12.479873  6541 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:12.480059  2275 raft_consensus.cc:1240] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:12.481320  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:12.482033  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:12.485052  2272 raft_consensus.cc:2393] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:12.485409  2275 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:12.429100  6617 raft_consensus.cc:2804] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:12.483281  2276 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:12.477608  1689 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:12.484054  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:12.483048  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:12.483445  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:01:12.493184  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.493737  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.494469  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 298015us
I20260709 13:01:12.496544  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:12.498088  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 151441us
I20260709 13:01:12.476573  6639 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.501659  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:12.494975  6240 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:12.499607  2243 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:12.462575  6547 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.506110  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:12.498804  6472 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:12.500360  6617 raft_consensus.cc:697] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:12.511559  6472 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.505894  6648 consensus_queue.cc:1059] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:01:12.512194  6617 consensus_queue.cc:237] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.512697  6648 raft_consensus.cc:3055] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.513116  6648 raft_consensus.cc:740] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:12.513615  6391 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.504365  6437 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:01:12.510190  6462 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:12.511970  6472 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.515365  6462 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.519441  2271 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:12.519619  6647 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:12.520788  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:12.521665  1620 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:12.522176  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:12.522845  6471 consensus_queue.cc:1059] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:12.523051  6478 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:12.523579  6478 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.523675  6471 raft_consensus.cc:3055] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:12.524091  6471 raft_consensus.cc:740] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:12.524784  6471 consensus_queue.cc:260] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.525913  6471 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.527125  1615 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:01:12.527419  1615 pending_rounds.cc:85] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 5
I20260709 13:01:12.527626  1615 pending_rounds.cc:107] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:01:12.527822  1615 raft_consensus.cc:2889] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.519021  6254 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:12.529078  1614 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:12.531201  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:12.531790  1614 raft_consensus.cc:2393] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:12.533025  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:12.533566  1620 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:12.528455  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2351) took 1305 ms. Trace:
I20260709 13:01:12.534226  1618 rpcz_store.cc:276] 0709 13:01:11.223331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.300806 (+ 77475us) service_pool.cc:224] Handling call
0709 13:01:12.087442 (+786636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.438253 (+350811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.528222 (+ 89969us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54001a45d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:12.528376 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695022336}
I20260709 13:01:12.505610  6541 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:12.506378  6053 raft_consensus.cc:2804] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.503659  6610 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:12.541443  1689 raft_consensus.cc:1240] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:12.540942  1691 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:12.514142  6391 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.536408  2243 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:12.544591  2270 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
W20260709 13:01:12.545044  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.566534  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:12.567595  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:12.504742  6639 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.646545  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:12.568382  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:12.520871  6462 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:12.570659  1687 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:12.566426  6653 consensus_queue.cc:1048] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:01:12.568689  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:12.648006  1686 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:12.648878  1615 raft_consensus.cc:2410] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 14.
W20260709 13:01:12.580472  6656 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:12.580781  6658 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.510175  6178 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:01:12.511018  6642 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:01:12.506211  6226 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:01:12.514068  6648 consensus_queue.cc:260] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.584880  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:12.598227  6285 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:12.600775  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1241) took 1592 ms. Trace:
I20260709 13:01:12.680197  2274 rpcz_store.cc:276] 0709 13:01:11.008244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.008343 (+    99us) service_pool.cc:224] Handling call
0709 13:01:12.405131 (+1396788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.406686 (+  1555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.600518 (+193832us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400586bd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:12.600704 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3172299648}
W20260709 13:01:12.605417  6627 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.549s	user 0.000s	sys 0.003s
W20260709 13:01:12.624857  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.626475  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.632472  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 65635.5us
I20260709 13:01:12.644758  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 1976) took 1361 ms. Trace:
I20260709 13:01:12.546064  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:12.646962  2271 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.579649  6547 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:12.650470  6364 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:12.644594  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:12.806227  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:12.806737  1694 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:12.654765  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 587960us
I20260709 13:01:12.808171  1509 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:12.682188  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 146678us
I20260709 13:01:12.639310  5881 raft_consensus.cc:2804] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:12.652565  6580 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.653002  6437 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:12.685174  1545 rpcz_store.cc:276] 0709 13:01:11.283463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.845117 (+561654us) service_pool.cc:224] Handling call
0709 13:01:11.859582 (+ 14465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.644405 (+784823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.644452 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.644492 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:12.644524 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.644593 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.644696 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":784471,"raft.queue_time_us":792246,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7118}
I20260709 13:01:12.743398  1686 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:12.661877  6578 consensus_queue.cc:1059] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 13:01:12.745265  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:12.739888  6391 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:12.825626  1541 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:12.740163  6541 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:12.796294  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.797308  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 985) took 1678 ms. Trace:
I20260709 13:01:12.793813  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:12.802333  6623 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.812608  6258 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.814316   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:12.833053  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:12.834347  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 1.03727e+06us
I20260709 13:01:12.835896  6240 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:12.836514  6240 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.836536  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:12.830435  1540 rpcz_store.cc:276] 0709 13:01:11.119164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.194630 (+ 75466us) service_pool.cc:224] Handling call
0709 13:01:11.194925 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.195128 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:11.371668 (+176540us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.608191 (+1236523us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.796985 (+188794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.797038 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:12.797081 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.797150 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.797258 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":938162,"prepare.queue_time_us":271915,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":2031,"raft.queue_time_us":976277,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7725,"spinlock_wait_cycles":36066432,"thread_start_us":613744,"threads_started":3,"wal-append.queue_time_us":466422}
I20260709 13:01:12.837436  1686 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:12.837973  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:12.838284  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:12.849821  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:12.850451  1686 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.854923  6623 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:12.857453  6623 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:12.858312  1686 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:12.819469  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:12.820170  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:12.859661  1544 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:12.859814  1536 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 7.
I20260709 13:01:12.815013  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:12.654946  6053 raft_consensus.cc:697] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:01:12.823448  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 196101us
I20260709 13:01:12.815678  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:12.862185  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.794576  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 112723us
I20260709 13:01:12.862317  1537 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:01:12.819031  6648 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.793826  6440 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.867781  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:12.739780  6647 consensus_queue.cc:1048] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.116s
I20260709 13:01:12.835974  6580 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:12.838797  1540 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 16.
I20260709 13:01:12.839221  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:12.839471  6547 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:12.841056  6668 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.212s
W20260709 13:01:12.842144  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.847254  5881 raft_consensus.cc:697] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:12.847332  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:12.848765  1685 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 14: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:12.681573  6285 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:12.812116  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 266526us
I20260709 13:01:12.803601  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2372) took 1578 ms. Trace:
I20260709 13:01:12.814304  1510 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:12.827271  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:12.833840  1541 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:12.794453  6335 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.803580  6577 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:12.869475  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.793790  6462 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:01:12.871315  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:12.870818  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:12.838553  6240 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:12.915726  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.087829  2273 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:12.869918  6264 consensus_queue.cc:1059] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.219s
I20260709 13:01:13.089022  1585 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:13.089604  6264 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.092993  6643 raft_consensus.cc:3055] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:13.007790  1615 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:13.093518  6643 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:13.008255  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.094501  6643 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:12.869999  6658 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.226s
I20260709 13:01:13.009215  1614 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:13.096045  6643 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:12.967830  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 153586us
I20260709 13:01:13.008654  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:13.011293  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.075727  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:13.029784  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.100383  2268 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:12.966799  1545 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:13.101744  1685 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 9: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:13.046470  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:13.102170  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 231389us
I20260709 13:01:13.102527  1537 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.997304  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:13.016736  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:13.103886  1686 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.875944  1611 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:12.971725  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:13.107008  6434 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.868681  6446 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:12.874348  6258 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:12.991165  1658 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:13.109567  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:12.947291  6602 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.114444  1694 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:13.115954  1693 raft_consensus.cc:2393] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:01:13.149036  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 60085us
I20260709 13:01:13.148432  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.152199  1545 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.872859  6017 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.220s
I20260709 13:01:12.971805  6580 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.152261  1544 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:13.121281  1536 raft_consensus.cc:3060] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.966389  1542 rpcz_store.cc:276] 0709 13:01:11.225419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.763402 (+537983us) service_pool.cc:224] Handling call
0709 13:01:11.832355 (+ 68953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.832530 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:11.852619 (+ 20089us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.803071 (+950452us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.803145 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:12.803212 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.803323 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.803530 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":672759,"prepare.queue_time_us":23009,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":683000,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":20200,"thread_start_us":277184,"threads_started":2,"wal-append.queue_time_us":225431}
W20260709 13:01:13.054478  1428 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d53120c1adf947fd992e5950edf26301 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0cccd9c43f9747529680a8e7463961c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:13.087009  6335 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.090202  6264 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.010294  6639 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:13.153688  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 162583us
W20260709 13:01:12.948282  6652 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:01:12.916563  6440 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:12.972152  6676 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.064049  6478 consensus_meta.cc:287] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.002s
I20260709 13:01:12.947291  6657 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.212s
I20260709 13:01:12.991832  6577 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:13.063661  6622 consensus_meta.cc:287] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.005s
I20260709 13:01:13.087035  6547 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.146226  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:13.121899  6434 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.163861  6678 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.203774  6678 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.165966  6285 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:13.155054  6659 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.208514  6659 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:13.214259  6609 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.381s	user 0.000s	sys 0.003s
I20260709 13:01:13.111430  6541 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:13.156797  6602 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.220373  6602 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:13.225418  6580 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:13.229693  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.232884  6654 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.879s	user 0.001s	sys 0.001s
W20260709 13:01:13.233448  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 979) took 2116 ms (client timeout 1819 ms). Trace:
W20260709 13:01:13.233831  1538 rpcz_store.cc:269] 0709 13:01:11.117219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.129440 (+ 12221us) service_pool.cc:224] Handling call
0709 13:01:13.233233 (+2103793us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54001b8354. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:13.233372 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051037568}
I20260709 13:01:13.235106  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 1065) took 1085 ms. Trace:
I20260709 13:01:13.235499  1612 rpcz_store.cc:276] 0709 13:01:12.150140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.150335 (+   195us) service_pool.cc:224] Handling call
0709 13:01:12.164638 (+ 14303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.195008 (+ 30370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.195046 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.203198 (+  8152us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.325240 (+122042us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:12.325298 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.329501 (+  4203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.232139 (+902638us) spinlock_profiling.cc:243] Waited 999 us on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:13.234832 (+  2693us) raft_consensus.cc:1685] finished
0709 13:01:13.234852 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.235051 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32613,"raft.queue_time_us":31862,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":763,"spinlock_wait_cycles":2297088,"thread_start_us":78814,"threads_started":1,"wal-append.queue_time_us":108292}
I20260709 13:01:13.171734  1686 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
W20260709 13:01:13.171394  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 344183us
I20260709 13:01:13.237840  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:13.251268  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.199760  1543 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:13.180210  1539 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.253434  2273 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:13.200551  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.184125  1545 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:13.178251  1536 raft_consensus.cc:2468] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
W20260709 13:01:13.247866  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 300292us
I20260709 13:01:13.187570  1541 raft_consensus.cc:3060] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.198077  1687 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:13.166767  1428 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 338041us
I20260709 13:01:13.180737  1658 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:13.259223  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 78669us
I20260709 13:01:13.166364  1542 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:13.238454  2271 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:13.264719  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.268201  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:13.259718  1658 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:13.271317  1584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.187273  6547 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:13.273008  6519 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:13.273114  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:13.273504  6519 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.273876  6519 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:13.193601  6526 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.275758  6526 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.279086  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.171831  6677 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:13.280026  6240 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:13.280527  6677 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:13.281018  6677 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.280753  6240 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.283277  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:13.201651  6471 consensus_meta.cc:287] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.000s
I20260709 13:01:13.268075  6254 raft_consensus.cc:2764] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:01:13.199349  6666 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
I20260709 13:01:13.302742  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:13.168164  6335 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:13.168593  6264 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:13.171218  6470 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.116s
W20260709 13:01:13.196318  6650 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.846s	user 0.001s	sys 0.000s
I20260709 13:01:13.288020  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.288672  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.288861  1543 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:13.289489  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:13.353128  1612 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:13.289951  1511 leader_election.cc:336] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 2.332s (SENT)
I20260709 13:01:13.163028  6648 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:13.295691  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.202634  6531 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.297475  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.369830  1615 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:01:13.287849  6312 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:13.301632  1584 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:13.375671  1618 raft_consensus.cc:2393] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 9: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:01:13.375597  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 74033.1us
I20260709 13:01:13.377406  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:13.199115  6434 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.185148  6577 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:13.198817  6610 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.181706  6440 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:13.154824  6679 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.195947  6364 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:13.411095  6679 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:13.411625  6240 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:13.411224  6364 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:13.412075  6679 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.413359  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.413800  6364 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:13.414068  2271 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:01:13.314774  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 262669us
I20260709 13:01:13.414853  6285 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.416720  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.417851  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.417979  2243 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:13.419417  6019 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:13.419766  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:13.295331  2270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:40644
I20260709 13:01:13.420250  6636 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:13.420825  2270 raft_consensus.cc:606] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:13.421231  2270 raft_consensus.cc:614] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:13.421284  6636 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:13.421823  6636 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:13.423058  6636 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.284489  6429 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:01:13.182279  6478 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.283571  6391 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.186782  5881 consensus_queue.cc:237] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.182024  6676 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.365541  6519 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:13.366781  6675 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:13.368848  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.155186  6446 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:13.294559  6472 consensus_meta.cc:287] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.749s	user 0.014s	sys 0.002s
I20260709 13:01:13.370306  1539 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:13.289238  6634 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:13.297530  6659 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:13.298480  1537 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
W20260709 13:01:13.380865  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 113244us
I20260709 13:01:13.380915  6226 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:13.304988  6547 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:13.449540  6626 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:13.462953  1688 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:13.389252  6671 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:13.394304  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.347136  6669 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:01:13.396417  6642 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:13.475008  1538 pending_rounds.cc:85] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 9
I20260709 13:01:13.478775  1538 pending_rounds.cc:107] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:01:13.479005  1538 raft_consensus.cc:2889] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.479333  6519 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:13.455049  6675 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.480105  6675 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.403863  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.405340  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.427517  6610 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:13.483732  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:13.484241  1620 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.484347  6610 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:13.449276  6526 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.485159  6526 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:13.406318  1613 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:13.487025  6526 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:13.487453  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:13.408425  6670 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.572s	user 0.001s	sys 0.001s
W20260709 13:01:13.408525  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.363094  6258 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.424459  6244 raft_consensus.cc:3060] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.424970  6364 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.375562  6531 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.369530  6648 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.418397  1619 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:13.433960  2274 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:13.434458  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.506023  2271 raft_consensus.cc:2410] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:13.420828  1660 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:13.453058  1612 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
W20260709 13:01:13.508427  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 87657.3us
I20260709 13:01:13.509088  1660 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:13.476900  6636 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.163914  6053 consensus_queue.cc:237] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.456840  1585 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:13.510802  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 54033.8us
W20260709 13:01:13.458246  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.460688  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.459673  1541 raft_consensus.cc:2468] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 16.
I20260709 13:01:13.382656  6546 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:13.477420  1614 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:13.478343  6642 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:13.403208  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.382388  6312 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:13.456977  6634 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:13.499482  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.472904  6671 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:13.380280  6678 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:13.512961  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.533423  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.533898  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.534242  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.510082  6648 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.516630  1612 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:01:13.538298  1612 pending_rounds.cc:85] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 9
I20260709 13:01:13.538699  1612 pending_rounds.cc:107] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:13.538990  1612 raft_consensus.cc:2889] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.517272  6519 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.517623  1618 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:13.461493  6472 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.475508  6226 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:13.510628  6558 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:13.475322  6547 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.515945  6526 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.577243  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:13.577788  6019 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:13.577962  6434 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.579337  6446 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:13.579995  6671 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:13.516057  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 418558us
I20260709 13:01:13.581058  6671 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.518363  6668 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:13.583487  6668 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.583914  6668 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.584736  2273 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 13:01:13.585032  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.543601  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:13.585794  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.532958  6546 raft_consensus.cc:697] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:13.532102  6634 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.591078  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.591831  1537 raft_consensus.cc:2368] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:01:13.529124  6610 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:01:13.512759  1660 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:13.554013  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.555095  1620 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:13.609413  1612 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:13.575176  6478 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:13.575860  6226 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:13.612787  6478 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:13.613268  6478 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.613725  6478 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:13.615157  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 102437us
I20260709 13:01:13.616040  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:13.588303  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.590018  1617 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:01:13.629810  1617 pending_rounds.cc:85] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 9
I20260709 13:01:13.630088  1617 pending_rounds.cc:107] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:01:13.630333  1617 raft_consensus.cc:2889] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.576567  6676 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:13.620195  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.632329  6519 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:13.632529  1660 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:13.633029  6519 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:13.634166  6519 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:13.634965  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:13.638444  6526 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:13.591387  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:13.640021  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.657346  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.553212  6440 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.658486  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.663455  1537 raft_consensus.cc:2410] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:01:13.663769  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 72451us
I20260709 13:01:13.664176  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.646633  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:13.643860  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:13.651494  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.640836  6655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.007s	sys 0.020s
I20260709 13:01:13.654181  6546 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:13.647778  6676 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:13.664780  1537 raft_consensus.cc:2368] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:01:13.664800  2241 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:13.673249  1686 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:13.674278  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:13.587435  6558 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:13.681310  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 137789us
I20260709 13:01:13.593600  6580 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:13.689702  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:13.670362  6655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.007s	sys 0.020s
I20260709 13:01:13.657850  6526 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.694864  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:13.740217  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:13.662710  6669 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:13.743012  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:13.743685  1537 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:13.663143  6641 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.003s	sys 0.021s
I20260709 13:01:13.662961  6684 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:13.741094  1691 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
W20260709 13:01:13.775621  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.850709  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 155864us
W20260709 13:01:13.854219  6667 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.007s	user 0.007s	sys 0.000s
I20260709 13:01:13.855472  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:13.872411  1692 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:13.656752  6577 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:01:13.921988  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.923641  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:13.924273  1543 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.928262  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:13.930450  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:13.932708  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:13.655064  6642 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.943181  1537 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:13.944876  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.945629  1537 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:13.947036  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:13.948633  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:13.949316  1537 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.952332  1685 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:13.657639  6312 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:13.953037  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:13.857661  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.859478  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.954795  1617 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
W20260709 13:01:13.956079  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.860236  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.682612  6643 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:13.682046  6688 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.910864  1584 leader_election.cc:400] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
W20260709 13:01:13.749970  6641 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.007s	sys 0.022s
I20260709 13:01:13.914808  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:13.688781  6687 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.745060  6526 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.671789  6440 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:13.974897  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.980432  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 108435us
W20260709 13:01:13.981290  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 238910us
I20260709 13:01:13.871519  6684 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:13.981336  1584 leader_election.cc:403] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:13.985160  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:13.995862  1616 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:01:13.962328  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:13.932658  6637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.017s	sys 0.031s
I20260709 13:01:13.992647  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:13.984316  6578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.012s	sys 0.042s
I20260709 13:01:14.002169  2277 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:14.000423  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:14.005719  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:13.951292  6617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.000s	sys 0.030s
I20260709 13:01:13.920105  6446 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:01:13.983290  6643 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.991564  6642 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.919106  6541 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
W20260709 13:01:13.998739  6637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.018s	sys 0.031s
I20260709 13:01:14.010356  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:14.015872  1613 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.015s	sys 0.032s
I20260709 13:01:14.016952  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:14.030884  1613 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.015s	sys 0.032s
I20260709 13:01:14.031214  1617 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:13.932327  6437 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:01:13.990797  6531 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:14.016250  6675 consensus_meta.cc:287] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.004s
I20260709 13:01:13.851809  6669 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.002076  6264 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.998510  6684 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:14.014314  6617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.000s	sys 0.031s
I20260709 13:01:13.991032  6688 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:14.005610  6578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.012s	sys 0.042s
I20260709 13:01:14.010126  6412 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.990736  6179 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:01:14.014349  6602 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:01:14.012933  6530 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:14.044270  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 133580us
I20260709 13:01:14.001866  6686 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:14.015467  6643 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:14.011794  6673 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.014s	sys 0.041s
I20260709 13:01:14.036409  6472 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.034979  6178 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
W20260709 13:01:14.046017  6699 log.cc:927] Time spent T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:01:14.069416  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2382) took 1322 ms. Trace:
I20260709 13:01:14.043998  6434 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.055080  6531 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:01:14.121438  1584 leader_election.cc:400] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:01:14.127018  1584 leader_election.cc:403] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:14.110608  2276 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:14.125497  1539 rpcz_store.cc:276] 0709 13:01:12.746693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.746825 (+   132us) service_pool.cc:224] Handling call
0709 13:01:14.069178 (+1322353us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b540025b7d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:14.069332 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858573568}
I20260709 13:01:14.128334  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.129000  1539 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
W20260709 13:01:14.147044  6680 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.424s	user 0.000s	sys 0.001s
I20260709 13:01:14.122023  6617 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:14.147351  6690 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:01:14.147583  6617 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:14.148574  6617 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.149856  6617 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:14.151233  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 1999) took 1446 ms. Trace:
I20260709 13:01:14.151669  1690 rpcz_store.cc:276] 0709 13:01:12.704536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.735827 (+ 31291us) service_pool.cc:224] Handling call
0709 13:01:12.807299 (+ 71472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:12.812691 (+  5392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.812734 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:12.829006 (+ 16272us) log.cc:844] Serialized 52 byte log entry
0709 13:01:13.254827 (+425821us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:13.254859 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.254918 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.150998 (+896080us) raft_consensus.cc:1685] finished
0709 13:01:14.151019 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.151171 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4901,"raft.queue_time_us":11731,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5446,"thread_start_us":415663,"threads_started":1,"wal-append.queue_time_us":696636}
I20260709 13:01:14.049690  6675 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.060539  6264 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.123553  6437 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:14.167538  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.168890  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.169580  1539 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:01:14.120843  6637 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:14.178560  1537 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
W20260709 13:01:14.122311  6673 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.014s	sys 0.041s
W20260709 13:01:14.156898  6478 consensus_meta.cc:287] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.002s
I20260709 13:01:14.181340  1511 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:14.181664  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 60368.1us
I20260709 13:01:14.155577  6437 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.183939  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.206472  1539 raft_consensus.cc:2410] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:14.204527  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:14.116644  6412 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.156724  6429 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:14.210608  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:14.211169  6178 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:14.211269  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:14.225273  1511 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:14.215211  6698 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:01:14.215253  6694 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:14.170809  6580 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.219595  1543 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:01:14.179147  6637 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:14.220021  1539 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:14.166569  6678 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:01:14.204892  1537 raft_consensus.cc:1240] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:14.245374  1537 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 15. Current term is 16. Ops: [14.9-15.10]
I20260709 13:01:14.238451  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:14.180989  6558 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.246940  1537 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:01:14.247764  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.207685  6437 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:14.235800  6519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.027s	sys 0.012s
I20260709 13:01:14.257866  1537 raft_consensus.cc:1275] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:01:14.259505  1537 pending_rounds.cc:85] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 9
I20260709 13:01:14.260057  1537 pending_rounds.cc:107] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:14.210608  6531 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.261842  1537 raft_consensus.cc:2889] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.211203  6675 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.236425  6440 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.235136  6472 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.235173  6446 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:14.281054  6668 consensus_meta.cc:287] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.002s
I20260709 13:01:14.281507  6668 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.283066  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1260) took 1052 ms. Trace:
I20260709 13:01:14.250876  6602 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.284652  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:14.208593  6478 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:14.242146  6659 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.243338  6637 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.251060  6686 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:14.262405  6519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.028s	sys 0.012s
W20260709 13:01:14.286460  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 48062us
I20260709 13:01:14.292604  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:14.291210  1617 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:14.293247  6526 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.293932  6226 raft_consensus.cc:2764] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:14.294586  1687 raft_consensus.cc:1240] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:14.298784  6602 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.299347  6675 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.299762  6688 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.300768  6602 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.304703  6412 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.239804  6429 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.307577  1511 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:14.283571  2269 rpcz_store.cc:276] 0709 13:01:13.230411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.233654 (+  3243us) service_pool.cc:224] Handling call
0709 13:01:13.234001 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.234378 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.234406 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.238650 (+  4244us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.667876 (+429226us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:13.667928 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.668017 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.282756 (+614739us) raft_consensus.cc:1685] finished
0709 13:01:14.282785 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.282974 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":363770,"threads_started":1,"wal-append.queue_time_us":760995}
W20260709 13:01:14.311064  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 348745us
I20260709 13:01:14.312398  1658 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:14.304109  6648 consensus_meta.cc:287] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.000s
W20260709 13:01:14.308606  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 292921us
W20260709 13:01:14.317499  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 311812us
W20260709 13:01:14.304711  6691 log.cc:927] Time spent T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.378s	user 0.002s	sys 0.000s
I20260709 13:01:14.336536  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:14.337477  1659 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:14.330736  1615 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:14.305658  6696 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:14.320770  6541 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.288584  6472 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.321848  6688 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:14.356837  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 49353.7us
I20260709 13:01:14.360110  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:14.342504  6659 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:14.383455  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.346135  6519 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:14.391798  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:14.329916  6648 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:14.412417  1511 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:14.420409  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 419967us
I20260709 13:01:14.359754  6264 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.359839  6577 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:14.437813  6178 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.446192  6714 log.cc:927] Time spent T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:01:14.445998  6178 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:14.448052  6178 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.448706  6688 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.451725  6675 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.457620  6688 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.430332  6258 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:01:14.434141  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:14.437328  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:14.563315  2275 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:14.563546  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 129484us
W20260709 13:01:14.416608  1428 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d53120c1adf947fd992e5950edf26301 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0cccd9c43f9747529680a8e7463961c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:14.457367  6684 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:14.410032  6686 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:01:14.409750  6696 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:01:14.410259  6531 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.392900  6659 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:14.568811  6659 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.569761  6258 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:14.570757  6178 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:14.571380  6178 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:14.572418  6178 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.427695  6240 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:01:14.570389  6258 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:14.478372  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 138540us
I20260709 13:01:14.576463  6240 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.576963  6240 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.578796  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 1179) took 2078 ms. Trace:
I20260709 13:01:14.422370  6519 raft_consensus.cc:697] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:01:14.579454  6721 log.cc:927] Time spent T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:14.579229  2276 rpcz_store.cc:276] 0709 13:01:12.500500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.502015 (+  1515us) service_pool.cc:224] Handling call
0709 13:01:12.510175 (+  8160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.127755 (+1617580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.578561 (+450806us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540046df54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:14.578738 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3679712128}
I20260709 13:01:14.580564  6519 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.445156  6526 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.360498  6541 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.588668  6541 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.482527  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
W20260709 13:01:14.445190  6679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.009s	sys 0.018s
W20260709 13:01:14.589437  6679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.010s	sys 0.018s
W20260709 13:01:14.480258  6713 log.cc:927] Time spent T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:01:14.589985  1617 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 16.
I20260709 13:01:14.474203  6668 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:14.523138  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 178436us
I20260709 13:01:14.591018  6547 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.591243  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 1087) took 1115 ms. Trace:
I20260709 13:01:14.591670  1620 rpcz_store.cc:276] 0709 13:01:13.476143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.609672 (+133529us) service_pool.cc:224] Handling call
0709 13:01:13.609997 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.610331 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.610365 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.610861 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.061349 (+450488us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:14.061401 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.061483 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.591045 (+529562us) raft_consensus.cc:1685] finished
0709 13:01:14.591075 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.591192 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1808,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":449668,"threads_started":1,"wal-append.queue_time_us":694859}
I20260709 13:01:14.527827  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:14.484840  6693 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:14.544255  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:14.599018  1685 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
W20260709 13:01:14.529152  6671 consensus_meta.cc:287] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.948s	user 0.011s	sys 0.001s
I20260709 13:01:14.548537  1692 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:01:14.553326  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.013s	sys 0.018s
W20260709 13:01:14.605096  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.013s	sys 0.018s
I20260709 13:01:14.605386  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:14.605675  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2384) took 1858 ms. Trace:
I20260709 13:01:14.528033  6643 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.528038  6647 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:14.540022  6653 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:14.556272  6478 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:14.553882  6677 consensus_meta.cc:287] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.270s	user 0.010s	sys 0.004s
I20260709 13:01:14.564590  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:14.564635  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.632313  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 67833.2us
I20260709 13:01:14.525871  6726 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.636284  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:14.636595  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:14.636946  1692 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:14.637251  2270 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:14.610968  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:14.639143  2274 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:14.561589  6709 log.cc:927] Time spent T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:01:14.615342  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:14.565364  6429 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.626905  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:14.650388  1537 raft_consensus.cc:3060] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:14.625557  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:14.625869  1428 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 209277us
W20260709 13:01:14.565980  6642 consensus_meta.cc:287] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.004s
I20260709 13:01:14.606067  1540 rpcz_store.cc:276] 0709 13:01:12.747505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.148858 (+401353us) service_pool.cc:224] Handling call
0709 13:01:13.149253 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.149447 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:13.589281 (+439834us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.605389 (+1016108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.605435 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:14.605478 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.605537 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.605629 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":699700,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":45146,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":15674,"thread_start_us":1436532,"threads_started":3,"wal-append.queue_time_us":621476}
W20260709 13:01:14.592058  6720 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:14.641731  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
W20260709 13:01:14.698662  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 63297us
I20260709 13:01:14.698945  1541 raft_consensus.cc:606] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:14.612160  6472 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.699330  1541 raft_consensus.cc:614] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:14.591890  6701 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.462s	user 0.000s	sys 0.010s
I20260709 13:01:14.652707  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.697412  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.697576  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.704607  1692 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:14.598547  6669 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.705806  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:14.650687  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:14.717042  1545 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:14.724989  1685 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:01:14.729717  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:14.642832  6671 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:14.734066  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 250902us
W20260709 13:01:14.735391  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 88827.6us
I20260709 13:01:14.730316  2268 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:14.749583  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:14.772079  2270 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:14.722747  2275 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:14.757011  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:14.640072  6547 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:14.655010  6446 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:01:14.762081  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 183335us
I20260709 13:01:14.782963  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:14.783644  1692 raft_consensus.cc:2393] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:14.784904  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:14.785701  1689 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:14.644850  6677 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.792776  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:14.793640  1692 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:14.798661  1692 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:01:14.775539  1510 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:14.800230  1692 raft_consensus.cc:1240] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:14.777064  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:14.801003  2276 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:14.706373  6731 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:14.774503  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:14.772778  1685 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:14.781776  1540 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:14.764685  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1266) took 1222 ms. Trace:
I20260709 13:01:14.808054  2271 rpcz_store.cc:276] 0709 13:01:13.542025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.542167 (+   142us) service_pool.cc:224] Handling call
0709 13:01:13.542569 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.544931 (+  2362us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:13.576770 (+ 31839us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.532159 (+955389us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.532598 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.532762 (+   164us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:14.532794 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.532867 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.764435 (+231568us) raft_consensus.cc:1685] finished
0709 13:01:14.764461 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.764601 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7692,"prepare.queue_time_us":494821,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":63876,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":38273,"thread_start_us":954515,"threads_started":2,"wal-append.queue_time_us":627763}
I20260709 13:01:14.789088  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:14.789804  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:14.790133  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:14.811246  1612 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:14.812770  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.810593  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:14.822551  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:14.827433  1692 raft_consensus.cc:1240] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:14.762584  6648 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:14.829783  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:14.835436  1615 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:01:14.835767  1615 pending_rounds.cc:85] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 8
I20260709 13:01:14.835976  1615 pending_rounds.cc:107] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:01:14.836210  1615 raft_consensus.cc:2889] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.830813  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:14.837432  1620 raft_consensus.cc:2368] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10.
I20260709 13:01:14.830860  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:14.838214  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:14.822333  1509 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:14.832410  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.839919  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:14.648036  6726 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:14.833252  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 57797.9us
I20260709 13:01:14.841024  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 974) took 1180 ms. Trace:
I20260709 13:01:14.841269  1614 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:14.841392  1510 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:14.833427  1691 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:14.630570  6312 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.160s
I20260709 13:01:14.838042  1685 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 7.
I20260709 13:01:14.838866  1690 raft_consensus.cc:2468] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:14.766992  6240 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.841392  1688 rpcz_store.cc:276] 0709 13:01:13.660569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.661770 (+  1201us) service_pool.cc:224] Handling call
0709 13:01:13.680519 (+ 18749us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:13.680957 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.681002 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:13.739543 (+ 58541us) log.cc:844] Serialized 78 byte log entry
0709 13:01:14.237293 (+497750us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:14.558763 (+321470us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.766363 (+207600us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.840578 (+ 74215us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.840757 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.840821 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.840856 (+    35us) raft_consensus.cc:1685] finished
0709 13:01:14.840867 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.840978 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73766,"prepare.queue_time_us":331896,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":31246,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":47568,"thread_start_us":811636,"threads_started":3,"wal-append.queue_time_us":527711}
I20260709 13:01:14.849913  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.850515  1540 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:14.802064  1537 raft_consensus.cc:2468] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:14.637084  6647 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:14.875810  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 53553.8us
W20260709 13:01:14.848595  6744 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:01:14.852650  1612 raft_consensus.cc:2468] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:14.881397  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 999) took 2082 ms. Trace:
I20260709 13:01:14.892910  1538 rpcz_store.cc:276] 0709 13:01:12.798856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.234758 (+435902us) service_pool.cc:224] Handling call
0709 13:01:13.267853 (+ 33095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.479543 (+211690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.479574 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.479977 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.747124 (+267147us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:13.747171 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.591302 (+844131us) spinlock_profiling.cc:243] Waited 948 us on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:14.625762 (+ 34460us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54002c0e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:14.625816 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.881164 (+255348us) raft_consensus.cc:1685] finished
0709 13:01:14.881184 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.881333 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478157440,"thread_start_us":266792,"threads_started":1,"wal-append.queue_time_us":602331}
I20260709 13:01:14.889339  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:14.906752  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.908186  6643 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:14.908253  1690 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:14.806468  6244 consensus_queue.cc:1048] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:01:14.838450  6688 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:14.912642  1509 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:14.839794  6258 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.807538  6547 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.840062  6617 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:14.856385  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:14.931089  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:14.807870  6446 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:14.813330  6684 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:14.880844  6531 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:14.874040  6731 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:14.940878  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:14.941346  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:14.945673  1620 raft_consensus.cc:2410] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:14.889225  6578 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:14.948051  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 125556us
W20260709 13:01:14.959658  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 47087us
I20260709 13:01:14.964745  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:14.960788  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:14.899394  6671 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:14.970201  6671 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.970916  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
W20260709 13:01:14.971707  6636 consensus_meta.cc:287] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.454s	user 0.007s	sys 0.003s
I20260709 13:01:14.972370  6671 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:14.947644  6724 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.973825  6724 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.966886  1690 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:14.947489  6440 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:14.964788  1509 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:14.975553  6440 raft_consensus.cc:3055] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:14.975906  6440 raft_consensus.cc:740] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:14.976727  6531 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:14.977174  6531 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.977517  6531 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.978121  6696 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:14.978622  6696 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:14.978885  6679 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:14.979449  6679 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:14.980492  6696 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.981228  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2394) took 1488 ms. Trace:
W20260709 13:01:14.981750  6737 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
W20260709 13:01:14.983769  6734 log.cc:927] Time spent T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.329s	user 0.000s	sys 0.000s
I20260709 13:01:14.985826  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 2000) took 1324 ms. Trace:
W20260709 13:01:14.987251  6733 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:01:14.986261  1543 rpcz_store.cc:276] 0709 13:01:13.661709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.241305 (+579596us) service_pool.cc:224] Handling call
0709 13:01:14.241650 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.289438 (+ 47788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.289482 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.306385 (+ 16903us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.526633 (+220248us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:14.526710 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.579549 (+ 52839us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b54002c2254. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:14.579620 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.985533 (+405913us) raft_consensus.cc:1685] finished
0709 13:01:14.985553 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.985769 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3367,"raft.queue_time_us":20184,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":11789,"spinlock_wait_cycles":101116800,"thread_start_us":182853,"threads_started":1,"wal-append.queue_time_us":529606}
I20260709 13:01:14.968422  6446 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.962883  1538 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
W20260709 13:01:14.988309  6437 consensus_meta.cc:287] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.000s
I20260709 13:01:14.988689  6437 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:14.989675  1538 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:01:14.990509  6742 log.cc:927] Time spent T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:01:14.990756  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.940917  6558 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.981635  1542 rpcz_store.cc:276] 0709 13:01:13.492956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.493081 (+   125us) service_pool.cc:224] Handling call
0709 13:01:13.497007 (+  3926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.532498 (+ 35491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.532544 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.539818 (+  7274us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.052191 (+512373us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:14.056699 (+  4508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.980891 (+924192us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400354654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:14.980935 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.980978 (+    43us) raft_consensus.cc:1685] finished
0709 13:01:14.980991 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.981175 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":4981,"spinlock_wait_cycles":80702208,"thread_start_us":466376,"threads_started":1,"wal-append.queue_time_us":775777}
I20260709 13:01:14.991492  6558 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:14.993384  1585 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:14.969225  6731 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:14.995268  6732 log.cc:927] Time spent T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:01:14.997674  1538 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:14.993533  6558 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.998157  6244 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:14.999089  6671 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:15.000347  6671 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.002928  6723 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.003062  6671 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.003417  6723 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.005801  6558 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:15.006291  6558 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:15.007359  6743 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
W20260709 13:01:15.008347  6717 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.477s	user 0.000s	sys 0.001s
I20260709 13:01:15.009825  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2382) took 1352 ms. Trace:
I20260709 13:01:15.010196  1618 rpcz_store.cc:276] 0709 13:01:13.657316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.029682 (+372366us) service_pool.cc:224] Handling call
0709 13:01:14.029962 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.464203 (+434241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.464234 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.464649 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.640405 (+175756us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:14.640455 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.640543 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.009614 (+369071us) raft_consensus.cc:1685] finished
0709 13:01:15.009636 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.009777 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14428,"raft.queue_time_us":14837,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":12210,"thread_start_us":520309,"threads_started":2,"wal-append.queue_time_us":543578}
I20260709 13:01:15.001032  6244 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.014943  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2387) took 1021 ms. Trace:
I20260709 13:01:15.015792  6244 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:15.015312  1619 rpcz_store.cc:276] 0709 13:01:13.993209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.087487 (+ 94278us) service_pool.cc:224] Handling call
0709 13:01:14.088010 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.089956 (+  1946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.089991 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.113921 (+ 23930us) log.cc:844] Serialized 564 byte log entry
0709 13:01:14.468414 (+354493us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:14.468480 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.468712 (+   232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.014737 (+546025us) raft_consensus.cc:1685] finished
0709 13:01:15.014757 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.014892 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":354033,"threads_started":1,"wal-append.queue_time_us":506404}
I20260709 13:01:15.019995  6547 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.020891  6578 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:15.021189  6647 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.021346  6578 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.990633  6437 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:15.025457  6659 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.027596  6659 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:15.029769  6637 consensus_meta.cc:287] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.001s
I20260709 13:01:15.030725  1541 raft_consensus.cc:606] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:15.031224  1541 raft_consensus.cc:614] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:15.031356  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43404 (request call id 1083) took 1614 ms. Trace:
I20260709 13:01:15.031749  6726 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:15.031780  1614 rpcz_store.cc:276] 0709 13:01:13.417212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.573775 (+156563us) service_pool.cc:224] Handling call
0709 13:01:13.574091 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.841668 (+1267577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.031148 (+189480us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000e1354. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:15.031304 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2913545472}
W20260709 13:01:15.034026  6634 consensus_meta.cc:287] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 1.387s	user 0.009s	sys 0.004s
I20260709 13:01:15.034439  6634 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.035509  6653 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:15.035604  1611 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:15.036047  6653 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.036464  6634 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:15.036149  6671 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:15.037024  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 2373) took 1633 ms (client timeout 1930 ms). Trace:
I20260709 13:01:15.037712  6673 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:15.037436  1611 rpcz_store.cc:269] 0709 13:01:13.403175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.403624 (+   449us) service_pool.cc:224] Handling call
0709 13:01:15.036855 (+1633231us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54001a40d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:15.036974 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3569921792}
I20260709 13:01:15.038394  6673 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:15.039368  6673 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:15.043315  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 78650.5us
I20260709 13:01:14.995299  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:15.048520  2274 raft_consensus.cc:2468] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:15.053107  2275 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 15. Current term is 16. Ops: [13.14-15.15]
I20260709 13:01:15.056666  1585 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:15.058723  1660 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:15.068884  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:14.962287  6643 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:15.069183  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:15.070179  1538 raft_consensus.cc:606] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.069876  6643 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.070515  1538 raft_consensus.cc:614] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:14.959338  6617 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.069869  1611 raft_consensus.cc:2393] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 16: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:15.072535  6617 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:14.963577  6722 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:15.073508  6722 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.073947  6722 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:15.068996  6727 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.502s	user 0.001s	sys 0.000s
I20260709 13:01:15.077620  6312 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.078119  6312 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.100070  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:15.068852  6725 raft_consensus.cc:2804] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:15.030181  6637 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.100596  1660 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:15.074162  6526 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:01:15.070494  6579 raft_consensus.cc:3055] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:15.119680  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.118229  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.187165  2274 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:15.145128  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.328974  1694 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:15.092748  6634 raft_consensus.cc:2804] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:15.272680  2241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.009s	sys 0.006s
W20260709 13:01:15.330487  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 210886us
I20260709 13:01:15.060951  6437 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:15.323417  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 244917us
W20260709 13:01:15.350147  2241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.009s	sys 0.015s
I20260709 13:01:15.323559  6671 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.331805  6258 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.315510  6757 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:01:15.105407  6693 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.358772  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:15.361212  1694 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.363860  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.366504  1690 raft_consensus.cc:2393] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 16: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
W20260709 13:01:15.208091  6718 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:15.362324  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.389101  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.389580  1685 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 16.
I20260709 13:01:15.389729  1691 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:15.124682  6547 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:15.124747  6637 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.331789  6647 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.399523  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:15.400070  1619 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.332608  6723 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:15.357025  6641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.005s	sys 0.012s
W20260709 13:01:15.394006  6519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.010s	sys 0.009s
I20260709 13:01:15.352035  6735 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.122850  6642 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:15.111843  6725 raft_consensus.cc:697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:15.394363  1687 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:15.142392  6746 raft_consensus.cc:2804] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:15.397569  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:15.420081  1611 raft_consensus.cc:2376] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13. Re-sending same reply.
I20260709 13:01:15.157610  6617 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.238605  6729 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.328141  6579 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:15.361327  6634 raft_consensus.cc:697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:15.367957  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.364820  6258 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:15.409395  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 45655us
I20260709 13:01:15.428098  1618 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:15.402153  6547 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.429450  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.429970  1611 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 9.
I20260709 13:01:15.122792  6752 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index 4 to 7, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:15.406418  6641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.005s	sys 0.013s
I20260709 13:01:15.417610  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 978) took 1742 ms. Trace:
I20260709 13:01:15.368460  6722 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.432371  1686 rpcz_store.cc:276] 0709 13:01:13.674971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.675107 (+   136us) service_pool.cc:224] Handling call
0709 13:01:13.675457 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:13.675806 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.675837 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:13.676461 (+   624us) log.cc:844] Serialized 52 byte log entry
0709 13:01:14.345964 (+669503us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:14.346007 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.346072 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.417420 (+1071348us) raft_consensus.cc:1685] finished
0709 13:01:15.417441 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.417560 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4486,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2718,"thread_start_us":472136,"threads_started":1,"wal-append.queue_time_us":1213978}
I20260709 13:01:15.435361  6634 consensus_queue.cc:237] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.425784  6746 raft_consensus.cc:697] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:15.437054  6264 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.437582  6264 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.421702  6642 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.439647  6264 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:15.440802  6642 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.426888  6617 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.445078  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.420895  1694 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
W20260709 13:01:15.416143  6519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.011s	sys 0.010s
I20260709 13:01:15.405431  6643 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:15.424870  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.112046  6659 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:15.425979  6677 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.405715  6647 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.463651  1614 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:15.451002  6240 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:15.473937  1614 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:01:15.467758  6472 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.485749  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.487332  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.490887  1611 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:15.492332  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.492899  1618 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:15.495689  1511 leader_election.cc:400] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10.
I20260709 13:01:15.496021  1511 leader_election.cc:403] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:15.495568  2243 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:15.499468  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:15.500273  1686 raft_consensus.cc:2368] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:01:15.501327  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:15.500469  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.501917  1685 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.504143  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.504936  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.506385  1659 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.506930  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:01:15.501360  1584 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:35447 timed out after 1.641s (SENT) [suppressed 36 similar messages]
I20260709 13:01:15.508872  1613 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:15.488245  6722 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:15.470944  6659 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.514185  1692 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:15.424645  6729 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.515044  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.516392  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.515600  1659 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.525892  1542 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:15.514391  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.527323  6749 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:15.435518  6579 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.530931  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.532205  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.529713  1693 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:15.526171  1659 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:15.516500  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.534806  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.478747  6240 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.507723  6760 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:15.535352  1536 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:15.536226  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.541208  1539 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:15.508863  6577 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 9. Current term is 10.
I20260709 13:01:15.538240  1511 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.438454  6725 consensus_queue.cc:237] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.437750  6746 consensus_queue.cc:237] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.562064  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.562705  1536 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:15.495461  6472 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.544181  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.533180  6470 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.566342  1511 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:15.540308  6760 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.568850  1539 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:15.537961  6751 raft_consensus.cc:2804] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:15.586154  6751 raft_consensus.cc:697] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:15.587088  6751 consensus_queue.cc:237] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.587841  6647 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.540355  6688 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.591928  1685 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 17.
W20260709 13:01:15.592824  6653 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.001s
I20260709 13:01:15.592948  6637 raft_consensus.cc:2764] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:01:15.572079  6760 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.593281  6653 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:15.572836  6765 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:01:15.570645  6547 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.596611  6724 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.514822  6643 consensus_queue.cc:1059] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 13:01:15.576570  6578 consensus_meta.cc:287] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.000s
I20260709 13:01:15.599479  6602 raft_consensus.cc:3055] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:15.599911  6602 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:15.599653  6578 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.600745  6602 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.601605  6578 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.601677  6602 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.582888  6472 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.582913  6258 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:15.603118  6558 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.608070  6760 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.570097  6673 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.542618  6579 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.610085  6760 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:15.615762  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.618626  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.619262  1543 raft_consensus.cc:3060] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:15.620409  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.621141  1618 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:15.622932  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.629694  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.630441  1542 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:15.632098  1536 raft_consensus.cc:1275] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:15.636431  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:15.637122  2270 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:15.638494  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.639256  1617 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:01:15.633350  6673 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.643180  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:15.647495  2270 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:15.647501  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:15.648797  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 82507.5us
I20260709 13:01:15.649716  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:15.565605  6617 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:15.657739  2270 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:15.658763  1545 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:15.660326  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:15.655244  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 111155us
I20260709 13:01:15.663482  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:15.663571  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:15.664218  1613 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:15.664815  2241 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.665858  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:15.666507  2270 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:15.668069  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:15.667233  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:15.671563  1510 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:15.674625  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.675381  1618 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:15.679100  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.679463  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.680238  1685 raft_consensus.cc:2410] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:15.681293  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.681787  1619 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:15.687052  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.687621  1536 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:15.691179  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:15.692081  1619 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 17: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:15.680713  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.698397  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.692857  6547 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.700248  1691 raft_consensus.cc:1240] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 13. Ops: []
I20260709 13:01:15.700465  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.700258  6547 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.704635  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.667735  6687 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.677589  6558 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.687824  6655 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:15.704656  1687 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:15.688179  6724 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:15.721658  6531 consensus_meta.cc:287] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.002s
I20260709 13:01:15.707052  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.688010  6688 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:15.693964  6617 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.695605  6634 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.737732  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.738503  6688 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:15.748070  6653 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:15.748672  1542 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:15.780611  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 117126us
I20260709 13:01:15.781366  6547 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.781872  6531 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.749199  6240 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.783113  6729 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:15.783658  6729 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.784025  6531 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:15.784219  6729 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.786226  6731 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.786870  6731 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.789139  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:15.790293  6735 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.725009  6687 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:15.693554  6763 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:15.801060  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 299670us
I20260709 13:01:15.762933  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:15.802248  1618 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.803579  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:15.768550  6098 consensus_queue.cc:1059] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:15.772724  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:15.772805  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:15.782147  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.755641  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.795416  1542 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:15.753404  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:15.786306  6729 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:15.723685  6578 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:15.816675  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:15.720674  6693 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:15.721930  6647 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:15.728260  6655 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.822866  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:15.783710  6755 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.837s	user 0.006s	sys 0.007s
I20260709 13:01:15.726377  6577 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.791393  6688 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.790984  6687 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.829900  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:15.836134  1543 raft_consensus.cc:2468] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:15.729306  6724 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:15.850829  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.895895  1618 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:15.839521  6763 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.849495  1611 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 4 to 7, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:15.885193  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:15.875348  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:15.829635  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:15.872097  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.889441  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.726109  6673 consensus_queue.cc:1059] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:01:15.852487  6558 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.895187  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.924412  1543 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:15.906648  1619 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.853112  6671 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.868255  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:15.801640  6634 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:15.902143  2277 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:15.931007  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:15.931725  1541 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:15.932940  2276 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 17: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:01:15.898993  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 61576.8us
I20260709 13:01:15.918946  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.821424  6579 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:15.907457  1613 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:15.946930  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.947386  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:15.947882  1543 raft_consensus.cc:2368] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:01:15.948192  1658 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:15.868458  6655 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.820297  6531 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:15.884639  1584 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:15.898211  6724 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:15.801411  6617 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.898357  6659 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:15.957281  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:15.886026  6578 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:15.868739  6647 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.958834  1536 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:15.959825  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.963057  6531 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.970749  1612 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:01:15.970559  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 281465us
I20260709 13:01:15.884338  6677 consensus_queue.cc:1059] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:01:15.977679  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:15.978053  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 93476.5us
I20260709 13:01:15.978219  1613 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 9.
I20260709 13:01:15.972524  1541 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:15.973613  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:15.981815  1687 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:15.894122  6577 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.886053  6693 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:15.983285  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 1190) took 1373 ms. Trace:
I20260709 13:01:15.984289  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:16.034888  2273 rpcz_store.cc:276] 0709 13:01:14.610049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.610211 (+   162us) service_pool.cc:224] Handling call
0709 13:01:14.610494 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.619215 (+  8721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.619240 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.619631 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.807297 (+187666us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:14.825352 (+ 18055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.825429 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.783178 (+957749us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:15.961555 (+178377us) raft_consensus.cc:1685] finished
0709 13:01:15.961601 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.983191 (+ 21590us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58730,"raft.queue_time_us":7840,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":17653,"spinlock_wait_cycles":27790592,"thread_start_us":147159,"threads_started":1,"wal-append.queue_time_us":305461}
I20260709 13:01:15.985437  2243 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:16.016342  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.029430  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:16.044891  1618 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:16.058916  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f61c89956d24976b4d464550172cd55"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:16.059667  1541 raft_consensus.cc:606] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:16.061908  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 76552.3us
I20260709 13:01:15.951368  6547 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:16.072957  1619 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:16.073688  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:16.075702  1543 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:16.079218  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 412933us
I20260709 13:01:16.071646  2243 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:16.074432  1613 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:16.106438  1619 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:16.110965  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:16.112185  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1203) took 1496 ms. Trace:
I20260709 13:01:16.112607  2275 rpcz_store.cc:276] 0709 13:01:14.616055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.801783 (+185728us) service_pool.cc:224] Handling call
0709 13:01:15.052857 (+251074us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:15.053536 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.112003 (+1058467us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540075fb50. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:16.112130 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576201088}
I20260709 13:01:15.958638  6240 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:01:16.030843  6751 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:16.030277  6671 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.960583  6579 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:15.971788  6558 consensus_queue.cc:1059] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:01:16.100258  6653 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:16.105639  6597 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:16.146374  1543 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:16.116429  6659 raft_consensus.cc:3055] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:16.164903  1692 raft_consensus.cc:1240] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:16.161147  6597 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.185293  6597 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.192338  6531 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:16.193053  6531 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:16.193485  6531 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:16.193892  6531 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:16.195600  6634 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:16.196220  6634 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:16.196609  6634 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:16.197001  6634 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.198132  6597 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:16.131349  6735 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.102495  6547 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:16.106590  6677 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:01:16.153405  6653 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.247321  6019 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:16.281626  6019 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:16.284346  6019 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:16.165683  6659 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:16.214473  6602 consensus_meta.cc:287] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.612s	user 0.005s	sys 0.005s
W20260709 13:01:16.287869  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.298357  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 544952us
W20260709 13:01:16.332079  1620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.012s	sys 0.041s
W20260709 13:01:16.410246  1620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.013s	sys 0.041s
W20260709 13:01:16.286702  6779 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:01:16.202932  6578 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:16.264541  6653 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:16.389417  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 455095us
I20260709 13:01:16.425726  1585 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:16.441421  2243 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:16.442981  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 353620us
W20260709 13:01:16.432611  6783 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:01:16.447324  2243 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:16.449646  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:16.452062  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:16.453338  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 505113us
I20260709 13:01:16.454124  1658 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:16.439713  6763 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:16.451546  5881 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:16.456596  6053 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:16.468768  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:16.448721  6602 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:16.455963  6647 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:16.480412  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:16.485994  6579 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:16.488408  6579 consensus_queue.cc:1059] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:16.478782  6800 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:16.495147  6800 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:16.469075  6597 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:16.499526  6789 log.cc:927] Time spent T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:16.495397  1611 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:16.503523  6547 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:16.464193  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 327827us
I20260709 13:01:16.465610  5881 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.467989  6053 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.474754  6693 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:16.502882  6617 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:16.471371  6019 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:16.742029  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.473903  6602 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:16.692061  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 282022us
W20260709 13:01:16.596873  2274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 1198) took 1539 ms (client timeout 1892 ms). Trace:
W20260709 13:01:16.520972  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.000s	sys 0.023s
I20260709 13:01:16.515265  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:16.471665  6749 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:01:16.552129  6688 consensus_meta.cc:287] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.000s
W20260709 13:01:16.767168  2274 rpcz_store.cc:269] 0709 13:01:15.057884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.099549 (+ 41665us) service_pool.cc:224] Handling call
0709 13:01:16.596649 (+1497100us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b5400881dd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:16.596804 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177003776}
W20260709 13:01:16.569115  6785 log.cc:927] Time spent T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
W20260709 13:01:16.495934  6736 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.764s	user 0.004s	sys 0.012s
I20260709 13:01:16.565142  6519 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.514717  2268 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
W20260709 13:01:16.750346  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 291537us
I20260709 13:01:16.747941  6053 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:16.545361  6724 consensus_meta.cc:287] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.001s
W20260709 13:01:16.767549  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.003s	sys 0.031s
W20260709 13:01:16.681800  6671 consensus_meta.cc:287] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
W20260709 13:01:16.792670  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 970153us
W20260709 13:01:16.767110  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 251891us
W20260709 13:01:16.541477  6794 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:01:16.594302  6679 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:16.490615  6579 consensus_queue.cc:1059] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.299s
I20260709 13:01:16.569446  6746 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.797204  6440 consensus_queue.cc:260] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:16.777278  6751 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.778008  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2389) took 4029 ms. Trace:
I20260709 13:01:16.779848  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:16.784524  6312 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:16.787631  6811 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:01:16.495576  6800 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:16.534087  6687 consensus_meta.cc:287] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.623s	user 0.006s	sys 0.003s
I20260709 13:01:16.533107  6725 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.514240  6677 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.888487  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2407) took 1061 ms. Trace:
I20260709 13:01:16.747380  5881 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:16.795035  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:16.807835  1511 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:16.807947  1509 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:16.793886  1660 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:16.809947  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 354101us
I20260709 13:01:16.766812  6602 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:16.542816  6526 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.472138  6659 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:16.774394  6647 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:16.497542  6763 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.295s
W20260709 13:01:16.814528  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 213646us
W20260709 13:01:16.650411  6673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.000s	sys 0.014s
W20260709 13:01:16.951169  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 143276us
I20260709 13:01:16.775822  6019 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:01:16.952179  1428 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d53120c1adf947fd992e5950edf26301 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0cccd9c43f9747529680a8e7463961c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:16.821573  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2414) took 1115 ms. Trace:
I20260709 13:01:16.819767  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2410) took 1142 ms. Trace:
I20260709 13:01:16.953114  1542 rpcz_store.cc:276] 0709 13:01:15.706182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.706548 (+   366us) service_pool.cc:224] Handling call
0709 13:01:16.821377 (+1114829us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5400210cd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:16.821505 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35896576}
I20260709 13:01:16.953161  1545 rpcz_store.cc:276] 0709 13:01:15.677617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.677780 (+   163us) service_pool.cc:224] Handling call
0709 13:01:15.678018 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.678191 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:16.141312 (+463121us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.817964 (+676652us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.818017 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.818064 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.818127 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.819708 (+  1581us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1681,"prepare.queue_time_us":787225,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":3415,"raft.queue_time_us":101404,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":62767,"thread_start_us":1115803,"threads_started":3,"wal-append.queue_time_us":454170}
W20260709 13:01:16.951169  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 143396us
I20260709 13:01:16.956526  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:16.959559  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2421) took 1049 ms. Trace:
I20260709 13:01:16.963012  1542 rpcz_store.cc:276] 0709 13:01:15.909922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.958547 (+1048625us) service_pool.cc:224] Handling call
0709 13:01:16.958943 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.959145 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.959184 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.959239 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:16.959290 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.959361 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.959487 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:16.957302  6673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.004s	sys 0.019s
I20260709 13:01:16.554384  6634 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:16.913089  6788 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.461s	user 0.003s	sys 0.000s
I20260709 13:01:16.900635  6731 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:16.916944  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45396 (request call id 1202) took 1145 ms. Trace:
I20260709 13:01:16.904021  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38018 (request call id 2015) took 1152 ms. Trace:
I20260709 13:01:16.859948  6722 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:16.957713  6578 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:16.855093  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.012s	sys 0.018s
W20260709 13:01:17.008996  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.016s	sys 0.021s
W20260709 13:01:17.011340  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.608947  6809 raft_consensus.cc:3055] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:16.789806  6688 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:16.842869  6655 consensus_meta.cc:287] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.864s	user 0.011s	sys 0.000s
I20260709 13:01:16.928691  6687 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:16.823669  6746 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:16.816951  6653 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:16.828833  6579 raft_consensus.cc:3055] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:16.793653  6519 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:16.827328  6440 raft_consensus.cc:3060] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.818428  1544 rpcz_store.cc:276] 0709 13:01:12.748706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.172325 (+423619us) service_pool.cc:224] Handling call
0709 13:01:13.172611 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.472772 (+300161us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:13.953230 (+480458us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.354119 (+400889us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.354628 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.357811 (+  3183us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:14.358188 (+   377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.592492 (+234304us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b5400311d54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:14.592536 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.434050 (+1841514us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:16.777781 (+343731us) raft_consensus.cc:1685] finished
0709 13:01:16.777804 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.777929 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":514306,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":33,"raft.queue_time_us":463,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":6974,"spinlock_wait_cycles":705577600,"thread_start_us":806433,"threads_started":2,"wal-append.queue_time_us":569585}
I20260709 13:01:17.048372  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:17.049093  1544 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:16.809036  6724 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:16.879287  6795 log.cc:927] Time spent T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:01:16.821148  6751 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:16.896961  6531 consensus_meta.cc:287] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.003s
W20260709 13:01:16.928090  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 134253us
I20260709 13:01:16.929929  2241 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:16.927296  1617 rpcz_store.cc:276] 0709 13:01:15.827284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.966977 (+139693us) service_pool.cc:224] Handling call
0709 13:01:15.967311 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.322739 (+355428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.322785 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.322852 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.322886 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.888227 (+565341us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400056ed4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:16.888279 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.888425 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816626432}
W20260709 13:01:16.946785  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.055985  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:16.809198  6671 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:17.057922  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 128067us
I20260709 13:01:16.948622  6437 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.045966  6659 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:16.985385  1536 rpcz_store.cc:276] 0709 13:01:15.752044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.791429 (+ 39385us) service_pool.cc:224] Handling call
0709 13:01:16.903820 (+1112391us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b54002c0e54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:16.903950 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143137024}
I20260709 13:01:16.985332  2268 rpcz_store.cc:276] 0709 13:01:15.771838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.772385 (+   547us) service_pool.cc:224] Handling call
0709 13:01:16.916725 (+1144340us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b540045b0d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:16.916875 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452448128}
I20260709 13:01:16.880661  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 1009) took 2106 ms. Trace:
I20260709 13:01:16.990023  6722 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:16.991585  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2406) took 1347 ms. Trace:
I20260709 13:01:17.095516  1540 rpcz_store.cc:276] 0709 13:01:15.643893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.644026 (+   133us) service_pool.cc:224] Handling call
0709 13:01:15.662210 (+ 18184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.662515 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.662539 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.686867 (+ 24328us) log.cc:844] Serialized 564 byte log entry
0709 13:01:16.031719 (+344852us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.031757 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.031838 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.912399 (+880561us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:16.991282 (+ 78883us) raft_consensus.cc:1685] finished
0709 13:01:16.991304 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.991526 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7390592,"thread_start_us":344599,"threads_started":1,"wal-append.queue_time_us":742887}
I20260709 13:01:16.992010  6731 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:16.957712  6470 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:16.998147  6019 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:16.963078  6647 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:17.002831  6817 consensus_queue.cc:1059] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:01:16.958222  6819 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.952772  6725 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.005043  6577 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:16.952114  6526 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.004916  6800 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.007160  6636 raft_consensus.cc:3055] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:17.007205  6634 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:16.928087  6677 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.017582  6688 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.018282  6655 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.020430  6687 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:16.822908  6814 consensus_queue.cc:1059] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:01:17.051726  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2403) took 1254 ms. Trace:
I20260709 13:01:17.014596  6558 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.059973  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.144089  6746 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.166978  6636 raft_consensus.cc:740] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:17.059197  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38026 (request call id 2416) took 1266 ms. Trace:
I20260709 13:01:17.014642  6809 raft_consensus.cc:740] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:17.060297  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:17.208894  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 148637us
I20260709 13:01:17.072168  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.210498  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:16.950515  6240 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.074316  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.043967  6825 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.075572  1539 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:17.042335  6579 raft_consensus.cc:740] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:17.075693  1537 rpcz_store.cc:276] 0709 13:01:14.774279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.923072 (+148793us) service_pool.cc:224] Handling call
0709 13:01:14.923425 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.051579 (+128154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.051622 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.051673 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:15.051725 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.880406 (+1828681us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002111d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:16.880455 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.880606 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294116736}
I20260709 13:01:17.071360  6749 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:17.097939  1584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.073s	sys 0.104s
W20260709 13:01:17.214830  1584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.074s	sys 0.104s
W20260709 13:01:17.215430  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 1.23098e+06us
I20260709 13:01:17.192143  2273 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 4 to 7, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:17.099783  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.217855  2276 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:17.124190  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.125968  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:17.071692  6729 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.128643  2269 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:17.108582  1540 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:17.131636  1658 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:17.222682  1584 leader_election.cc:400] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:01:17.125521  6470 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.075011  6437 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.098356  6731 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.150987  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.196007  6722 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.155396  6724 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.159827  6642 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:17.071913  5881 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.070904  6531 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.123181  6671 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:17.127291  6819 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.160696  6725 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:17.203379  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:17.250294  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 46981.5us
I20260709 13:01:17.189524  1612 rpcz_store.cc:276] 0709 13:01:15.796978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.797141 (+   163us) service_pool.cc:224] Handling call
0709 13:01:15.800082 (+  2941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.973093 (+173011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.051518 (+1078425us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54001a36d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:17.051672 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371444096}
I20260709 13:01:17.203130  1543 rpcz_store.cc:276] 0709 13:01:15.792776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.948418 (+155642us) service_pool.cc:224] Handling call
0709 13:01:17.059006 (+1110588us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b5400354b54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:17.059133 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220182912}
I20260709 13:01:17.219708  6746 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:17.223117  1584 leader_election.cc:403] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:17.223958  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:17.224179  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 433010us
I20260709 13:01:17.224675  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.233430  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.261641  2269 raft_consensus.cc:2410] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:17.200042  6636 consensus_queue.cc:260] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:17.153469  1719 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:40935 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:40935 timed out after 15.000s (SENT)
I20260709 13:01:17.237317  2277 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:17.189178  6829 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:17.212133  6597 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:17.220062  6815 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:01:17.224087  6693 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.212606  6240 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.241154  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.242951  2272 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:17.242980  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.214602  6749 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.230966  6634 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:01:17.221339  6519 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:17.236348  6731 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.251029  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2417) took 1428 ms. Trace:
I20260709 13:01:17.190869  6558 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:17.257282  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.198868  6688 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:17.220175  6610 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:17.244364  6722 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.263288  2241 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:17.274159  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 56909.4us
I20260709 13:01:17.244721  6642 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.217408  6825 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.201797  6647 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.244552  6602 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.254434  6579 consensus_queue.cc:260] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.263209  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:17.462141  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:17.250351  6802 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:17.460938  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 197718us
I20260709 13:01:17.465171  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:17.347097  2269 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:17.260536  6687 raft_consensus.cc:2764] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:01:17.254949  6478 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:17.489252  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:17.488940  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:17.506502  1692 raft_consensus.cc:2393] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:17.503562  2241 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:17.506696  1690 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:01:17.425371  6312 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:17.255119  6653 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:17.503834  1538 rpcz_store.cc:276] 0709 13:01:15.823080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.484930 (+661850us) service_pool.cc:224] Handling call
0709 13:01:16.485222 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.929688 (+444466us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:16.984154 (+ 54466us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.250666 (+266512us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:17.250739 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:17.250783 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.250879 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.250981 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40233,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":128062,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":6525,"thread_start_us":699386,"threads_started":2,"wal-append.queue_time_us":469291}
W20260709 13:01:17.514369  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 382762us
I20260709 13:01:17.249357  6819 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.517577  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:17.275599  6440 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:17.464372  6834 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.509156  6412 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.526233  6412 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.502813  6688 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.526078  6440 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.526738  6412 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:17.527217  6835 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:01:17.529119  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:17.418614  6826 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.526485  6796 raft_consensus.cc:3055] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:17.459250  6578 raft_consensus.cc:697] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:17.346803  6178 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.530821  1692 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:17.481161  6724 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:17.481988  6800 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.467450  6597 consensus_queue.cc:1243] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:17.418634  6526 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:17.272818  6746 raft_consensus.cc:697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:17.502461  6677 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.554194  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2420) took 1657 ms. Trace:
I20260709 13:01:17.503645  6519 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:17.255981  6671 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.282433  6827 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:01:17.519084  6655 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:17.581091  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 324647us
I20260709 13:01:17.505388  6240 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.534301  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:17.555507  1539 rpcz_store.cc:276] 0709 13:01:15.897167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.501482 (+604315us) service_pool.cc:224] Handling call
0709 13:01:16.501787 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.211987 (+710200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.553879 (+341892us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54001856d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:17.554116 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319031168}
I20260709 13:01:17.361248  6636 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.528208  6688 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.528208  6440 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.516575  6470 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.505805  6478 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:17.561968  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 46309us
I20260709 13:01:17.583987  1690 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:17.533895  6796 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:17.601763  6842 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.602342  6842 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:17.586817  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 57787us
I20260709 13:01:17.591651  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:17.260073  6809 consensus_queue.cc:260] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:17.604115  6837 log.cc:927] Time spent T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:01:17.604440  6809 raft_consensus.cc:3060] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:17.604672  6688 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.605182  6688 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:17.606169  6832 log.cc:927] Time spent T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:01:17.463847  6749 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.509322  6722 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.602780  6440 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.523923  6312 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:17.565894  6053 consensus_meta.cc:287] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.000s
I20260709 13:01:17.602931  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:17.609575  2273 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:17.638206  2241 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:17.606988  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 2014) took 1855 ms. Trace:
I20260709 13:01:17.613293  1658 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:17.584690  6800 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.608028  6478 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:17.638857  1541 rpcz_store.cc:276] 0709 13:01:15.751725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.114867 (+363142us) service_pool.cc:224] Handling call
0709 13:01:16.115179 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.416775 (+301596us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:16.817028 (+400253us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.187658 (+370630us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.188309 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:01:17.188457 (+   148us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:17.189002 (+   545us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.198993 (+  9991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.199091 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.606775 (+407684us) raft_consensus.cc:1685] finished
0709 13:01:17.606803 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.606930 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19846,"prepare.queue_time_us":83149,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":424460,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":20232,"thread_start_us":1026005,"threads_started":3,"wal-append.queue_time_us":541668}
I20260709 13:01:17.645859  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.546703  6724 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.658281  6412 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.658877  6724 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.658951  6796 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.544402  6729 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:17.660267  6729 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:17.637439  6725 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:01:17.660755  6729 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.660831  6412 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.662256  6602 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.565062  6437 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:17.634514  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.635704  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:17.285312  6829 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.607383  6758 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:17.553895  6178 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:17.650866  6659 consensus_meta.cc:287] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 13:01:17.651173  6722 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:17.651651  6843 log.cc:927] Time spent T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:17.637336  6440 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.654809  6531 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.617913  6836 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.544939  6826 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.565419  6677 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.674218  6758 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.699088  6758 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.631599  6519 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.656903  6312 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:17.510476  6693 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.678719  6626 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:17.701745  6626 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.617280  6634 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.672879  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:17.703384  6178 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.705907  6519 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.698840  6677 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.706841  6836 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.672643  6470 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:17.683082  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.686138  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:17.687001  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:17.659174  6688 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.687633  6264 consensus_queue.cc:1048] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:01:17.692983  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:17.668674  6800 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.698257  5881 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:17.712376  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 250297us
I20260709 13:01:17.713738  2273 raft_consensus.cc:1240] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 15. Current term is 16. Ops: [13.14-15.15]
I20260709 13:01:17.702303  6693 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.714442  1613 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.713696  1615 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:17.718114  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.718406  1584 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:17.719343  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:17.720679  6688 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:17.503728  6802 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.663466  6763 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:01:17.683669  6827 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.647333  6053 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.709185  6677 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.709978  6626 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.709192  6836 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:17.731518  1659 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:17.738512  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.715364  6470 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:17.733577  6724 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.739545  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:17.743001  1538 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:01:17.743373  1538 pending_rounds.cc:85] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 5
I20260709 13:01:17.742357  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:17.743718  1538 pending_rounds.cc:107] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:01:17.743966  1538 raft_consensus.cc:2889] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.741608  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:17.741336  1544 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:17.744414  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:17.744997  1620 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.743309  1541 raft_consensus.cc:606] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:17.745481  1541 raft_consensus.cc:614] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:17.722174  6531 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:17.746691  1616 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:17.747466  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 186857us
I20260709 13:01:17.748411  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:17.724910  6800 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.755749  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.756174  2274 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:17.756546  2271 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:17.754654  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.757601  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.749753  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:17.725466  6178 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:17.752065  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:17.750387  6470 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.750852  6677 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:17.798056  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:17.798694  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:17.798573  6677 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.799294  1611 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.799340  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:17.752876  1544 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:17.801147   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:17.802740  6440 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.760455  6724 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.808751  6724 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.811307  6671 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.811462  1611 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:17.813352  1510 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:17.814124  6724 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.791180  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.814891  6558 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:17.815117  2269 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:17.792690  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.730391  6688 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.816392  6688 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.819233  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:17.819334  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:17.820020  1612 raft_consensus.cc:2410] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:17.795058  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:17.821096  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:17.821749  1541 raft_consensus.cc:2393] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:17.795462  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:17.796116  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:17.822926  1618 raft_consensus.cc:3060] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.744679  6642 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:17.798218  6838 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:01:17.823699  6558 consensus_queue.cc:1059] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:17.712576  6847 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:01:17.822410  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:17.753700  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:17.819972  1611 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.669627  6578 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.825907  1537 pending_rounds.cc:85] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 8
I20260709 13:01:17.826175  1537 pending_rounds.cc:107] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:17.826428  1537 raft_consensus.cc:2889] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.823108  1545 raft_consensus.cc:3060] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.712227  6746 consensus_queue.cc:237] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:17.831364  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 77964.4us
I20260709 13:01:17.831522  1616 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:17.824580  6558 raft_consensus.cc:3055] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:17.798897  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:17.752400  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:17.829666  1613 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:17.758695  1619 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:17.730121  6840 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.751577  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:17.832132  1585 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:17.824198  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:17.837499  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.744851  6725 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:17.839363  1539 raft_consensus.cc:1275] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:17.818475  6688 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.750247  6531 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.731637  6827 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:17.863299  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.863772  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:17.900800  2275 raft_consensus.cc:2393] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:17.864068  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:17.857573  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:17.842980  1611 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
W20260709 13:01:17.903041  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 52052.9us
I20260709 13:01:17.850832  1545 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:17.900697  2277 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 15: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:17.842577  1620 raft_consensus.cc:2468] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:17.904089  2243 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:17.904640  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.916631  1618 raft_consensus.cc:2468] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:17.837369  6558 raft_consensus.cc:740] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:17.946825  1614 raft_consensus.cc:1275] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:01:17.910959  2243 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:17.938732  2241 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:17.863380  6264 consensus_queue.cc:1059] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:01:17.941996  5881 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.892012  6178 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 17 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:17.899008  6531 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:17.942332  6842 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.942695  6677 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.892491  6240 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.842953  6519 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.966948  6178 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.969180  6825 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:17.902305  6693 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:01:17.965955  6626 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:17.962436  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 211009us
I20260709 13:01:17.932044  6688 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:17.991216  1428 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d53120c1adf947fd992e5950edf26301 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0cccd9c43f9747529680a8e7463961c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:17.963737  6773 raft_consensus.cc:3055] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:17.953778  2243 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:17.958061  6019 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:17.992772  2243 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:17.983016  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 150969us
I20260709 13:01:17.966099  6850 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:17.932538  6846 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.901293  6758 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:17.990274  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:17.959824  6636 raft_consensus.cc:2804] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:17.996690  1585 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:17.945953  6643 consensus_queue.cc:1059] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:01:17.985890  6677 raft_consensus.cc:2764] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:01:17.998425  2243 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:18.041821  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 45204.1us
I20260709 13:01:18.045778  6800 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:17.994262  6773 raft_consensus.cc:740] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:17.995000  6312 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:18.054208  6636 raft_consensus.cc:697] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:18.050336  6577 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:18.055146  6731 consensus_meta.cc:287] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.003s
W20260709 13:01:18.051662  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 410348us
I20260709 13:01:18.055291  6626 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.003584  6019 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:18.004545  6602 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:17.966010  6470 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.084371  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:18.043968  6642 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:18.049765  6826 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:18.041105  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 50885.5us
I20260709 13:01:17.932610  6840 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.049492  6829 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.043779  6842 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.071072  1658 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:18.073791  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:18.075199  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 76845.9us
W20260709 13:01:18.061355  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 309951us
I20260709 13:01:18.077512  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:18.055817  6800 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:17.996894  6688 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.092391  6659 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:18.086339  6763 raft_consensus.cc:2804] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:18.095688  6751 consensus_meta.cc:287] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 1.023s	user 0.007s	sys 0.004s
I20260709 13:01:18.081280  6577 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.104233  1538 raft_consensus.cc:2410] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:01:18.106285  6642 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:18.107299  6827 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.070461  6053 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.062495  6825 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:18.078642  6819 consensus_meta.cc:287] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:01:18.121809  1659 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:18.153100  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 82117.1us
W20260709 13:01:18.181414  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 59682.3us
I20260709 13:01:18.157258  2271 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:18.157953  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:18.042837  6558 consensus_queue.cc:260] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.099618  6019 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.086787  6240 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:18.171962  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.074747  6729 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.125756  6829 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:18.052488  6749 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.078167  6731 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.210023  6470 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:18.184578  1658 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:18.114964  6602 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:18.201022  6437 consensus_queue.cc:1059] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:01:18.211714  6602 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.212536  6437 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:18.171679  6725 raft_consensus.cc:2804] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:18.003364  6850 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.213053  6846 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:18.214651  6850 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.215552  6850 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:18.216964  6725 raft_consensus.cc:697] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:18.217911  6725 consensus_queue.cc:237] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.170208  6642 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:18.189359  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:18.219669  1542 raft_consensus.cc:1240] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:01:18.220290  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.220573  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:18.209875  6749 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.211155  6752 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.212683  6861 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:18.195928  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:18.218899  6558 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.190973  6472 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:18.239753  2275 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:18.241778  6840 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.158869  6751 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.154739  6842 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.249401  6312 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:18.255740  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:18.256052  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:18.257385  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 46333.9us
I20260709 13:01:18.269058  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:18.266767  6800 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.244585  6752 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.272468  6312 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:18.238124  6647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.011s
W20260709 13:01:18.276067  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.279354  1544 raft_consensus.cc:2393] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 15: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:18.197431  6827 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:01:18.237922  6861 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:18.282584  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:18.283341  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:18.187309  6825 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.305939  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:18.280812  6647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.007s	sys 0.011s
I20260709 13:01:18.311571  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.192173  6636 consensus_queue.cc:237] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.189047  6819 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.220623  6829 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.316576  1690 raft_consensus.cc:2393] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 17: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:18.317265  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:18.280310  6752 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:18.322106  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:18.325456  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.175377  6773 consensus_queue.cc:260] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.275355  6749 consensus_queue.cc:1059] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:01:18.329746  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.328450  1544 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:18.332123  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.330482  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.333593  1688 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:18.313499  6722 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.299401  6864 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:01:18.309705  6859 consensus_queue.cc:1048] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:01:18.337093  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:18.464687  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.466117  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.466720  1687 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:18.468185  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:18.468371  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:18.446058  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 334237us
I20260709 13:01:18.470393  1584 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:18.412664  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1284) took 1250 ms. Trace:
I20260709 13:01:18.470796  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:18.471242  2272 rpcz_store.cc:276] 0709 13:01:17.162492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.164994 (+  2502us) service_pool.cc:224] Handling call
0709 13:01:17.170479 (+  5485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.460288 (+289809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.412425 (+952137us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b54005875d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:18.412609 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156364544}
W20260709 13:01:18.358297  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 66507.2us
W20260709 13:01:18.370764  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.472429  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:18.282016  6852 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:18.468813  1541 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:18.464960  6886 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:01:18.478857  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:18.487192  1544 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:18.466877  6871 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.172s	user 0.002s	sys 0.001s
I20260709 13:01:18.487442  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:18.362485  6862 log.cc:927] Time spent T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:01:18.411706  6839 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.853s	user 0.002s	sys 0.002s
I20260709 13:01:18.330228  6867 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.413436  6774 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.492089  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.493021  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:18.512184  1688 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:18.467885  6842 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.465508  6841 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:18.342769  6758 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.520040  1692 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:18.523883  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.474682  6877 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.484094  6800 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:18.526412  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 54132.1us
I20260709 13:01:18.530226  1691 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:18.536145  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:18.537705  1584 leader_election.cc:400] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 9 election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10.
I20260709 13:01:18.537585  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:18.538622  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:18.486037  6749 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:01:18.484896  6722 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.556823  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:18.527753  6797 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:18.524124  6867 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.542797  6677 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:18.562014  6677 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:18.562466  6677 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.563556  6867 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:18.541923  6877 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.565685  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:18.566430  1537 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 15: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:18.566942  6877 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.567462  1537 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:18.569103  6881 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:01:18.539448  6841 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.570079  6891 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:18.570549  6891 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:18.570926  6891 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.539952  6729 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:18.413085  6861 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.533943  6880 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:18.557147  6875 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:01:18.591241  1688 raft_consensus.cc:1240] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:18.528414  6774 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.592439  1690 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:18.591266  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.594923  1687 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.557978  6751 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.593788  2272 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:18.590384  1541 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:18.602330  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:18.603430  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:18.575766  6825 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.614151  2272 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:18.622923  6891 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:18.621451  1659 leader_election.cc:336] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Timed out: RequestConsensusVote RPC to 127.0.107.196:33801 timed out after 1.536s (SENT)
W20260709 13:01:18.633183  6874 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:18.633760  6677 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.635984  6677 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.637450  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.639113  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.639266  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.639647  1693 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.641137  6671 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:18.641554  6671 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:18.642704  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:18.642823  6659 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:18.643363  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.643425  6659 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.643392  1615 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:18.645818  6659 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.646507  6891 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.646586  6610 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:18.647123  6610 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:18.647202  6891 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:18.647543  1693 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:18.647746  6891 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.648015  6610 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.644203  1692 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:18.649853  1685 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:18.653785  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.575486  6797 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:18.642390  6671 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.699121  6891 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.658185  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.700456  1618 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:18.657899  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.658522  2273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1216) took 1014 ms. Trace:
I20260709 13:01:18.705521  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.705744  1617 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:18.705727  2273 rpcz_store.cc:276] 0709 13:01:17.644278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.644414 (+   136us) service_pool.cc:224] Handling call
0709 13:01:17.644756 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:17.717408 (+ 72652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.658273 (+940865us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b540075fb54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:18.658468 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158040832}
I20260709 13:01:18.651379  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.651707  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.655548  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.689719  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.708201  1620 raft_consensus.cc:2410] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:01:18.709194  1691 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:18.657879  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:18.710294  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.711124  1620 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
W20260709 13:01:18.711809  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 90394.8us
I20260709 13:01:18.713634  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.650312  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.707847  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.708201  1615 raft_consensus.cc:1240] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:18.715937  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.716544  1693 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 9.
I20260709 13:01:18.717330  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:18.720279  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.678164  6478 consensus_meta.cc:287] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 1.005s	user 0.007s	sys 0.002s
I20260709 13:01:18.721979  6820 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:18.722489  6820 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:18.723486  6820 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.724771  6820 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.725112  2276 raft_consensus.cc:1275] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:18.721997  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.726136  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.722343  6478 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.728796  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.729130  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.730002  6478 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:18.730358  6531 consensus_meta.cc:287] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.001s
I20260709 13:01:18.731029  1692 raft_consensus.cc:1240] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:18.730847  6531 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.732769  2276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1286) took 1532 ms. Trace:
I20260709 13:01:18.733148  2276 rpcz_store.cc:276] 0709 13:01:17.200493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.277877 (+ 77384us) service_pool.cc:224] Handling call
0709 13:01:17.278242 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.725521 (+1447279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.732527 (+  7006us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54004aa1d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:18.732710 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3326284160}
I20260709 13:01:18.649135  6610 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:18.738802  1540 raft_consensus.cc:1240] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:18.739100  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.728858  1617 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:18.728858  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.734205  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.743570  2276 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:18.744321  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.707208  6867 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.706880  6749 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.692888  6019 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.748953  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:18.750234  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:18.645820  6688 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.733798  6825 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:18.735952  6671 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.752925  1511 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:18.741024  6531 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.780267  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:18.758150  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.778482  1544 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:18.761149  1687 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:18.763381  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.771456  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:18.772276  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:18.774220  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:18.756703  1620 raft_consensus.cc:2376] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14. Re-sending same reply.
W20260709 13:01:18.754933  6763 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.015s	sys 0.003s
I20260709 13:01:18.782037  1611 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:18.782136  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.785006  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:18.786897  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:18.783326  1693 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 18: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:18.803567  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:18.804657  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.806604  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:01:18.800357  6763 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.015s	sys 0.006s
I20260709 13:01:18.809180  2243 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:18.812878  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.782477  6817 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:18.800638  1544 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 4 to 7, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:18.814590  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:18.836560  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.837298  1693 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:18.801885  6820 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.758921  6749 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.838285  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.845678  1693 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:18.847311  1693 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:01:18.811326  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:18.849241  6876 log.cc:927] Time spent T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.437s	user 0.000s	sys 0.000s
I20260709 13:01:18.849660  1511 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:18.851191  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.851922  1687 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:18.839564  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.853536  1611 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:18.854454  6826 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:18.855221  6826 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:18.855577  6826 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:18.855962  6826 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.856406  1658 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:18.857224  6842 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:18.808625  6873 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:01:18.835803  6726 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:18.859246  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2425) took 1107 ms. Trace:
I20260709 13:01:18.859700  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 1039) took 1002 ms. Trace:
I20260709 13:01:18.781122  6688 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:18.860755  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 1041) took 1002 ms. Trace:
I20260709 13:01:18.859617  1619 rpcz_store.cc:276] 0709 13:01:17.752069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.837847 (+ 85778us) service_pool.cc:224] Handling call
0709 13:01:17.838121 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.899312 (+ 61191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.899356 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.902404 (+  3048us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.225978 (+323574us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:18.226027 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.226100 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.859012 (+632912us) raft_consensus.cc:1685] finished
0709 13:01:18.859032 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.859172 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64826,"raft.queue_time_us":66569,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":26974,"spinlock_wait_cycles":1368832,"thread_start_us":276987,"threads_started":1,"wal-append.queue_time_us":537254}
I20260709 13:01:18.861119  1540 rpcz_store.cc:276] 0709 13:01:17.858013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.975656 (+117643us) service_pool.cc:224] Handling call
0709 13:01:17.975966 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.744126 (+768160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.860519 (+116393us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400281754. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:18.860702 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743881984}
I20260709 13:01:18.756511  6867 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.860244  1536 rpcz_store.cc:276] 0709 13:01:17.857431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.932104 (+ 74673us) service_pool.cc:224] Handling call
0709 13:01:17.959035 (+ 26931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.961123 (+  2088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.961167 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.988170 (+ 27003us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.225372 (+237202us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:18.225675 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.226419 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.226490 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.848536 (+622046us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:18.859366 (+ 10830us) raft_consensus.cc:1685] finished
0709 13:01:18.859488 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.859628 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2127,"prepare.queue_time_us":167,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":15000,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":28287,"spinlock_wait_cycles":20872576,"thread_start_us":179907,"threads_started":1,"wal-append.queue_time_us":316896}
I20260709 13:01:18.863960  6867 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:18.842615  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.760015  6019 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.866199  6019 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:18.869647  6897 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:18.810171  6531 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:18.870541  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 1.24403e+06us
I20260709 13:01:18.818369  6817 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:18.871304  6817 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.875532  6797 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.875955  6826 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.877075  6731 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:18.878903  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 59364.9us
I20260709 13:01:18.881479  2243 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:18.857724  1658 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:18.883464  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:18.817386  6763 raft_consensus.cc:697] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:18.885829  6763 consensus_queue.cc:237] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.886766  6643 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:18.890241  1687 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:18.892920  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.877810  6722 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.895717  6901 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:18.924500  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 66844us
I20260709 13:01:18.929947  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:18.925168  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46854.5us
I20260709 13:01:18.933194  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:18.935566  6826 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.895643  6478 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:18.938704  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:18.939765  6887 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:18.941660  6887 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:18.942979  6887 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:18.943369  6887 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:18.944260  6887 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.945458  6887 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.929095  6901 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.951186  6901 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.957888  1658 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:18.960916  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:18.961797  6659 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:18.962180  6820 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.962246  6659 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:18.962924  6659 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.963578  1584 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:18.964885  6867 raft_consensus.cc:2804] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:18.965646  6867 raft_consensus.cc:697] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:18.966254  6877 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:18.966532  6867 consensus_queue.cc:237] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.970496  6859 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:18.889305  6749 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.971813  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:18.971971  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:18.972739  6749 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:18.972945  6642 consensus_meta.cc:287] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.005s
I20260709 13:01:18.973172  6749 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:18.973634  6749 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.973372  6642 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:18.975620  6642 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.975631  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 1208) took 1717 ms. Trace:
I20260709 13:01:18.976871  6802 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:18.976372  2270 rpcz_store.cc:276] 0709 13:01:17.258245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.462776 (+204531us) service_pool.cc:224] Handling call
0709 13:01:17.463335 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.662973 (+199638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.663018 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:17.663063 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:17.663098 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.975408 (+1312310us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54004da654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:18.975454 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.975576 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458622336}
I20260709 13:01:18.783654  6825 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:18.979455  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53894 (request call id 2418) took 1233 ms. Trace:
I20260709 13:01:18.979875  1614 rpcz_store.cc:276] 0709 13:01:17.746262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.746373 (+   111us) service_pool.cc:224] Handling call
0709 13:01:17.746627 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.947315 (+200688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.979239 (+1031924us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400068454. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:18.979394 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459373440}
I20260709 13:01:18.980379  6825 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:18.981875  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:18.982625  2270 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:18.986877  1612 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 17: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:01:18.992509  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.994966  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:19.007182  6883 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.798s	user 0.003s	sys 0.000s
I20260709 13:01:19.009090  6901 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:19.013401  6773 raft_consensus.cc:3060] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.015105  1585 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:19.016417  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:19.013455  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.021507  1584 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:19.022488  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:19.023144  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:19.024431  2270 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:18.992493  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:19.127244  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 69336.4us
I20260709 13:01:19.134316  6478 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.027942  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.019958  6877 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:19.023837  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:19.028952  2268 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:19.020685  6817 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:19.045782  6800 consensus_queue.cc:1059] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:01:19.227552  1536 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:19.041935  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:18.992981  6853 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.045746  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:19.015561  6642 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:19.049642  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 198976us
I20260709 13:01:19.050047  2270 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:19.024489  6634 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:19.158066  6472 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:19.290779  6852 raft_consensus.cc:3055] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:19.291237  6852 raft_consensus.cc:740] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:19.291638  2276 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:19.292054  6852 consensus_queue.cc:260] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:19.293154  6852 raft_consensus.cc:3060] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:19.135021  6478 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:19.295774  6478 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:19.168900  6868 log.cc:927] Time spent T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:19.043519  6677 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:19.068811   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:19.047822  6671 consensus_queue.cc:1059] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:01:19.072988  2274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1289) took 1871 ms (client timeout 1536 ms). Trace:
I20260709 13:01:19.073609  2272 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:19.018918  6659 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:19.297443  2274 rpcz_store.cc:269] 0709 13:01:17.201367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.210205 (+  8838us) service_pool.cc:224] Handling call
0709 13:01:19.072774 (+1862569us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54004c95d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:19.072919 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242141440}
I20260709 13:01:19.299239  6659 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:19.301051  6841 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:19.302917  6647 raft_consensus.cc:3055] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:19.303231  1537 raft_consensus.cc:2410] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:19.303336  6647 raft_consensus.cc:740] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:19.314831  1544 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:19.141302  6725 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:19.134914  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 142500us
W20260709 13:01:19.137444  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 163288us
I20260709 13:01:19.264979  2277 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:19.249002  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:19.076617  1442 catalog_manager.cc:5697] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 5 to 8, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.289016  6853 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:19.205585  6636 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:19.044770  6885 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:19.194703  6901 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:19.201553  6774 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:19.142099  6577 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:19.122329  6827 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.183s
I20260709 13:01:19.283033  1511 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:19.305895  6817 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:19.307472  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 265626us
I20260709 13:01:19.312898  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:19.321535  1585 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:19.334408  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:19.335457  1614 raft_consensus.cc:2410] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:01:19.337342  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:19.338059  1617 raft_consensus.cc:2393] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:19.339224  6867 consensus_queue.cc:1048] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.341318  1611 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:19.342322  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:19.343129  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:19.343848  1618 raft_consensus.cc:2393] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:19.344614  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:19.329438  1544 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:19.339385  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:19.349752  6472 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:19.349871  1612 raft_consensus.cc:2393] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 15: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:19.350345  6472 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:19.350261  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:19.350943  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:19.351737  1612 raft_consensus.cc:2410] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:19.351630  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:19.352530  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:19.352778  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:19.353505  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:19.354154  1612 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:19.297642  6671 raft_consensus.cc:3055] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:19.355424  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 72865.6us
I20260709 13:01:19.319520  6634 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:19.356940  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:19.369874  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.359455  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:19.370352  6634 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.373610  6634 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:19.374881  1693 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:19.376381  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:19.380721  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.378437  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:19.382468  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.383035  1544 raft_consensus.cc:2393] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:19.383905  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:19.384886  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.372450  1511 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:19.386135  6577 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:19.386775  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.389285  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:19.389816  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.390388  6577 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:19.392369  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.394025  2269 raft_consensus.cc:2468] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:19.394861  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.324810  6636 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:19.370123  6817 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:19.398445  1612 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:19.322993  6659 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:01:19.324455  6877 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:01:19.440274  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.440575  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.329365  6749 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:19.420928  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:19.422519  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:19.443881  1690 raft_consensus.cc:2393] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:19.424732  1688 raft_consensus.cc:1240] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:19.359229  6684 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.328404  6885 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.431231  1689 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:19.359161  6671 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:19.432855  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:19.446583  1611 raft_consensus.cc:2468] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:19.469877  1660 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:19.510447  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 51775.5us
I20260709 13:01:19.511693  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:19.447939  6796 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.449263  6885 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.526096  1660 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:19.547837  6918 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:01:19.454114  6817 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.418942  6647 consensus_queue.cc:260] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:19.507673  6752 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:19.525571  6519 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:19.448210  6684 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:19.524436  6825 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.529089  6847 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:19.525125  6841 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:19.459188  6577 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:01:19.513072  6846 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:01:19.592653  6647 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.507938  6636 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:19.593816  6752 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:19.578076  6671 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:19.584180  6825 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:19.593194  6841 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:19.611636  6853 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:19.628659  6671 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:19.635298  6919 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:01:19.629912  6264 raft_consensus.cc:3055] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:19.625664  6634 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:19.632911  6749 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:19.637435  6264 raft_consensus.cc:740] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:19.639950  6684 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:19.640103  6825 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:19.643355  6472 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:19.695914  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.766201  6634 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:19.701084  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:19.732362  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.746030  6264 consensus_queue.cc:260] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:19.751325  6800 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:19.698885  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:19.773698  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.777542  6264 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:19.779596  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.781634  6841 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:19.791416  1536 raft_consensus.cc:2393] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:19.790179  6472 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:19.799795  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2422) took 2787 ms. Trace:
I20260709 13:01:19.800307  1542 rpcz_store.cc:276] 0709 13:01:17.011906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.012050 (+   144us) service_pool.cc:224] Handling call
0709 13:01:17.012465 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.220051 (+1207586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.799134 (+1579083us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400281c54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:19.799565 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775449472}
I20260709 13:01:19.802121  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:19.809463  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.811717  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:19.812603  1620 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.813522  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:19.817806  1542 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:19.819044  1619 raft_consensus.cc:1240] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:19.819784  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1229) took 1457 ms. Trace:
I20260709 13:01:19.820218  2272 rpcz_store.cc:276] 0709 13:01:18.361888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.743042 (+381154us) service_pool.cc:224] Handling call
0709 13:01:19.073421 (+330379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.297585 (+224164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.819410 (+521825us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54004c95d0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:19.819603 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739653888}
W20260709 13:01:19.824950  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1301) took 1629 ms (client timeout 2113 ms). Trace:
W20260709 13:01:19.825431  2269 rpcz_store.cc:269] 0709 13:01:18.195474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.282359 (+ 86885us) service_pool.cc:224] Handling call
0709 13:01:19.824487 (+1542128us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b540071dc54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:19.824705 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209745152}
W20260709 13:01:19.827208  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45402 (request call id 1300) took 1632 ms (client timeout 2092 ms). Trace:
W20260709 13:01:19.827811  2271 rpcz_store.cc:269] 0709 13:01:18.194735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.220271 (+ 25536us) service_pool.cc:224] Handling call
0709 13:01:19.826702 (+1606431us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54004d99d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:19.827007 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091468032}
I20260709 13:01:19.829408  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:19.829931  6885 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:19.825440  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:19.843827  1542 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.855373  6861 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:19.858911  6746 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:19.862185  1618 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:19.848922  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:19.867559  1542 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
W20260709 13:01:19.868889  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.872267  1620 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:19.874119  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 1012) took 1309 ms. Trace:
I20260709 13:01:19.873968  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:19.875687  1619 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:19.876410  1536 raft_consensus.cc:1240] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:19.877172  1619 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:19.881206  1615 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:01:19.883237  1689 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.889350  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53910 (request call id 2834) took 1176 ms. Trace:
I20260709 13:01:19.890842  1615 rpcz_store.cc:276] 0709 13:01:18.712777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.735309 (+ 22532us) service_pool.cc:224] Handling call
0709 13:01:18.756302 (+ 20993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.881845 (+1125543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.883755 (+  1910us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001a40d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:19.889182 (+  5427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584881408}
I20260709 13:01:19.893234  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:19.874534  1686 rpcz_store.cc:276] 0709 13:01:18.540086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.540202 (+   116us) service_pool.cc:224] Handling call
0709 13:01:18.555843 (+ 15641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.556202 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:18.984834 (+428632us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b18004f8dc0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c32c0a 00007f29f2372219 00007f29e8cbaa40 00007f29e8cb54e4 00007f29e8cb5455 00007f29ef79d3c7 00007f29ebdaf9a7 00007f29ebdbf0bf 00007f29ebdbf038
0709 13:01:19.191552 (+206718us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.370932 (+179380us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:19.813588 (+442656us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b2c0009d728. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 13:01:19.814366 (+   778us) log.cc:844] Serialized 26 byte log entry
0709 13:01:19.831122 (+ 16756us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:19.831180 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.844461 (+ 13281us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.847048 (+  2587us) raft_consensus.cc:1685] finished
0709 13:01:19.847061 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.849541 (+  2480us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18987,"prepare.queue_time_us":437614,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1861,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":41504,"spinlock_wait_cycles":121485440,"thread_start_us":385264,"threads_started":2,"wal-append.queue_time_us":251152}
I20260709 13:01:19.894129  1687 raft_consensus.cc:3060] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.894827  6579 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:19.899906  6894 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 1.194s	user 0.004s	sys 0.001s
I20260709 13:01:19.901863  1615 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:19.862634  6819 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:19.849536  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 249210us
I20260709 13:01:19.908874  1537 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:19.914611  6860 log.cc:927] Time spent T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 1.759s	user 0.007s	sys 0.002s
W20260709 13:01:19.920658  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57234 (request call id 1038) took 2063 ms (client timeout 1509 ms). Trace:
W20260709 13:01:19.921263  1538 rpcz_store.cc:269] 0709 13:01:17.857068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.857229 (+   161us) service_pool.cc:224] Handling call
0709 13:01:19.920057 (+2062828us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540027fbd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:19.920385 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462428032}
I20260709 13:01:19.926299  1615 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:19.928097  1615 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:19.928514  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2443) took 1520 ms. Trace:
I20260709 13:01:19.929014  1540 rpcz_store.cc:276] 0709 13:01:18.408373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.862115 (+453742us) service_pool.cc:224] Handling call
0709 13:01:18.862466 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.988172 (+125706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.988237 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.988856 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.989064 (+   208us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:18.989110 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.927715 (+938605us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540025c1d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:19.927816 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.927917 (+   101us) raft_consensus.cc:1685] finished
0709 13:01:19.927942 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.928320 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288330624}
I20260709 13:01:19.931818  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 1040) took 2074 ms. Trace:
I20260709 13:01:19.932322  1543 rpcz_store.cc:276] 0709 13:01:17.857736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.971750 (+114014us) service_pool.cc:224] Handling call
0709 13:01:17.972065 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.185382 (+213317us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:18.218882 (+ 33500us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.316390 (+ 97508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:18.316440 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:18.316486 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.931280 (+1614794us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400282654. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:19.931361 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.931611 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17161,"prepare.queue_time_us":33393,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":3422,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5104,"spinlock_wait_cycles":490047616,"thread_start_us":97156,"threads_started":1,"wal-append.queue_time_us":358012,"wal-append.run_cpu_time_us":1089,"wal-append.run_wall_time_us":1004268}
I20260709 13:01:19.938748  1658 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:19.953117  1542 raft_consensus.cc:1275] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 15. (term mismatch)
I20260709 13:01:19.955586  1542 pending_rounds.cc:85] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 14
I20260709 13:01:19.963400  6731 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:19.964263  6731 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:19.968231  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46849.5us
I20260709 13:01:19.972231  1689 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:19.959859  1542 pending_rounds.cc:107] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 15.15
I20260709 13:01:19.975952  1537 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:19.973793  1542 raft_consensus.cc:2889] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:19.998893  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 123845us
I20260709 13:01:19.886961  6887 consensus_queue.cc:1048] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:01:20.006748  1687 raft_consensus.cc:2468] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:20.001950  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:20.011332  6617 consensus_queue.cc:1059] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:01:20.010761  1442 catalog_manager.cc:5697] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:20.027941  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.016247  6617 raft_consensus.cc:3055] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:20.031257  6478 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.031070  6053 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:20.018939  6264 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:01:20.029255  6472 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:01:20.046865  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 108465us
I20260709 13:01:20.034015  6885 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:20.042812  6901 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:01:20.044188  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.044791  6935 log.cc:927] Time spent T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:01:20.045895  1543 raft_consensus.cc:1240] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:20.046857  1440 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 343) took 30744 ms (client timeout 15000 ms). Trace:
W20260709 13:01:20.050472  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.069792  6847 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:20.077916  1659 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:20.078922  6478 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.080256  1509 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.082201  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:20.078112  6879 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.701s	user 0.000s	sys 0.003s
I20260709 13:01:20.082834  6817 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.084497  6800 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:20.032629  6617 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:20.085970  6617 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.087414  6617 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.088940  6610 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.091298  6264 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:20.092043  6264 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:20.093303  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 760003us
W20260709 13:01:20.093931  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.095873  6597 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.096468  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:20.096700  6597 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:20.098616  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52958 (request call id 2821) took 2610 ms (client timeout 2136 ms). Trace:
W20260709 13:01:20.099037  1694 rpcz_store.cc:269] 0709 13:01:17.487982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.488137 (+   155us) service_pool.cc:224] Handling call
0709 13:01:20.098207 (+2610070us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54004015d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:20.098408 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1840263552}
I20260709 13:01:20.099573  1540 raft_consensus.cc:1240] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:20.100723  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:20.101167  6519 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:20.101583  6519 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:20.084991  6800 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.104059  6885 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:01:20.102627  6519 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:20.112227  6597 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:20.095968  6264 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:20.105808  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:20.112691  6519 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.084998  1442 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.147037  1612 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:20.148211  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:20.151007  1537 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:20.156610  6885 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:20.157373  6880 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.157230  6885 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:20.158176  1584 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:20.157954  6880 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.159441  6885 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:20.160001  6885 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.160147  6880 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.160713  6880 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.160581  6885 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:20.161230  6880 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.162995  6659 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.163177  6880 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.163549  6659 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.164312  1617 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:20.164669  1612 raft_consensus.cc:1240] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:20.165835  6659 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.167184  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.168960  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.157255  6677 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.170825  6677 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.172899  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.174719  1544 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 18.
I20260709 13:01:20.175530  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:20.175876  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.177171  6825 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.177940  6825 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:20.173071  6677 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.162570  6885 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:20.182045  6936 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.366s	user 0.000s	sys 0.002s
W20260709 13:01:20.182449  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.183501  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:20.183701  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39668 (request call id 6) took 1635 ms. Trace:
I20260709 13:01:20.106017  6829 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:20.189505  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 107476us
W20260709 13:01:20.189855  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 163100us
W20260709 13:01:20.192836  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 77566.7us
I20260709 13:01:20.189239  1541 rpcz_store.cc:276] 0709 13:01:18.548384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.927898 (+379514us) service_pool.cc:224] Handling call
0709 13:01:20.183255 (+1255357us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b540025c1d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebdab735 00007f29ebda39fa 00007f29f0d6b4c9 00007f29ea2e7c54 00007f29ea2e7be2 00007f29ea2e7b11 00007f29ea2e7a8c 00007f29ea2e6d42 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:20.183528 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126045952}
I20260709 13:01:20.201964  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:20.065586  1440 rpcz_store.cc:269] 0709 13:00:49.302341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.309487 (+  7146us) service_pool.cc:224] Handling call
0709 13:00:49.412900 (+103413us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b5400350054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0f090 00007f29ebdadf3a 00007f29f1b641cc 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc 00007f29f0122392 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:20.046562 (+30633662us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:11.087620 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:11.096200 (+  8580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:11.096249 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:01:11.096281 (+    32us) tablet.cc:662] Decoding operations
0709 13:01:11.097372 (+  1091us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:11.097478 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:11.097503 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:11.098350 (+   847us) tablet.cc:701] Row locks acquired
0709 13:01:11.098399 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:01:11.098550 (+   151us) write_op.cc:270] Start()
0709 13:01:11.105468 (+  6918us) write_op.cc:276] Timestamp: P: 1783602071098490 usec, L: 0
0709 13:01:11.110096 (+  4628us) op_driver.cc:348] REPLICATION: starting
0709 13:01:11.240856 (+130760us) log.cc:844] Serialized 3606 byte log entry
0709 13:01:12.030008 (+789152us) op_driver.cc:464] REPLICATION: finished
0709 13:01:13.088488 (+1058480us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18003228a0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:01:13.088638 (+   150us) write_op.cc:301] APPLY: starting
0709 13:01:13.088724 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:13.208561 (+119837us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:13.208603 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:13.496960 (+288357us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:13.497295 (+   335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:01:13.497358 (+    63us) write_op.cc:312] APPLY: finished
0709 13:01:13.497701 (+   343us) log.cc:844] Serialized 89 byte log entry
0709 13:01:14.001449 (+503748us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:14.008958 (+  7509us) write_op.cc:454] Released schema lock
0709 13:01:14.022812 (+ 13854us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:14.110282 (+ 87470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:14.113486 (+  3204us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16326,"reported_tablets":47,"spinlock_wait_cycles":62941440,"child_traces":[["op",{"apply.queue_time_us":286491,"apply.run_cpu_time_us":32285,"apply.run_wall_time_us":959515,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41693,"num_ops":9,"prepare.queue_time_us":191998,"prepare.run_cpu_time_us":21317,"prepare.run_wall_time_us":256333,"raft.queue_time_us":244313,"raft.run_cpu_time_us":51297,"raft.run_wall_time_us":325692,"replication_time_us":888932,"spinlock_wait_cycles":3107584,"thread_start_us":948643,"threads_started":5,"wal-append.queue_time_us":664778,"wal-append.run_cpu_time_us":47428,"wal-append.run_wall_time_us":2598078}]]}
I20260709 13:01:20.212859  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 1042) took 2092 ms. Trace:
I20260709 13:01:20.213348  1539 rpcz_store.cc:276] 0709 13:01:18.120165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.121248 (+  1083us) service_pool.cc:224] Handling call
0709 13:01:18.176417 (+ 55169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.962650 (+1786233us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:19.962716 (+    66us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.962784 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:19.962857 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.212449 (+249592us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54001851d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:20.212502 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.212664 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":183,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":131,"spinlock_wait_cycles":4104937216}
I20260709 13:01:20.191046  6885 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.190013  6579 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.235612  6647 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:20.237094  6825 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:20.226888  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.241827  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 49456.4us
W20260709 13:01:20.255596  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 97569.9us
I20260709 13:01:20.240291  6731 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:20.304628  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.321076  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 71046.6us
I20260709 13:01:20.248319  6634 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:20.263062  2241 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:20.326812  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.330888   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:20.333082  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:20.337623  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 88551us
I20260709 13:01:20.246845  1442 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 5 to 8, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.349270  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:20.349785  6642 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:20.349972  1688 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:20.350402  6642 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.352571  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:20.352777  6642 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.354651  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.358803  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:20.359618  1693 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
I20260709 13:01:20.362887  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:20.363466  1693 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.367627  6677 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.367769  6725 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.368333  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:20.368631  6725 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:20.372249  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:20.375082  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:20.377940  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:20.337248  6671 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.379990  6671 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.382108  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:20.382305  6671 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.383363  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.384037  6470 consensus_queue.cc:1059] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:20.390440  1442 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 10 to 11, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.384773  1658 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:20.340827  2243 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:20.397063  2276 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:20.397370  6470 raft_consensus.cc:3055] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:20.397825  6470 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:20.397646  6634 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:20.398885  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 155470us
I20260709 13:01:20.398835  6470 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:20.400290  6946 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:20.400847  6946 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:20.401077  6655 consensus_queue.cc:1059] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:20.402141  6626 raft_consensus.cc:3055] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:20.402444  1585 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:20.402555  6626 raft_consensus.cc:740] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:20.403680  6626 consensus_queue.cc:260] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.404098  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.404682  6626 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.404960  2276 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:20.405177  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.401908  6946 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:20.409593  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 76651.5us
I20260709 13:01:20.400529  6470 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.427597  1442 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 8 to 11, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:20.429355  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.429212  1442 catalog_manager.cc:5697] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 13:01:20.430166  2277 raft_consensus.cc:2393] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:20.400734  6634 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.432415  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.433360  2268 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:20.433575  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:20.434237  2241 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.415175  6731 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:20.434834  6642 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:20.435468  2268 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:20.439080  6642 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.441318  6642 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:20.442483  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.444162  6861 consensus_meta.cc:287] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 13:01:20.443568  1442 catalog_manager.cc:5697] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.415009  6671 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:20.446211  6642 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:20.446414  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.447124  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:20.449141  2274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 1225) took 1001 ms. Trace:
W20260709 13:01:20.450073  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 65409.2us
I20260709 13:01:20.450816  6867 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:20.419528  6829 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.453634  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38018 (request call id 2035) took 1002 ms. Trace:
I20260709 13:01:20.456810  6731 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.457784  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 211589us
I20260709 13:01:20.457906  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 2435) took 1121 ms. Trace:
W20260709 13:01:20.458045  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.453544  6610 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.458833  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45396 (request call id 1215) took 2348 ms. Trace:
I20260709 13:01:20.460879  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.458612  6834 raft_consensus.cc:2804] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:20.461457  6655 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:20.463040  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 2433) took 1127 ms. Trace:
I20260709 13:01:20.463397  1542 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:20.463873  1619 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:20.484004  1611 rpcz_store.cc:276] 0709 13:01:19.335728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.342103 (+  6375us) service_pool.cc:224] Handling call
0709 13:01:20.462729 (+1120626us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54000e1d54. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:20.462868 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36084480}
I20260709 13:01:20.480504  1618 rpcz_store.cc:276] 0709 13:01:19.336185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.344388 (+  8203us) service_pool.cc:224] Handling call
0709 13:01:20.457607 (+1113219us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400111cd4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:20.457827 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1119747456}
I20260709 13:01:20.463953  6636 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:20.464802  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 69112.9us
I20260709 13:01:20.468323  1688 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:20.474990  1693 raft_consensus.cc:2410] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:20.476914  6827 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:20.483534  2275 rpcz_store.cc:276] 0709 13:01:18.110004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.153877 (+ 43873us) service_pool.cc:224] Handling call
0709 13:01:18.154187 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.240210 (+ 86023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.458364 (+2218154us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b54006504d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:20.458638 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196259584}
W20260709 13:01:20.485508  6948 log.cc:927] Time spent T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:20.488646  6834 raft_consensus.cc:697] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:20.489501  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:20.468196  6671 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.470170  2274 rpcz_store.cc:276] 0709 13:01:19.447880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.448030 (+   150us) service_pool.cc:224] Handling call
0709 13:01:19.448374 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.448681 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.448706 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:20.111934 (+663228us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b2c00047618. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea69ea11 00007f29ea6ae372 00007f29ebde0a01 00007f29ebda543a 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2
0709 13:01:20.112533 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:01:20.244500 (+131967us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:20.249045 (+  4545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.313993 (+ 64948us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:20.448761 (+134768us) raft_consensus.cc:1685] finished
0709 13:01:20.448780 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.448978 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":297,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":9865,"spinlock_wait_cycles":5825280,"thread_start_us":115728,"threads_started":1,"wal-append.queue_time_us":334385}
I20260709 13:01:20.436466  6800 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.489518  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:20.477916  1538 rpcz_store.cc:276] 0709 13:01:19.451124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.922523 (+471399us) service_pool.cc:224] Handling call
0709 13:01:19.960624 (+ 38101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:20.010820 (+ 50196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:20.010865 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:20.011558 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 13:01:20.122893 (+111335us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:20.122940 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.123009 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:20.453427 (+330418us) raft_consensus.cc:1685] finished
0709 13:01:20.453446 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.453557 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3321,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"spinlock_wait_cycles":39808,"thread_start_us":110905,"threads_started":1,"wal-append.queue_time_us":378656}
I20260709 13:01:20.478509  6725 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:20.505707  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 50442.3us
I20260709 13:01:20.498961  6671 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:20.511749  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.490518  6827 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:20.511112  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:20.515388  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:01:20.516670  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 55880.2us
I20260709 13:01:20.517899  6829 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.519096  1613 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:20.518334  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.508849  6655 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:20.518514  6829 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.523324  1617 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:20.501260  6519 consensus_queue.cc:1059] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:01:20.525712  6877 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:20.525987  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:20.526731  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 80424.7us
I20260709 13:01:20.522405  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.526661  2274 raft_consensus.cc:2468] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:20.513152  6731 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.527624  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.525730  6901 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:20.538172  1694 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:20.498862  6834 consensus_queue.cc:237] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.547871  1693 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 10: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:20.557972  1539 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:20.561460  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.564615  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.564986  1545 raft_consensus.cc:1275] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:20.566764  1541 raft_consensus.cc:1275] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:20.567634  1615 raft_consensus.cc:1240] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:20.567939  1545 raft_consensus.cc:1275] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:01:20.571723  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.573396  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:20.574123  1612 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:20.575672  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:20.576367  1539 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:20.576622  1616 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:20.577059  1685 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:20.578068  6931 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.578617  6931 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.619009  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.620853  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.570530  6647 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:20.617079  6470 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:20.632655  6470 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.617187  6053 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.640790  2268 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 17: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
W20260709 13:01:20.641337  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 94767.4us
W20260709 13:01:20.645745  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 136483us
W20260709 13:01:20.647840  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 129599us
W20260709 13:01:20.649637  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.653947  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.635098  6579 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:20.670789  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:20.677141  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:20.672474  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:20.638765  6519 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:20.657336  6642 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:20.686619  1509 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.687922  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:20.689646  1689 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.658902  6867 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.664330  6800 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.696440  6731 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.697105  6731 consensus_queue.cc:1059] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:20.698042  6731 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.698796  6470 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.699327  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:20.685352  6579 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.701407  6579 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:20.702044  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.669176  6825 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:20.708397  6961 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:01:20.711687  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52956 (request call id 2038) took 1871 ms. Trace:
I20260709 13:01:20.704113  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:20.715139  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 51507.8us
I20260709 13:01:20.717679  1689 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:20.674495  6647 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.718313  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:20.720948  6842 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.721115  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:20.721482  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 56870us
I20260709 13:01:20.722390  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.723112  2273 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:01:20.723951  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:20.724606  1691 raft_consensus.cc:2376] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14. Re-sending same reply.
I20260709 13:01:20.680354  6053 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.730669  1658 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:20.706131  6731 raft_consensus.cc:3055] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:20.707940  6867 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.742802  6731 raft_consensus.cc:740] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:01:20.744760  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 59356.8us
I20260709 13:01:20.713485  1692 rpcz_store.cc:276] 0709 13:01:18.712160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.852226 (+140066us) service_pool.cc:224] Handling call
0709 13:01:18.852594 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.925664 (+ 73070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.925708 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.926331 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:01:19.945162 (+1018831us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18002c9620. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb9450d1 00007f29ebd60a0f
0709 13:01:20.088510 (+143348us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:20.088552 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.088677 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:20.579640 (+490963us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b54000f0120. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd1adbe 00007f29ebd25930 00007f29ebd258d8 00007f29ebd25858 00007f29ebd25813 00007f29ebd24a9c 00007f29f1c10626 00007f29f1c0add8 00007f29ebd617cb 00007f29ebd642c0
0709 13:01:20.582960 (+  3320us) raft_consensus.cc:1685] finished
0709 13:01:20.582989 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.583169 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37307,"raft.queue_time_us":43290,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":18175,"spinlock_wait_cycles":142732928,"thread_start_us":80617,"threads_started":1,"wal-append.queue_time_us":1101223}
I20260709 13:01:20.744751  6751 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:01:20.745661  6752 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:20.747051  1694 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:20.727069  6800 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.759774  6731 consensus_queue.cc:260] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.761399  6731 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.757387  6470 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:20.676669  6827 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.764267  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.764837  6827 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:20.767395  6959 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:01:20.713825  6519 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:20.773139  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 111628us
I20260709 13:01:20.762717  6579 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:20.760360  6867 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.779960  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:20.781507  6949 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:20.782177  6949 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:20.784621  6949 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:20.789355  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52426 (request call id 1022) took 2139 ms (client timeout 1631 ms). Trace:
W20260709 13:01:20.789938  1685 rpcz_store.cc:269] 0709 13:01:18.649395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.653504 (+  4109us) service_pool.cc:224] Handling call
0709 13:01:20.789090 (+2135586us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b5400125054. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:20.789255 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4124426624}
W20260709 13:01:20.790357  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 68128.7us
I20260709 13:01:20.795501  6519 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.796299  6647 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.792258  1509 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.798171  6684 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:20.798254  6796 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:20.799320  1689 raft_consensus.cc:1275] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:20.800287  6774 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:20.801259  6968 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:01:20.801812  6774 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:20.733946  6746 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:01:20.801133  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.803236  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:20.804183  6901 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:20.804327  6796 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:20.804668  6901 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:20.756314  6825 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.805359  6901 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.807314  6825 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.807471  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.808995  2268 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:20.809914  6684 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:20.810789  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 62003.9us
I20260709 13:01:20.811162  6684 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.807485  1509 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:20.811792  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 63225.5us
I20260709 13:01:20.809305  6752 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.814092  6829 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:20.816833  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.823997  6752 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:20.840848  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.827642  6825 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:20.844573  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 140503us
W20260709 13:01:20.854995  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 47651.5us
I20260709 13:01:20.856141  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:20.856990  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:20.864634  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.858467  6842 raft_consensus.cc:2764] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:20.858919  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:20.890009  1509 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.888775  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:20.893612  6946 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.901690  6579 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:20.901818  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 94247.5us
I20260709 13:01:20.902343  6579 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:20.902930  6579 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:20.907895  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:20.911756  6800 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.912204  6931 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:20.919929  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:20.926791  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 52789.9us
I20260709 13:01:20.910075  6949 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:20.927706  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:20.920769  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.932536  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:20.938412  6053 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:20.938660  6970 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.887105  6610 consensus_queue.cc:1059] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:01:20.953135  6470 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.909945  6647 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:20.961326  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:20.894635  6946 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:20.969211  1428 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d53120c1adf947fd992e5950edf26301 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0cccd9c43f9747529680a8e7463961c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:20.971089  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 108014us
W20260709 13:01:20.971684  6958 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.314s	user 0.003s	sys 0.000s
I20260709 13:01:20.956527  6800 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.978374  6949 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:20.978955  6258 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:20.990607  1542 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:20.963915  6842 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:20.999920  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.998735  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 95697.4us
W20260709 13:01:21.012120  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.560s (SENT) [suppressed 13 similar messages]
I20260709 13:01:21.015174  6725 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:21.026803  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46241.2us
I20260709 13:01:21.015307  6825 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:20.994894  6647 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:21.024977  6671 consensus_meta.cc:287] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.004s
I20260709 13:01:21.035804  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:21.035734  6749 consensus_queue.cc:1059] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:01:21.043542  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:21.044147  6834 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.044739  6655 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:21.047838  6053 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.048185  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:21.050916  6655 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:21.051314  6977 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:21.051630  6655 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:21.029711  6725 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:21.055718  1584 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:21.030799  6258 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:21.077332  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.091351  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:21.052980  6655 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:21.097985  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 67220.4us
I20260709 13:01:21.038498  6671 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.061980  6827 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:21.106802  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.106377  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:21.108752  1544 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:21.109404  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 97305.5us
I20260709 13:01:21.110437  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:21.112463  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:21.115247  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:21.116299  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:21.116196  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:21.117093  1688 raft_consensus.cc:2368] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11.
I20260709 13:01:21.117717  1542 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:21.119956  6258 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.120190  6825 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.119800  1685 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:21.120731  6825 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.122241  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:21.123775  1620 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:21.137092  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:21.141113  1509 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:21.142187  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:21.119776  6846 raft_consensus.cc:3055] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:01:21.145177  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 106664us
I20260709 13:01:21.113106  6634 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:21.113245  6847 consensus_queue.cc:1048] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:01:21.170156  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 53099.2us
I20260709 13:01:21.170382  6731 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.171003  6731 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:21.171356  1509 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:21.172003  6731 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.131407  6834 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:21.174903  6946 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:21.176229  6634 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:21.177747  6981 log.cc:927] Time spent T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:01:21.146281  6846 raft_consensus.cc:740] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:21.181332  6846 consensus_queue.cc:260] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.183892  6825 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:21.184599  6725 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.173214  6829 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.172598  1509 leader_election.cc:400] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11.
I20260709 13:01:21.168553  1658 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:21.189872  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 73329.2us
W20260709 13:01:21.207412  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.113653  6993 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 13:01:21.249358  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 76956.5us
I20260709 13:01:21.241214  6642 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.176177  6985 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:21.264478  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:21.255043  6610 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:21.266613  6847 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:21.266773  6989 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.002s
I20260709 13:01:21.280169  1544 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
W20260709 13:01:21.268719  6967 log.cc:927] Time spent T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.544s	user 0.006s	sys 0.000s
I20260709 13:01:21.269410  6519 raft_consensus.cc:3055] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:21.269888  6884 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.279553  6847 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.290829  6636 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:21.291028  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:21.291461  6829 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:21.291631  6834 consensus_queue.cc:1048] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:21.292066  6825 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:21.292423  1509 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:21.300719  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:21.265863  6987 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.293849  6519 raft_consensus.cc:740] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:21.302174  6847 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.336169  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:21.278590  6642 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.344527  2277 raft_consensus.cc:1240] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:21.338897  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:21.347925  1614 raft_consensus.cc:2393] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 8: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:21.317826  6825 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:21.359200  6986 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:01:21.362023  6990 log.cc:927] Time spent T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.154s	user 0.003s	sys 0.000s
I20260709 13:01:21.363495  6725 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:21.367414  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 75050.8us
I20260709 13:01:21.373859  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:21.374492  1691 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
W20260709 13:01:21.385140  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.396574  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46587.3us
I20260709 13:01:21.326342  6969 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:21.410622  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 151204us
I20260709 13:01:21.407271  1510 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:21.405625  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:21.409909  6258 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:21.416826  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 112631us
I20260709 13:01:21.418284  6642 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:21.412889  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:21.422806  6829 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.425259  6970 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.427290  1537 raft_consensus.cc:1240] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:21.425987  6519 consensus_queue.cc:260] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.331905  6610 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.429018  6519 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.317086  6884 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:21.427917  6752 consensus_meta.cc:287] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
I20260709 13:01:21.430531  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:21.431229  1620 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:21.431901  6884 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:21.432689  1611 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 8.
I20260709 13:01:21.416766  6258 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.434721  6258 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.438097  6800 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:21.403972  6684 consensus_meta.cc:287] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 13:01:21.438756  1536 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:21.438834  6684 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.349637  6825 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.430975  6752 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.404194  6655 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:21.478434  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 62953.7us
I20260709 13:01:21.325358  6987 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.412542  6617 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.495443  6999 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:01:21.498471  6655 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:01:21.442003  6975 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:21.474017  6684 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:21.513511  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 111317us
I20260709 13:01:21.514818  1692 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 19: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:21.510142  6617 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.520500  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:21.524850  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:21.529734  6987 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:21.537062  6655 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.537968  6847 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.539438  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:21.540042  1615 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:21.540793  6579 consensus_meta.cc:287] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.003s
I20260709 13:01:21.540985  6617 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:21.541244  6579 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.543496  6579 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.544329  6847 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:21.549039  6901 consensus_meta.cc:287] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.743s	user 0.005s	sys 0.009s
I20260709 13:01:21.549510  6901 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.550133  6634 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:21.554235  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 158914us
I20260709 13:01:21.550637  2271 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:21.551779  6671 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.557403  1615 raft_consensus.cc:2468] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:21.559043  1660 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:21.560184  1619 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:21.552186  6901 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:21.546381  6825 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.557106  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:21.565449  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.572791  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:21.561579  6731 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:21.562498  6827 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:21.576380  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.563301  6684 raft_consensus.cc:2804] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:21.578963  6610 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.567433  6796 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:21.568809  6579 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:21.598922  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 89561us
I20260709 13:01:21.577582  6731 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.591130  6579 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.618716  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:21.591486  6684 raft_consensus.cc:697] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:21.621371  1691 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
I20260709 13:01:21.603588  6731 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:21.622648  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:21.627305  6825 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.629210  6846 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:21.631384  6684 consensus_queue.cc:237] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:21.636147  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.636991  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.645262  6610 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.645684  6610 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.647634  6610 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.649216  6847 consensus_queue.cc:1048] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:21.650328  1659 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:21.651312  7013 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:21.651813  6749 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.652360  6752 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:21.622545  6579 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.673357  1659 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:21.677945  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:21.678512  1692 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.599716  6796 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.667984  6749 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.680855  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 77929.5us
I20260709 13:01:21.670397  7006 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:21.667273  6969 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:21.684751  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:21.689316  1614 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.691494  6725 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:21.694782  6796 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:21.695508  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.696394  6749 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:21.699684  7009 log.cc:927] Time spent T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:21.701435  7018 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.701925  6749 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.701994  7018 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.708557  7018 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.704311  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:21.711017  7010 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:21.712001  7010 consensus_queue.cc:1059] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:21.713018  7010 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:21.713424  7010 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:21.715303  1584 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:21.716320  6827 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:21.716980  6827 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:21.729276  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 58434us
I20260709 13:01:21.732482  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.750363  1692 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:21.750547  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:21.752471  1509 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:21.752928  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:21.761044  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 338445us
I20260709 13:01:21.731932  6969 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:21.733181  7006 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:21.718139  6827 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.769409  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:21.760856  6970 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:21.772768  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:21.773772  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.774758  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:21.775494  1539 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.785568  6579 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.786254  1539 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:21.795985  6579 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:21.798365  7006 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.801020  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:21.801172  2241 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:21.801740  1692 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.802459  6617 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:21.802837  6617 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:21.803203  6617 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.807188  6969 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.809693  6617 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.714471  7010 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.811197  6970 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:21.811548  6995 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.812399  6970 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.814033  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:21.813495  6617 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:21.769932  6610 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.815184  1659 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:21.815271  6982 consensus_queue.cc:1048] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 13:01:21.825049  7005 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.003s
I20260709 13:01:21.825119  6610 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:21.765808  6634 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:21.826617  6749 consensus_queue.cc:1059] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:21.826838  6634 consensus_queue.cc:1048] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:21.827385  6634 consensus_queue.cc:1243] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 13.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:01:21.827499  6847 raft_consensus.cc:3055] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:21.827962  6847 raft_consensus.cc:740] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:21.826150  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:21.829226  1543 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:21.828824  6847 consensus_queue.cc:260] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.829999  7010 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:21.830097  6647 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.830345  6847 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.796059  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:21.834352  1541 raft_consensus.cc:3060] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.834570  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.835049  2243 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:21.836211  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:21.836889  1543 raft_consensus.cc:2410] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:21.836961  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.819845  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1243) took 1004 ms. Trace:
I20260709 13:01:21.837853  2271 rpcz_store.cc:276] 0709 13:01:20.815834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.817160 (+  1326us) service_pool.cc:224] Handling call
0709 13:01:20.838231 (+ 21071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.557703 (+719472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.819610 (+261907us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54008d13d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:21.819785 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1637797120}
I20260709 13:01:21.838768  1692 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:21.839860  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:21.835175  2270 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 8.
I20260709 13:01:21.836011  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:21.840723  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.840569  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:21.842824  2243 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:21.843269  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.843670  1618 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:21.806176  1614 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 19.
I20260709 13:01:21.847224  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.847409  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.785621  6731 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:21.849157  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.850968  1660 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:21.852120  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:21.851651  1511 leader_election.cc:336] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Timed out: RequestConsensusVote RPC to 127.0.107.194:46485 timed out after 1.727s (SENT)
I20260709 13:01:21.846989  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:21.857210  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.858777  2269 raft_consensus.cc:2393] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:21.853893  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:21.812178  6995 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:21.868770  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 54795.5us
I20260709 13:01:21.844112  6579 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:21.857753  6884 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:21.861337  6752 raft_consensus.cc:2804] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:21.873982  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:21.868534  6949 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:21.880682  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:21.882382  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.883033  2273 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:21.884485  6995 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.885670  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:21.886422  1613 raft_consensus.cc:2393] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:21.886760  7020 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:21.881979  6470 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:21.887894  6470 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.888222  6470 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:21.888759  7029 raft_consensus.cc:2764] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:01:21.895795  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 44163.2us
I20260709 13:01:21.900383  6731 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:21.873910  7019 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:21.890347  6949 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.906867  6752 raft_consensus.cc:697] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 19 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:21.907368  7020 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:21.906922  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:21.876567  6884 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.911541  1658 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:21.915539  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:21.919826  6884 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:21.907202  6949 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.919448  6579 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:21.928746  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 521484us
I20260709 13:01:21.930389  1688 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: [8.8-12.10]
I20260709 13:01:21.939067  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:21.940691  1685 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:21.947052  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:21.947383  1692 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:21.947642  1687 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 7.
I20260709 13:01:21.908094  6752 consensus_queue.cc:237] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.951226  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:21.952054  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:21.953382  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:21.953476  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 55827.9us
I20260709 13:01:21.957342  1618 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:21.958465  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.908316  7020 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:21.959376  6796 consensus_queue.cc:1059] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:21.962219  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:21.967195  2268 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:21.969949  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:21.971884  1617 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:21.972209  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.972224  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.972779  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.973001  2271 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:21.974417  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:21.975198  1537 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 15: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:21.950613  6258 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:21.974215  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.973001  2270 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:21.973958  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:21.981397  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:21.982399  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:21.986563  2277 raft_consensus.cc:2393] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 17: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:21.987838  1687 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:21.993324  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:21.996445  1659 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:21.997709  1659 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:21.999329  1659 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:22.003926  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:21.979072  7029 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:22.018074  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:21.990723  6983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.004s	sys 0.017s
I20260709 13:01:22.023029  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.024084  1659 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:21.968762  6827 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:01:22.031461  1541 raft_consensus.cc:2468] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 19.
I20260709 13:01:22.029381  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:21.985387  6258 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:22.014261  6867 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:21.985055  6655 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:01:22.027518  6983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.006s	sys 0.017s
I20260709 13:01:22.080299  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.035398  6993 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.082836  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.020387  6746 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:22.087157  1685 raft_consensus.cc:1240] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:22.031864  6994 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:22.070137  6642 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:22.090428  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:22.090862  6647 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:22.091078  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.118085  1537 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:22.091845  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.092475  1694 raft_consensus.cc:2410] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:01:22.092522  1693 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:22.093083  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.093977  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.094973  6258 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:22.099653  1428 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d53120c1adf947fd992e5950edf26301 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0cccd9c43f9747529680a8e7463961c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:22.100449  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 71149.5us
I20260709 13:01:22.125447  1659 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:22.102975  6884 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.106802  1541 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:22.092432  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:22.020548  6796 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:01:22.030481  7029 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:22.114439  1542 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.115381  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.133466  1618 raft_consensus.cc:2368] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13.
I20260709 13:01:22.117187  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:22.126549  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.127424  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:22.128995  1540 raft_consensus.cc:2410] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 17 because replica has last-logged OpId of term: 13 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:01:22.136405  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:22.111006  6746 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:22.137353  2268 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 15: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:22.138897  1615 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:22.141561  1613 raft_consensus.cc:1275] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:22.145905  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.126240  6053 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:22.146709  2241 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:22.129959  6749 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:22.151563  1693 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:22.142246  6867 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:22.145852  6994 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:22.163092  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.147284  6746 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.149958  6053 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:01:22.193699  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.135426  6642 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.164098  6867 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:22.241731  6867 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.241529  6053 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.160948  6842 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:01:22.242867  6053 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.242654  7029 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.181929  7035 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.241525  6642 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:22.246929  7035 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.248680  7035 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:22.160872  7020 consensus_queue.cc:1059] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:01:22.249396  7020 raft_consensus.cc:3055] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:22.249696  7020 raft_consensus.cc:740] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:22.219540  6901 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:22.166764  6834 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:01:22.251111  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.251657  1613 raft_consensus.cc:3060] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.221801  6774 consensus_queue.cc:1059] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:22.225210  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.254962  6636 raft_consensus.cc:3055] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:22.255304  6636 raft_consensus.cc:740] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:22.256050  6636 consensus_queue.cc:260] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.236234  7019 raft_consensus.cc:3055] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:22.260275  7019 raft_consensus.cc:740] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:22.260578  7026 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:22.225914  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.261335  1618 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.261085  7026 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.263837  7026 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:22.261077  7019 consensus_queue.cc:260] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.264905  6470 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.221421  6884 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:22.161574  6655 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:01:22.142351  6969 consensus_queue.cc:1059] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:22.266893  6969 consensus_queue.cc:1243] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer e2a2b76c98ee44ff95e6508c34da0e3d log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:22.226575  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.267287  6969 raft_consensus.cc:3055] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:22.267592  6969 raft_consensus.cc:740] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:22.228228  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.228938  1616 raft_consensus.cc:1240] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:01:22.268299  6969 consensus_queue.cc:260] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.269328  6969 raft_consensus.cc:3060] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.227615  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:21.953985   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:22.239600  2276 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:22.229475  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.240764  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.242064  6579 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:22.279709  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.281065  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.285240  1620 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:22.320124  1618 raft_consensus.cc:2410] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:22.328390  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:22.328438  2277 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:22.276609  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:22.301980  1615 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:22.309134  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:22.287139  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.313921  1542 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:22.348466  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.349478  1612 raft_consensus.cc:2393] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 17: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:22.350133  1545 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:01:22.221838  6949 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.352689  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:22.295083  7043 log.cc:927] Time spent T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:01:22.356153  1538 raft_consensus.cc:1240] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:01:22.289172  7037 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.003s
I20260709 13:01:22.362879  6470 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:22.367451  1612 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:01:22.367595  6579 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:22.323794  6642 consensus_queue.cc:1059] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:01:22.371246  6642 raft_consensus.cc:3055] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:22.371600  6642 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:22.371752  1613 raft_consensus.cc:2468] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:22.412488  6949 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:22.415079  1441 catalog_manager.cc:5697] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 4 to 12, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:22.250448  7020 consensus_queue.cc:260] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.264911  7019 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.340023  6617 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:22.422996  6617 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.425177  6617 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:22.427531  7023 log.cc:927] Time spent T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:22.355125  7035 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.428642  7035 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.433113  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.433506  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.434676  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.434970  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.435316  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:22.435667  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 83076.6us
I20260709 13:01:22.436100  1614 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 15: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:22.436200  6470 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:22.436766  6470 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.436913  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.437211  6470 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.372424  6642 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.440894  6642 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.441040  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:22.441802  1538 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:22.443861  6993 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:22.274528  6867 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.430562  7035 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:22.447108  6867 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:22.450312  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.451191  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.451445  1542 raft_consensus.cc:2410] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:01:22.452129  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.452273  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.452884  1620 raft_consensus.cc:2368] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13.
I20260709 13:01:22.453192  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.453600  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.453712  1612 raft_consensus.cc:2376] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12. Re-sending same reply.
I20260709 13:01:22.453811  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.456491  6751 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:22.458369  6751 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.458871  2243 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:22.459597  6053 raft_consensus.cc:2804] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:22.459487  6751 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.460551  6053 raft_consensus.cc:697] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:22.460915  1693 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:22.461546  6751 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:22.435026  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.462625  1619 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 19: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:22.463389  1691 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:22.463506  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.464449  1619 raft_consensus.cc:2393] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 10: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:22.464643  7020 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.465327  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.466435  1619 raft_consensus.cc:2410] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:01:22.468705  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.435281  1618 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:22.475145  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.475519  1545 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:22.475719  1618 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:22.477308  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.479656  7026 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.480157  7026 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.482815  7026 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:22.483273  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:22.450700  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.485883  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:22.378665  6746 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.487099  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.487402  6731 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:22.488978  6746 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:22.494264  6993 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.494815  6993 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.495246  1539 raft_consensus.cc:1275] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:01:22.495663  1539 pending_rounds.cc:85] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 7
I20260709 13:01:22.495898  1539 pending_rounds.cc:107] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:01:22.496102  1539 raft_consensus.cc:2889] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.496874  6993 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:22.498330  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.501437  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.502226  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.461426  6053 consensus_queue.cc:237] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.505668  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.506399  1693 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:22.508066  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:22.503154  1618 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:01:22.517711  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.519443  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.520073  1615 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:22.521136  1538 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:22.521593  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.519542  1660 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:22.522912  1658 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:22.528353  1441 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 10 to 14, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 14 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:22.552166  2243 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:22.497565  6847 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:01:22.504508  6731 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.554965  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.517120  6867 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.559693  1612 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.554070  1441 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 6 to 11, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:22.525050  6825 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:22.529968  6751 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:22.562692  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.504096  6519 consensus_queue.cc:1048] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:01:22.554142  6749 raft_consensus.cc:2804] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:22.572496  1615 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 15: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:22.580687  6636 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.582111  1660 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:22.523541  6970 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:22.567454  1441 catalog_manager.cc:5697] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:22.569279  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 407829us
I20260709 13:01:22.526028  7026 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:01:22.566614  6983 raft_consensus.cc:2804] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:22.599098  6579 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.628253  6579 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.630370  6579 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:22.569352  6867 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.602824  6647 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.602340  1441 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.603638  6749 raft_consensus.cc:697] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:22.649693  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.610917  7035 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:22.611413  6983 raft_consensus.cc:697] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:01:22.619154  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38400 (request call id 237) took 32038 ms (client timeout 15000 ms). Trace:
I20260709 13:01:22.632078  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.675727  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.676491  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.633102  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:22.677536  1618 raft_consensus.cc:2410] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:22.566772  6731 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.635407  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.568593  6825 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.637418  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:22.638600  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.640446  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.695631  1537 pending_rounds.cc:85] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 13
I20260709 13:01:22.695919  1537 pending_rounds.cc:107] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 13:01:22.696089  1615 raft_consensus.cc:2393] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 19: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:22.696166  1537 raft_consensus.cc:2889] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.642374  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:22.653119  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.653635  6647 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.656288  6749 consensus_queue.cc:237] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.657413  1441 catalog_manager.cc:5697] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 6 to 12, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:22.660996  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.661615  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.661811  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.662302  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.678726  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.704258  1686 raft_consensus.cc:2410] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:22.686323  1685 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:01:22.679101  1584 connection.cc:256] RPC call timeout handler was delayed by -1.112876473999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
I20260709 13:01:22.687178  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.686952  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.704994  1584 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:22.688488  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.702603  1614 raft_consensus.cc:1275] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:22.702540  1539 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:22.704381  1541 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:22.708953  1545 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:22.658717  7035 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.710278  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:22.713747  1693 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.705379  1540 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:22.692225  7029 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.726147  1689 raft_consensus.cc:1240] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:22.735086  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.735693  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:22.701048  6825 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:22.738287  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.742635  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.745023  1511 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:22.746394  1687 raft_consensus.cc:2393] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:22.678375  6982 consensus_queue.cc:1048] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:01:22.722822  7035 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:22.679257  6655 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:01:22.754882  1441 catalog_manager.cc:5697] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:22.807075  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.756580  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.887567  1685 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
W20260709 13:01:22.757102  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 52174.3us
I20260709 13:01:22.889106  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:22.759123  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.866411  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.871728  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.891556  1686 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:22.735185  7018 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.745929  7026 consensus_queue.cc:1059] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:01:22.757815  6995 consensus_queue.cc:1048] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:01:22.756167  6796 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:22.757615  6970 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:01:22.755486  1511 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:22.928295  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:22.928347  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
W20260709 13:01:22.933075  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.675450  1442 rpcz_store.cc:269] 0709 13:00:50.580388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.581130 (+   742us) service_pool.cc:224] Handling call
0709 13:01:22.619078 (+32037948us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:20.771218 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:20.772080 (+   862us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:20.772153 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:01:20.772181 (+    28us) tablet.cc:662] Decoding operations
0709 13:01:20.773094 (+   913us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:20.773181 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:20.773212 (+    31us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:01:20.773968 (+   756us) tablet.cc:701] Row locks acquired
0709 13:01:20.774024 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:01:20.774199 (+   175us) write_op.cc:270] Start()
0709 13:01:20.774350 (+   151us) write_op.cc:276] Timestamp: P: 1783602080774138 usec, L: 0
0709 13:01:20.774397 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:01:20.920654 (+146257us) log.cc:844] Serialized 3281 byte log entry
0709 13:01:21.580071 (+659417us) op_driver.cc:464] REPLICATION: finished
0709 13:01:21.807061 (+226990us) write_op.cc:301] APPLY: starting
0709 13:01:21.807170 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:21.904178 (+ 97008us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:21.904315 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:21.923417 (+ 19102us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:21.923737 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:01:21.923794 (+    57us) write_op.cc:312] APPLY: finished
0709 13:01:21.924119 (+   325us) log.cc:844] Serialized 81 byte log entry
0709 13:01:21.924290 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.924402 (+   112us) write_op.cc:454] Released schema lock
0709 13:01:21.924464 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:21.924873 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.934454 (+  9581us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":10883,"mutex_wait_us":972852,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":226702,"apply.run_cpu_time_us":11702,"apply.run_wall_time_us":117795,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37519,"num_ops":8,"prepare.queue_time_us":153908,"prepare.run_cpu_time_us":13388,"prepare.run_wall_time_us":311087,"raft.queue_time_us":210858,"raft.run_cpu_time_us":59713,"raft.run_wall_time_us":182245,"replication_time_us":805479,"thread_start_us":426033,"threads_started":4,"wal-append.queue_time_us":139523}]]}
I20260709 13:01:22.945358  1441 catalog_manager.cc:5697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 9 to 13, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:22.923380  6642 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:22.961107  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.902315  1693 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
W20260709 13:01:22.907531  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.012s	sys 0.029s
W20260709 13:01:22.963413  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.012s	sys 0.029s
I20260709 13:01:22.910233  1612 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:22.964529  1618 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:01:22.914021  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 205155us
I20260709 13:01:22.747206  7029 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.917893  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:22.754019  6470 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:22.825165  6983 consensus_queue.cc:237] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:22.979732  1441 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:22.988500  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 70660.9us
I20260709 13:01:22.970732  6796 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:22.970504  6258 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.990221  1441 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.021584  1441 catalog_manager.cc:5697] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:23.019600  1685 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:23.024857  1584 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.027202  1584 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:22.989915  6642 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.012934  7049 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.029656  7049 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.013706  6579 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:23.033701  1441 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 9 to 11, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.045022  1619 raft_consensus.cc:1240] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:23.024421  6258 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.047019  1441 catalog_manager.cc:5697] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 7 to 11, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:23.048272  7055 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:01:23.048779  1441 catalog_manager.cc:5697] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 6 to 9, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:23.049813  7054 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:01:23.051514  7053 log.cc:927] Time spent T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:01:23.050179  1441 catalog_manager.cc:5697] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 11, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:23.032063  7018 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.095412  1441 catalog_manager.cc:5697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:23.038226  6634 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:23.041499  7050 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:01:23.108003  2275 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:23.039487  6731 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:23.113293  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 86119us
I20260709 13:01:23.069517  6647 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:23.119287  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 152098us
I20260709 13:01:23.119712  1441 catalog_manager.cc:5697] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 7 to 11, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:23.114312  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 128511us
I20260709 13:01:23.037330  6579 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:23.125270  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 369818us
I20260709 13:01:23.124711  1441 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 12 to 15, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:23.119207  7020 consensus_meta.cc:287] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.003s
I20260709 13:01:23.126573  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:23.129338  2241 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.142210  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.143337  1584 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.143280  1544 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:23.145121  1441 catalog_manager.cc:5697] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 6 to 13, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:23.165581  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.168678  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:23.179363  1536 raft_consensus.cc:2393] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 15: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:23.179963  1545 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:23.194020  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:23.194654  1540 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
I20260709 13:01:23.195045  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:23.195878  2273 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:23.152662  6470 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:23.146502  7026 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.199970  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:23.127826  7072 consensus_queue.cc:1059] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:01:23.151626  6827 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.152419  7078 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:23.236586  7078 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:23.237150  7078 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.220630  1441 catalog_manager.cc:5697] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 5 to 7, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:23.238622  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.238261  1441 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 11, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:23.239974  6827 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.239584  1441 catalog_manager.cc:5697] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 8 to 10, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.241145  1584 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.241886  6827 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.244175  1584 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.246258  6827 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:23.193053  6834 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.250663  1584 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.285902  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.287115  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.196552  7029 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:23.150839  7018 consensus_queue.cc:1059] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:01:23.246904  1441 catalog_manager.cc:5697] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 7 to 11, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 13:01:23.249876  7056 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:01:23.232466  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 94658.9us
I20260709 13:01:23.295992  1511 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:23.301712  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 106712us
I20260709 13:01:23.313841  6642 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.314554  6642 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.314884  6642 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:23.316787  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.284921  6827 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.325485  7064 log.cc:927] Time spent T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:01:23.315232  6642 raft_consensus.cc:3060] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.294422  7029 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.330766  7068 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.367707  6579 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:23.365139  7078 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:23.342942  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46961.1us
I20260709 13:01:23.376356  1511 leader_election.cc:400] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13.
I20260709 13:01:23.345134  6827 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.378851  6827 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:23.381119  7035 consensus_meta.cc:287] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.002s
I20260709 13:01:23.381666  7035 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.382810  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52426 (request call id 1042) took 1380 ms. Trace:
W20260709 13:01:23.389087  6825 consensus_meta.cc:287] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.000s
I20260709 13:01:23.383324  1688 rpcz_store.cc:276] 0709 13:01:22.002401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.002542 (+   141us) service_pool.cc:224] Handling call
0709 13:01:22.002958 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.020734 (+ 17776us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:22.077661 (+ 56927us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.405092 (+327431us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b18002ff0e0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb94523a 00007f29ebdafa2a
0709 13:01:23.176551 (+771459us) log.cc:844] Serialized 14 byte log entry
0709 13:01:23.177323 (+   772us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.193062 (+ 15739us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.193256 (+   194us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:23.197486 (+  4230us) log.cc:844] Serialized 14 byte log entry
0709 13:01:23.239646 (+ 42160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.239809 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.382572 (+142763us) raft_consensus.cc:1685] finished
0709 13:01:23.382593 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.382740 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43631,"prepare.queue_time_us":522052,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":91,"raft.queue_time_us":221960,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":29885,"spinlock_wait_cycles":4425472,"thread_start_us":786148,"threads_started":3,"wal-append.queue_time_us":836158}
I20260709 13:01:23.364152  7082 raft_consensus.cc:3055] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:01:23.416170  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 45945.6us
W20260709 13:01:23.422876  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 135825us
I20260709 13:01:23.424255  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.417057  1511 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.425585  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.427723  1584 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.429283  7018 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.430081  7086 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.428460  7029 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:23.431133  7029 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:23.431483  7029 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.426944  6827 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:01:23.434725  6796 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.410557  7082 raft_consensus.cc:740] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:23.412137  6825 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.447139  1511 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.447853  6796 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:23.448220  6825 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:23.448287  6796 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:23.449285  6796 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.451165  7078 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:23.451370  1542 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:23.454958  1511 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.455354  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:23.457752  1620 raft_consensus.cc:2410] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:23.442027  1659 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:23.459404  1584 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.461685  1659 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:23.457257  7086 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:01:23.463492  7070 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:23.461684  1584 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.474105  7070 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.474467  7070 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.470350  7078 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:23.472138  7069 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.478657  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:23.479048  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:23.479715  1543 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:23.488276  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:23.489017  1536 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
W20260709 13:01:23.493441  7062 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:01:23.499241  6834 raft_consensus.cc:3055] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:23.499706  6834 raft_consensus.cc:740] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:23.500715  6834 consensus_queue.cc:260] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.502156  6834 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.507505  6867 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:23.510803  6634 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.511432  7019 raft_consensus.cc:3055] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:23.511900  7019 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:23.512856  7019 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:23.522879  7057 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.606s	user 0.008s	sys 0.000s
I20260709 13:01:23.524652  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:23.527468  7069 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.528083  7069 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.530270  7069 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:23.535719  7029 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:23.537667  7060 log.cc:927] Time spent T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.423s	user 0.000s	sys 0.001s
I20260709 13:01:23.538604  6634 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.539052  6634 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.539423  6634 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.467744  7049 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:23.526448  2277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45390 (request call id 1256) took 1155 ms. Trace:
I20260709 13:01:23.481616  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:23.484366  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:23.546763  1538 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:23.538190  7029 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:23.568009  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.574781  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:23.574855  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:23.575315  1685 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:23.575414  1692 raft_consensus.cc:3060] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.577664  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:23.578222  1693 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 10.
W20260709 13:01:23.569783  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 114865us
I20260709 13:01:23.572746  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:23.581903  1541 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:23.583491  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:23.584306  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:23.584407  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.586826  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.587836  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:23.588438  2241 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:23.588493  1537 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.590595  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:23.591158  2273 raft_consensus.cc:3060] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:23.593240  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:23.593348  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:23.544042  2277 rpcz_store.cc:276] 0709 13:01:22.370659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.371226 (+   567us) service_pool.cc:224] Handling call
0709 13:01:22.371540 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.452441 (+ 80901us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:22.452763 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.598413 (+145650us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:22.599164 (+   751us) log.cc:844] Serialized 26 byte log entry
0709 13:01:22.599374 (+   210us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:22.599432 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.600340 (+   908us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.522267 (+921927us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:23.526130 (+  3863us) raft_consensus.cc:1685] finished
0709 13:01:23.526247 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.526384 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80460,"prepare.queue_time_us":2475,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":85302,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"spinlock_wait_cycles":8442624,"thread_start_us":142825,"threads_started":1,"wal-append.queue_time_us":282106}
I20260709 13:01:23.593739  1687 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.593886  1690 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:23.481706  7018 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:23.596184  7046 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:23.596474  7063 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.465s	user 0.000s	sys 0.002s
I20260709 13:01:23.596697  7082 consensus_queue.cc:260] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.597559  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:23.598456  1686 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:23.593743  7095 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.645784  1692 raft_consensus.cc:2468] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 9.
I20260709 13:01:23.603601  2273 raft_consensus.cc:2468] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:23.614068  7079 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:23.614846  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:23.679587  1688 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:23.615789  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:23.616689  7094 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:23.616772  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 155128us
I20260709 13:01:23.681540  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:23.688161  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:23.617219  6749 raft_consensus.cc:493] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.618100  6983 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:23.618541  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.618873  7096 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.619496  6258 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:23.619418  6642 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.621208  7035 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:23.590760  7088 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:23.481050  7078 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:23.626224  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:23.627521  7029 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:23.633379  2268 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 10.
I20260709 13:01:23.636536  1538 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:23.630409  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:23.602304  1687 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:23.595405  1511 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:23.648444  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2879) took 1008 ms. Trace:
I20260709 13:01:23.672729  7018 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:23.618104  6847 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.582581  7086 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:01:23.680585  1689 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:23.693075  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 387942us
W20260709 13:01:23.749104  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 118776us
W20260709 13:01:23.695698  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.722146  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:23.735225  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 116729us
I20260709 13:01:23.738500  1694 rpcz_store.cc:276] 0709 13:01:22.639825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.640063 (+   238us) service_pool.cc:224] Handling call
0709 13:01:22.659300 (+ 19237us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:01:22.687033 (+ 27733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.687062 (+    29us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:01:22.687756 (+   694us) log.cc:844] Serialized 104 byte log entry
0709 13:01:22.933718 (+245962us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:23.198446 (+264728us) log.cc:844] Serialized 14 byte log entry
0709 13:01:23.220079 (+ 21633us) log.cc:844] Serialized 14 byte log entry
0709 13:01:23.236213 (+ 16134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.236856 (+   643us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.496497 (+259641us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b1800050ce0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb8522 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:01:23.537028 (+ 40531us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:23.648245 (+111217us) raft_consensus.cc:1685] finished
0709 13:01:23.648263 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.648397 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119475,"prepare.queue_time_us":515734,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":88,"raft.queue_time_us":312592,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":24849,"spinlock_wait_cycles":63916160,"thread_start_us":501418,"threads_started":3,"wal-append.queue_time_us":346737}
W20260709 13:01:23.755374  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 160048us
I20260709 13:01:23.756345  1511 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:23.677937  7046 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.757903  7018 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.743188  7093 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.748939  6751 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:23.644938  7049 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:01:23.759725  6751 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.760892  6847 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.689183  7079 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.721617  7068 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.736233  7087 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.763906  1537 raft_consensus.cc:2468] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:23.764739  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:23.723181  6983 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.797792  1618 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:23.808578  6053 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.815143  1616 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:23.740864  7083 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.795426  1510 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:23.808897  2241 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:23.826508  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 58495.5us
I20260709 13:01:23.827342  1658 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:23.768137  6746 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:23.765442  6579 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.770035  7082 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:23.767661  7068 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:23.765097  7026 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.766422  6825 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:23.807852  6983 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.867277  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:23.883209  2273 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:23.858613  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:23.879704  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:23.807586  7086 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:23.856108  7065 log.cc:927] Time spent T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.718s	user 0.000s	sys 0.006s
I20260709 13:01:23.735837  6749 raft_consensus.cc:515] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.723966  7094 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.766093  7081 raft_consensus.cc:493] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:23.880793  1689 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:01:23.858810  1685 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 10.
I20260709 13:01:23.885474  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:23.857502  7047 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:23.826432  7035 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
W20260709 13:01:23.906199  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 325301us
I20260709 13:01:23.859164  6746 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:23.886372  7106 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:23.808308  7088 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:01:23.794715  7070 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.881858  7087 raft_consensus.cc:2804] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:23.886583  6796 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:23.931739  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:23.881793  7068 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.899626  7046 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:23.934084  7061 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:01:23.926889  6642 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:23.908907  7086 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.944187  7086 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:23.937708  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:23.902249  7026 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.944844  7086 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:23.945336  7086 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.946758  7026 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:23.921018  6746 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.885725  6827 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:23.929603  6579 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:23.943286  6634 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.940886  7018 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.948616  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 139749us
I20260709 13:01:23.908360  6258 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.885819  7078 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.899928  6946 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:01:23.960104  1690 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:23.927831  7079 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:23.959434  2241 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:23.954919  7107 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:23.984151  7107 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:23.984824  6749 leader_election.cc:290] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:23.985725  6884 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:23.986726  6655 consensus_queue.cc:1059] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:23.987675  7033 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:23.988031  7033 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:23.988809  7033 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.989977  7033 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.964190  6774 consensus_queue.cc:1059] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:01:23.964457  7086 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:23.964694  7019 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:23.969265  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:23.970793  7094 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:23.978257  6847 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:23.858237  7083 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.990365  1659 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:23.993402  1691 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:23.994699  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:23.920821  6825 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:23.955967  7087 raft_consensus.cc:697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:23.920810  7035 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.011598  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:23.956590  6579 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.007067  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:24.008747  1659 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.015254  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.016999  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:23.911927  7081 raft_consensus.cc:515] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.103915  2276 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:01:24.105980  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 89026.8us
I20260709 13:01:24.104214  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.106839  1537 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:01:24.109300  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 102323us
I20260709 13:01:24.002759  6626 raft_consensus.cc:3055] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:24.115424  1614 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:24.019415  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.116317  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.111019  1584 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:24.002138  6884 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:24.118561  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.020714  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:24.117254  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 321835us
W20260709 13:01:24.043843  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.022027  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.116807  1619 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:24.016469  7026 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:23.981956  7018 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.016968  6579 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.979642  6827 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:23.993273  6258 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.126794  1539 raft_consensus.cc:1275] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:01:24.194379  1539 pending_rounds.cc:85] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 11
I20260709 13:01:24.194772  1539 pending_rounds.cc:107] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:01:24.195065  1539 raft_consensus.cc:2889] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.132362  1537 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 18.
W20260709 13:01:24.195919  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 60762.9us
I20260709 13:01:23.999536  7107 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:24.006003  7086 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.011332  6993 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:24.211941  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 50524.9us
I20260709 13:01:24.110917  6995 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:24.104151  6949 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.147634  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:24.149585  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 393283us
I20260709 13:01:24.224848  1511 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.157271  6751 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.157397  1694 raft_consensus.cc:1240] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:24.167627  7029 raft_consensus.cc:2804] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:24.180804  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.135789  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.231135  1619 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:24.115636  6796 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.117926  6626 raft_consensus.cc:740] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
W20260709 13:01:24.208310  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 59839.7us
I20260709 13:01:24.208550  1584 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:24.123942  6749 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:24.019986  6982 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:24.219334  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:24.235019  1690 raft_consensus.cc:2393] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in current term 11: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:24.244122  1618 raft_consensus.cc:3060] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:24.233156  1509 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:24.242257  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.246919  1687 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:01:24.249571  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.268288  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.214879  7096 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:01:24.214777  7086 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:24.281373  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.229760  6949 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:24.301492  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 92996.7us
I20260709 13:01:24.249023  6749 raft_consensus.cc:697] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:24.325354  7026 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:24.327291  1612 raft_consensus.cc:3060] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.240919  6796 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.322000  6634 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:24.295728  6626 consensus_queue.cc:260] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.342422  7083 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:24.343523  7117 log.cc:927] Time spent T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:24.391580  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:24.347381  7108 log.cc:927] Time spent T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:01:24.322228  7070 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:24.348207  7099 log.cc:927] Time spent T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:01:24.334427  7118 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:24.273911  6884 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.295246  7124 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.336699  7116 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:01:24.357869  6258 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.358860  6827 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.360983  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.360477  1612 raft_consensus.cc:2468] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:24.361366  7035 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.361892  7114 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:24.362458  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:24.363662  6970 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:24.219390  7087 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:24.366086  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.367987  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:24.368284  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.438004  2273 raft_consensus.cc:3060] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.337335  7125 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:24.320001  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 86904.3us
W20260709 13:01:24.380782  1429 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82622e43412243cb95bf17b246050060 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5dd1b367d5dd4e6abfd29fc2df2bed07 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:24.383172  6626 raft_consensus.cc:3060] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:24.383701  7081 leader_election.cc:290] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.389812  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.389964  1618 raft_consensus.cc:2468] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 18.
I20260709 13:01:24.390475  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48135c32120406e945bec13a16ae327" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:24.392650  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 179608us
W20260709 13:01:24.396251  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 251589us
I20260709 13:01:24.396559  6983 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:24.413507  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 304405us
I20260709 13:01:24.413408  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:24.395457  6796 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.417061  7118 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.439548  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.439805  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.428056  7116 consensus_queue.cc:1243] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:24.395992  6642 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
W20260709 13:01:24.398089  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 129762us
I20260709 13:01:24.438230  1620 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
W20260709 13:01:24.491556  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 52432us
I20260709 13:01:24.530335  1538 raft_consensus.cc:606] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:24.491482  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 52393.3us
I20260709 13:01:24.545320  1538 raft_consensus.cc:614] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:24.500159  1619 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:24.546765  2268 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:24.471287  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 81805.8us
I20260709 13:01:24.548995  1511 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.437290  6827 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:24.553642  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:24.500051  1429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 131257us
I20260709 13:01:24.549520  7086 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:24.544414  7018 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:24.532717  6746 consensus_meta.cc:287] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.000s
W20260709 13:01:24.510212  7123 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:24.501662  2272 raft_consensus.cc:2393] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 11: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:24.426286  6825 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:24.547919  6949 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:24.594635  6655 consensus_queue.cc:1048] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:24.557071  7137 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:24.596313  7137 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:24.601912  7068 consensus_meta.cc:287] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.669s	user 0.016s	sys 0.001s
I20260709 13:01:24.602145  7095 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:01:24.489903  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 45405.4us
W20260709 13:01:24.443502  1509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.554298  1620 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 10.
I20260709 13:01:24.509377  7090 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:24.560513  1511 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.561964  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.622366  2276 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:24.427531  7124 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.627599  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:24.627668  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:24.628324  1686 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.628829  7124 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:24.629360  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 80823.1us
I20260709 13:01:24.456027  7029 raft_consensus.cc:697] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:24.563156  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.631330  7029 consensus_queue.cc:237] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.633795  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
W20260709 13:01:24.563735  2241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.635823  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.636150  7143 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:24.552062  7082 consensus_meta.cc:287] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.009s
I20260709 13:01:24.636960  7143 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:24.637300  7082 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:24.637670  7082 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:24.637420  7143 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:24.637812  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.638500  7082 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.639531  1617 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:24.639652  7082 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.639808  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:24.640421  1544 raft_consensus.cc:3060] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.567482  1541 raft_consensus.cc:1240] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 15. Current term is 16. Ops: [13.12-15.14]
I20260709 13:01:24.643035  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.643438  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.643596  1612 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:24.644410  6827 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:24.644553  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.645646  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.645418  6827 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.646309  1541 raft_consensus.cc:2393] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 15: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:24.562876  7125 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:24.646584  6983 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:24.569697  7089 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:24.602372  7068 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:24.557631  6834 consensus_meta.cc:287] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 1.055s	user 0.009s	sys 0.009s
I20260709 13:01:24.566350  6746 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:24.685043  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:24.552939  2273 raft_consensus.cc:2468] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:24.685617  1541 raft_consensus.cc:606] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.565538  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.686100  1541 raft_consensus.cc:614] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:24.619004  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.441537  7026 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:24.620781  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.598408  7137 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.624336  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:24.624624  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.691059  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.624902  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.625922  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.621814  7090 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:24.626999  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.636369  1545 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:24.648453  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.626502  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.649034  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:24.649622  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 81094us
I20260709 13:01:24.696138  1585 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:24.697273  1510 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:24.649818  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 89400.7us
I20260709 13:01:24.648996  2276 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.699155  1511 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.649734  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.699589  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:24.654909  7033 consensus_meta.cc:287] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.006s
I20260709 13:01:24.706985  1536 raft_consensus.cc:1275] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:24.660115  1537 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:24.435119  7114 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:24.684552  7019 consensus_meta.cc:287] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.001s
I20260709 13:01:24.664795  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0b1eaf4f774ec3b24c196f0234dff9" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.684654  7069 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:24.688869  2275 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
W20260709 13:01:24.689080  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 123567us
I20260709 13:01:24.715750  2275 pending_rounds.cc:85] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 11
I20260709 13:01:24.690312  2277 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:24.716104  2275 pending_rounds.cc:107] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:01:24.716415  2275 raft_consensus.cc:2889] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.701270  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.490696  6749 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.721674  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.722275  1685 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:24.723213  1584 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:24.705986  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 49888.1us
I20260709 13:01:24.706796  1658 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:24.724233  1584 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.713378  1539 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:24.682168  1689 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:24.713387  2269 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:01:24.713869  1511 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.671571  7125 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:24.556332  7118 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:24.720783  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:24.665997  1544 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:24.724134  1660 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:24.745391  2269 pending_rounds.cc:85] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 11
I20260709 13:01:24.746165  2269 pending_rounds.cc:107] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:01:24.725497  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.702654  7087 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.712960  6970 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.731232  6642 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:24.647713  7095 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.745697  7127 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:24.723611  7069 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:24.712776  7114 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.753254  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.750975  7139 raft_consensus.cc:2804] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:24.758330  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:24.713497  6579 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.756795  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.762158  1660 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.748257  2269 raft_consensus.cc:2889] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.751451  2243 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:24.752449  1658 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:24.750972  7144 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:24.766405  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 52593.5us
I20260709 13:01:24.776579  2241 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.702257  7018 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:24.751107  7035 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:24.747880  7137 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:24.778985  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.779289  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:24.788008  1541 raft_consensus.cc:606] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.788475  1541 raft_consensus.cc:614] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:24.754060  1659 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:24.750873  7143 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:24.789490  1660 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.747254  7136 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:24.757571  7029 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:24.751278  7122 raft_consensus.cc:493] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:24.773525  7125 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:24.789649  1540 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:01:24.795341  2268 pending_rounds.cc:85] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 9
I20260709 13:01:24.795737  2268 pending_rounds.cc:107] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:01:24.795965  2268 raft_consensus.cc:2889] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.796887  1685 raft_consensus.cc:1275] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:24.796890  1538 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:24.798517  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.780635  7127 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:24.786965  6751 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:24.801493  7102 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:24.790017  7035 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.804301  7035 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:24.806107  7140 log.cc:927] Time spent T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.293s	user 0.003s	sys 0.000s
I20260709 13:01:24.783160  7144 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.783529  1511 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.775210  7112 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:24.819200  1511 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.820423  1689 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:01:24.811161  1685 raft_consensus.cc:2410] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:24.813143  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.787434  7139 raft_consensus.cc:697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:24.787770  7137 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.827975  7026 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:24.814597  1690 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:24.828859  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.829483  1691 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:24.830166  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.793185  6626 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:24.791877  7094 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:24.832131  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.811148  7081 raft_consensus.cc:2804] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:24.797925  7143 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:24.845818  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 56403.3us
I20260709 13:01:24.846266  1511 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.850847  1686 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:24.853078  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:24.856154  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:24.856482  1541 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:24.822606  7112 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.857049  1511 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.858572  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:24.823252  7144 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.859721  2276 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:24.791113  7018 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.867187  6774 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:24.836385  6825 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:24.867535  7116 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:24.847215  6626 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.881026  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:24.843209  7137 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.872860  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:24.886200  1660 leader_election.cc:304] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.857654  6258 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.810577  6867 consensus_queue.cc:1048] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:01:24.874565  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.892704  1613 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:24.893402  1584 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:24.893841  1613 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:24.874853  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.873844  1541 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:24.894914  1615 raft_consensus.cc:2368] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18.
I20260709 13:01:24.876032  7107 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:01:24.897156  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:24.887414  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:24.888093  7119 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:24.873483  1618 raft_consensus.cc:1240] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:01:24.898821  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.899240  2276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:40644
W20260709 13:01:24.901046  7155 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:24.873837  7096 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:24.857564  7112 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.846472  7122 raft_consensus.cc:515] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.880079  6774 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.873879  6884 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:24.904673  2276 raft_consensus.cc:606] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.885928  6626 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.910486  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:24.932632  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:24.913154  1614 raft_consensus.cc:2410] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:24.851476  7127 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:01:24.883152  7081 raft_consensus.cc:697] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:24.874082  7141 consensus_queue.cc:1048] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:01:24.916451  1511 leader_election.cc:400] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18.
I20260709 13:01:24.916117  7146 raft_consensus.cc:2804] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:24.913820  6995 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:24.917294  6774 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.919740  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:24.910080  6746 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:24.922772  7095 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:24.925197  7116 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:24.874536  6970 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:01:24.896456  7026 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:24.956795  7114 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.958578  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53120c1adf947fd992e5950edf26301"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:24.959175  1541 raft_consensus.cc:606] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:24.959487  1541 raft_consensus.cc:614] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:24.960988  6579 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.961818  7146 raft_consensus.cc:697] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:24.962373  7118 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:24.964747  7118 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:24.965054  7081 consensus_queue.cc:237] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.943655  6258 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:24.966977  6258 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.967286  6258 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.948087  6995 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.970242  6995 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:24.971603  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:24.972319  1539 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 16: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:24.941236  6982 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:24.979341  7157 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:24.933343  1660 leader_election.cc:304] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:24.907760  7094 raft_consensus.cc:2749] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:24.903942  7119 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:24.938620  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:24.940881  1511 leader_election.cc:403] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:24.910477  7096 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:24.948742  1658 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:24.952528  7156 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.253s	user 0.003s	sys 0.000s
W20260709 13:01:24.979691  7159 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:24.941905  7086 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:01:24.961287  7114 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.875367  7029 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:01:24.994313  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 61074.3us
W20260709 13:01:25.034464  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 118090us
I20260709 13:01:24.935956  7068 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:24.987844  1584 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:25.003930  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
W20260709 13:01:25.029079  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 80395.9us
I20260709 13:01:25.042145  2276 raft_consensus.cc:2393] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:25.042367  1658 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:25.030789  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:25.043418  2270 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:25.044339  6825 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18.
I20260709 13:01:25.044690  7137 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.045476  6579 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.045994  6579 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.033012  7082 raft_consensus.cc:493] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:25.047222  7082 raft_consensus.cc:515] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.047397  7121 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:01:25.048329  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:25.048885  1538 raft_consensus.cc:606] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:25.049100  7082 leader_election.cc:290] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:25.039885  7087 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:25.042287  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 54526.5us
I20260709 13:01:25.052634  6579 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:24.993649  7069 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:25.053220  7136 raft_consensus.cc:2804] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:25.053725  7136 raft_consensus.cc:697] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:25.054612  7136 consensus_queue.cc:237] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.063318  6774 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.064587  1620 raft_consensus.cc:2393] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 14: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:25.065933  6746 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.078608   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:24.963006  7146 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.078828  7122 leader_election.cc:290] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:25.001307  7119 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:25.003331  7096 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.910431  7139 consensus_queue.cc:237] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.087489  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:25.002323  6610 raft_consensus.cc:2749] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:25.096645  2270 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:25.101373  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:25.113205  1618 raft_consensus.cc:2393] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 16: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:25.114140  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:25.101504  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:25.102622  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 49541.3us
I20260709 13:01:25.115422  1584 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:25.116464  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:25.117013  1692 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:25.121448  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:25.100054   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:25.104278  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 62015.9us
I20260709 13:01:25.125190  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:25.125746  1615 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
I20260709 13:01:25.126830  1511 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:25.107689  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:25.126627  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:25.105509  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:25.127679  1615 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:01:25.136624  1692 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:25.137538  1510 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:25.141510  1544 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:25.144074  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:25.106240  7093 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.155136  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:25.146114  1511 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:25.155912  1540 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:25.154991  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:25.157370  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:25.106537  6982 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:25.116614  6519 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:25.166257  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f61c89956d24976b4d464550172cd55" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:25.132110  7141 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:25.171799  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:25.143471  7114 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:25.175834  1509 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:25.144634  7069 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:25.142295  6579 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:25.106869  6746 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:24.961318  7090 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.182010  1509 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:25.165367  7026 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:25.197001  6258 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.200111  2269 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:25.201105  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:25.182843  7068 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:25.180862  7082 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:25.210136  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3b81d89af143c88a2c3179213662ff" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:25.178903  7114 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:25.219394  1616 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:25.206719  7026 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.224483  1585 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:25.230348  7088 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:25.231084  2277 raft_consensus.cc:1240] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:01:25.231386  7147 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:25.231590  6884 raft_consensus.cc:3055] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:25.232010  6884 raft_consensus.cc:740] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:25.232712  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:25.232882  6884 consensus_queue.cc:260] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.234880  6995 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.236078  1688 raft_consensus.cc:2368] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18.
W20260709 13:01:25.241895  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 59914.2us
I20260709 13:01:25.242791  1540 raft_consensus.cc:2468] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:25.237841  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:25.196041  7144 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:25.266984  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.186961  7069 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:25.167964  7093 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.190659  7137 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:25.270577  1584 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:25.279044  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:25.279851  1616 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:25.283463  1538 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:25.228125  7114 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:25.236999  7026 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:25.336265  1537 raft_consensus.cc:1275] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:25.187100  6579 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.266597  7072 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:25.266333  6970 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:25.169868  6982 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.219157  7122 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:01:25.326140  7143 raft_consensus.cc:2804] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:25.340075  6519 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:25.367393  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:25.226522  7107 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.119s
I20260709 13:01:25.271219  7141 consensus_queue.cc:1059] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:01:25.340504  6642 consensus_queue.cc:1059] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:01:25.381543  7122 consensus_queue.cc:1243] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Peer 0cccd9c43f9747529680a8e7463961c9 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:25.360334  7081 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:01:25.393085  7143 raft_consensus.cc:697] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:25.422909  7069 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.424459  6774 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:25.462996  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:25.467126  1613 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:25.459311  6995 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:25.454602  7144 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:25.462760  6746 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:25.462162  6982 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:25.461625  7093 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:25.482070  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:25.482729  1614 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:25.483045  6746 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:01:25.483827  7112 consensus_meta.cc:287] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.002s
W20260709 13:01:25.460970  7166 log.cc:927] Time spent T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:01:25.462242  7164 log.cc:927] Time spent T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:01:25.462617  7163 log.cc:927] Time spent T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:01:25.456236  7118 raft_consensus.cc:3055] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:25.461807  6579 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:25.503199  7143 consensus_queue.cc:237] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.571308  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:25.491832  6626 consensus_meta.cc:287] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260709 13:01:25.501225  7118 raft_consensus.cc:740] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
W20260709 13:01:25.575225  7177 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:25.492990  6746 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.612641  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:25.617408  1613 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:01:25.500504  7112 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.619848  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:25.620327  1613 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:25.604127  6626 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:25.618515  7170 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:01:25.566166  6519 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.643708  7026 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.645212  7134 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:25.624954  7181 log.cc:927] Time spent T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:01:25.631013  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:25.645738  7134 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:25.647331  7119 consensus_meta.cc:287] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
I20260709 13:01:25.647711  7119 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.647729  7134 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:25.649664  7119 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:25.633092  7112 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:25.634022  1693 raft_consensus.cc:1240] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:25.634773  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:25.639037  7118 consensus_queue.cc:260] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:25.642032  7096 consensus_meta.cc:287] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.000s
I20260709 13:01:25.658123  7096 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.659381  1689 raft_consensus.cc:1240] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:25.642571  7169 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:01:25.649664  7026 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:25.663314  6796 raft_consensus.cc:993] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: : Instructing follower e2a2b76c98ee44ff95e6508c34da0e3d to start an election
I20260709 13:01:25.663866  6796 raft_consensus.cc:1081] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Signalling peer e2a2b76c98ee44ff95e6508c34da0e3d to start an election
W20260709 13:01:25.643102  7171 log.cc:927] Time spent T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:01:25.656800  7114 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.666164  7114 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:25.622164  7172 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:01:25.667976  1612 raft_consensus.cc:1240] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:25.668057  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:25.699113  1613 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 18.
I20260709 13:01:25.702508  1660 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:25.711159  6746 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:25.712800  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:25.713491  1613 raft_consensus.cc:2393] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 15: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:25.726862  1616 raft_consensus.cc:2468] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
I20260709 13:01:25.728248  1660 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:25.708747  7112 raft_consensus.cc:2804] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:25.734741  7018 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:25.737458  6626 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:25.730538  7173 raft_consensus.cc:2804] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:25.740317  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:25.741097  1616 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:25.731235  7112 raft_consensus.cc:697] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
W20260709 13:01:25.748632  7165 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:01:25.740317  7018 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:25.752094  7018 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.754251  7018 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:25.755095  7112 consensus_queue.cc:237] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:25.743932  7173 raft_consensus.cc:697] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:25.764901  7173 consensus_queue.cc:237] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.767740  2275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45402 (request call id 1353) took 1013 ms. Trace:
I20260709 13:01:25.768142  2275 rpcz_store.cc:276] 0709 13:01:24.756879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.757026 (+   147us) service_pool.cc:224] Handling call
0709 13:01:24.757321 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.757949 (+   628us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:24.757978 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.758428 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.113284 (+354856us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:25.113320 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.113378 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.748078 (+634700us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:25.767460 (+ 19382us) raft_consensus.cc:1685] finished
0709 13:01:25.767485 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.767683 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268,"raft.queue_time_us":1254,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":8625,"spinlock_wait_cycles":34290944,"thread_start_us":354518,"threads_started":1,"wal-append.queue_time_us":576103}
I20260709 13:01:25.773432  6258 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:25.776934  7174 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:01:25.781031  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:25.781563  2276 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:25.781961  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:25.782744  2277 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:25.786753  7096 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:25.788290  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:25.792210  7072 consensus_queue.cc:1059] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:25.793200  7072 consensus_queue.cc:1243] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Peer e12d7b3551014757ba7dda3e83605b83 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:01:25.794970  2277 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:25.796234  6655 raft_consensus.cc:993] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 13:01:25.801193  2276 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:01:25.811704  7180 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:01:25.798869  7088 raft_consensus.cc:1081] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 13:01:25.819480  1616 raft_consensus.cc:2468] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:25.823354  1544 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:01:25.827766  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:25.834373  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:25.834975  1539 raft_consensus.cc:3060] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:25.843344  2243 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:25.823843  1544 pending_rounds.cc:85] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 9
I20260709 13:01:25.844327  1544 pending_rounds.cc:107] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:25.844653  1544 raft_consensus.cc:2889] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:25.846047  1616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:43404
I20260709 13:01:25.846663  1616 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.847031  1616 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:25.851198  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:25.851967  1540 raft_consensus.cc:2368] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 15. Current term is 16.
I20260709 13:01:25.857280  1688 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:01:25.860162  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.862217  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:25.873729  1539 raft_consensus.cc:2468] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 18.
I20260709 13:01:25.850019  7183 raft_consensus.cc:2804] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:25.876842  1616 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.857884  7096 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:25.892056  1616 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:25.899716  6834 raft_consensus.cc:3055] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:25.904295  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:25.888968  7183 raft_consensus.cc:697] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:25.904840  2277 raft_consensus.cc:3055] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:25.907033  2277 raft_consensus.cc:740] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:25.900101  6834 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:25.913256  7183 consensus_queue.cc:237] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:25.917315  1429 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82622e43412243cb95bf17b246050060 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5dd1b367d5dd4e6abfd29fc2df2bed07 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:25.919345  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:25.923115  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:25.924664  1688 raft_consensus.cc:1240] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:25.929270  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:25.931699  1536 raft_consensus.cc:2410] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:01:25.931849  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:25.930778  2277 consensus_queue.cc:260] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.932571  1692 raft_consensus.cc:2410] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:01:25.932781  2277 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:25.935231  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:25.936801  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:25.936923  6834 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:25.939785  1543 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:25.975366  6655 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.983543  7033 consensus_queue.cc:1059] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:01:26.027973  7090 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:25.992987  6655 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.032873  6655 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:26.033484  7192 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.121s	user 0.003s	sys 0.000s
I20260709 13:01:26.030119  2277 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:26.057909  6884 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:26.069809  1658 leader_election.cc:400] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 15. Current term is 16.
I20260709 13:01:26.070272  1658 leader_election.cc:403] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:26.071727  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.074026  7118 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.081256  6867 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:26.081794  6867 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:26.082556  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 86133.2us
I20260709 13:01:26.083786  7112 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.084263  7112 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:26.085808  7124 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:01:26.088958  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.090322  7049 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:26.095707  1658 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:26.096262  7173 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:26.106895  1616 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:26.086339  7124 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:26.116493  1545 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:26.136154  7094 consensus_queue.cc:1059] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:26.138120  6931 raft_consensus.cc:3055] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:26.138613  6931 raft_consensus.cc:740] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:26.138840  7112 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:26.139950  6931 consensus_queue.cc:260] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.123581  6519 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:26.143988  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:26.145812  6993 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:26.148138  6867 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:26.148280  6931 raft_consensus.cc:3060] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.148648  7139 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:01:26.151419  7113 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:26.151909  7113 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:26.143829  7173 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 15. Current term is 16.
I20260709 13:01:26.154455  7113 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:26.156500  7124 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.158363  7124 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:26.165719  2243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.191613  1585 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:26.192801  7122 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:26.193454  7122 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:26.194475  7122 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.206192  7127 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.206869  7127 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:26.211128  7127 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:26.216850  2273 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:26.219810  7113 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:26.220324  7113 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:26.222215  7113 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:26.226564  2273 raft_consensus.cc:3055] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:26.227126  2273 raft_consensus.cc:740] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:26.226562  6642 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:26.226990  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:26.228396  2273 consensus_queue.cc:260] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.229660  1614 raft_consensus.cc:2410] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:26.229820  2273 raft_consensus.cc:3060] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.237499  2273 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:01:26.244020  2273 pending_rounds.cc:85] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting all ops after (but not including) 10
I20260709 13:01:26.249022  2275 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:26.254508  2273 pending_rounds.cc:107] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:01:26.255885  2273 raft_consensus.cc:2889] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:26.257062  7113 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:26.261709  6655 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:26.262395  6655 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.264856  6655 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:26.253158  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:26.265862  1545 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
W20260709 13:01:26.267870  7189 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.560s	user 0.001s	sys 0.000s
I20260709 13:01:26.270750  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:26.270946  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:26.271365  1690 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:26.272100  1511 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:26.272594  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:26.273367  7116 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:26.273766  7116 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:26.274016  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:26.274395  6825 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:26.274567  1690 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:26.274999  6825 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.274103  7116 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.274587  7026 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:26.276989  6825 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:26.277118  7026 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:26.275323  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52958 (request call id 2892) took 1229 ms. Trace:
I20260709 13:01:26.278149  7026 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.278324  1693 rpcz_store.cc:276] 0709 13:01:25.045512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.050480 (+  4968us) service_pool.cc:224] Handling call
0709 13:01:25.050771 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.651231 (+600460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.275132 (+623901us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54002e4ad4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda5e01 00007f29ebda483e 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6
0709 13:01:26.275271 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340757376}
I20260709 13:01:26.281976  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:26.282601  1584 leader_election.cc:304] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.283712  1584 leader_election.cc:304] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.286626  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57234 (request call id 1095) took 1078 ms. Trace:
I20260709 13:01:26.287029  1538 rpcz_store.cc:276] 0709 13:01:25.208070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.210274 (+  2204us) service_pool.cc:224] Handling call
0709 13:01:25.270044 (+ 59770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.325846 (+ 55802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.286459 (+960613us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b54001b6f50. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda48ad 00007f29f0d69419 00007f29ea2e0bd4 00007f29ea2e0b62 00007f29ea2e0a91 00007f29ea2e0a0c 00007f29ea2dfcc2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:26.286577 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97365248}
I20260709 13:01:26.295028  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53910 (request call id 2887) took 1419 ms. Trace:
I20260709 13:01:26.295368  1620 rpcz_store.cc:276] 0709 13:01:24.875560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.887189 (+ 11629us) service_pool.cc:224] Handling call
0709 13:01:26.294840 (+1407651us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54000e1354. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:26.294962 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382606720}
I20260709 13:01:26.296356  1611 raft_consensus.cc:1240] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Rejecting Update request from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:26.304939  6834 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.286036   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:26.321225  7078 raft_consensus.cc:2749] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:26.321945  7078 raft_consensus.cc:2749] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:26.332079  7127 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:26.333393  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.334285  6642 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:26.335913  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:26.336498  1611 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:26.337447  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:26.338102  1620 raft_consensus.cc:2368] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18.
W20260709 13:01:26.341391  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 354639us
I20260709 13:01:26.348058  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:26.343321  2241 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.352293  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:26.353281  1690 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
W20260709 13:01:26.357020  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 85038.1us
I20260709 13:01:26.358170  1511 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:26.358268  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:26.360110  1543 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:26.360585  1694 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:26.360730  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:26.364172  7113 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:26.360750  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:26.365760  1539 raft_consensus.cc:1275] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:26.367574  1511 leader_election.cc:400] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18.
I20260709 13:01:26.368063  1511 leader_election.cc:403] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:01:26.368788  7113 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18.
I20260709 13:01:26.363232  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:26.370801  7183 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.372153  1544 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:26.363503  1509 leader_election.cc:400] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18.
I20260709 13:01:26.360987  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:26.373214  1693 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:26.375715  1689 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 16.
I20260709 13:01:26.379242  6746 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:26.380514  1620 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:26.382125  1620 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:01:26.383661  2240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.389822  6825 consensus_queue.cc:1059] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:26.390991  6825 consensus_queue.cc:1059] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:26.392061  1658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.392549  6825 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:26.393146  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:26.393342  7113 raft_consensus.cc:3055] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:26.393817  1689 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:26.394098  7113 raft_consensus.cc:740] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:26.393117  6825 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:26.395432  7113 consensus_queue.cc:260] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:26.395748  6825 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:26.397111  6825 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.397184  7113 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.401826  6746 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:26.402593  6746 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:26.405616  6746 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:26.409201  1694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:52958
I20260709 13:01:26.409746  1694 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:26.410075  1694 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:26.410707  1693 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
W20260709 13:01:26.415169  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 71925.8us
I20260709 13:01:26.416514  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.417487  1694 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.420038  1694 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:26.417840  6655 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:26.418992  2241 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.422731  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:26.424612  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 57220.2us
I20260709 13:01:26.425414  1687 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:26.445829  1509 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:26.390600  7116 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.434484  1541 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:01:26.448128  7215 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:26.448890  7116 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:26.423890  6655 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.450011  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:26.450945  2276 raft_consensus.cc:2393] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 14: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:26.453138  7127 consensus_queue.cc:1048] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:26.455509  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 99961.4us
I20260709 13:01:26.458745  1614 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:01:26.459111  1614 pending_rounds.cc:85] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Aborting all ops after (but not including) 8
I20260709 13:01:26.459355  1614 pending_rounds.cc:107] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: Aborting uncommitted NO_OP operation due to leader change: 14.9
W20260709 13:01:26.436920  7208 log.cc:927] Time spent T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:01:26.463466  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:26.472731  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 49218.4us
I20260709 13:01:26.472816  1438 catalog_manager.cc:5697] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 15 to 16, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.439265  1690 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:26.443367  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:26.477089  1686 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:26.444411  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:26.445472  7214 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:26.479880  1611 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 16.
I20260709 13:01:26.475381  1438 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 10 to 14, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.473826  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:26.459641  1614 raft_consensus.cc:2889] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:26.490996  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:26.491657  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:26.498410  7180 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:26.498117  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 353) took 12641 ms (client timeout 15000 ms). Trace:
I20260709 13:01:26.516180  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:26.516651  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:26.517167  7121 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:26.517560  2269 raft_consensus.cc:3060] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.499655  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.502776  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:26.503891  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:26.504513  2272 raft_consensus.cc:1240] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:26.504881  2275 raft_consensus.cc:1275] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:26.505443  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:26.506975  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:26.525058  2268 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:26.508482  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:26.517195  2274 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:26.531452  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:26.532984  2269 raft_consensus.cc:1275] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:26.536839  1545 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:26.537257  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:26.513325  1441 rpcz_store.cc:269] 0709 13:01:13.856326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.856584 (+   258us) service_pool.cc:224] Handling call
0709 13:01:26.498049 (+12641465us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:23.929149 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:23.984350 (+ 55201us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:23.984385 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:01:23.984402 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:23.986136 (+  1734us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:23.986239 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:23.986270 (+    31us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:01:24.386786 (+400516us) tablet.cc:701] Row locks acquired
0709 13:01:24.386811 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:01:24.386976 (+   165us) write_op.cc:270] Start()
0709 13:01:24.387137 (+   161us) write_op.cc:276] Timestamp: P: 1783602084386909 usec, L: 0
0709 13:01:24.387162 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:01:24.387790 (+   628us) log.cc:844] Serialized 9071 byte log entry
0709 13:01:24.698359 (+310569us) op_driver.cc:464] REPLICATION: finished
0709 13:01:25.131041 (+432682us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b1800330ee0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:01:25.141484 (+ 10443us) write_op.cc:301] APPLY: starting
0709 13:01:25.154319 (+ 12835us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:25.232170 (+ 77851us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:25.232198 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:25.713554 (+481356us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:25.713928 (+   374us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:01:25.713976 (+    48us) write_op.cc:312] APPLY: finished
0709 13:01:25.714426 (+   450us) log.cc:844] Serialized 204 byte log entry
0709 13:01:25.750106 (+ 35680us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.769720 (+ 19614us) write_op.cc:454] Released schema lock
0709 13:01:25.798957 (+ 29237us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:25.808520 (+  9563us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.809643 (+  1123us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1082676,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":188967,"apply.run_cpu_time_us":41426,"apply.run_wall_time_us":673382,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100129,"num_ops":23,"prepare.queue_time_us":365698,"prepare.run_cpu_time_us":50605,"prepare.run_wall_time_us":744347,"raft.queue_time_us":3096,"raft.run_cpu_time_us":22028,"raft.run_wall_time_us":182082,"replication_time_us":310995,"spinlock_wait_cycles":21906816,"thread_start_us":695003,"threads_started":5,"wal-append.queue_time_us":400620,"wal-append.run_cpu_time_us":3713,"wal-append.run_wall_time_us":1008929}]]}
I20260709 13:01:26.552032  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:26.552785  1539 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:26.553133  1539 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:26.554909  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.551950  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:26.562078  2268 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 18.
I20260709 13:01:26.562841  2277 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:26.566273  1659 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:26.538374  7121 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:26.573484  1539 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.579936  1539 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:26.567724  7127 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.566781  7139 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.572603  7094 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:26.591411  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:26.588699  1511 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:26.593042  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:26.582983  7215 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 16 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:26.569823  7122 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:01:26.587575  6931 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:26.615702  6931 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:26.599671  6825 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:26.626044  1539 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 18.
I20260709 13:01:26.627490  1614 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:26.577299  7182 consensus_queue.cc:1048] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:01:26.594609  7094 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:26.575191  6519 consensus_queue.cc:1048] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:01:26.582979  7138 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:01:26.586905  7121 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:01:26.603233  7143 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:26.594882  7173 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:01:26.644476  7143 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.658776  6749 consensus_queue.cc:1048] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:01:26.659723  7215 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:26.660862  1438 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:26.634966  7094 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.616556  7221 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:01:26.690115  7143 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:26.692477  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 108368us
W20260709 13:01:26.694157  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 127939us
I20260709 13:01:26.717890  1509 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:26.694360  7222 log.cc:927] Time spent T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:26.725189  1509 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.736045  1659 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:26.735646  7113 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:26.738696  6519 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:26.739213  6519 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.741088  6519 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:26.741544  6519 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.634465  6931 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.753211  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:26.772878  6995 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:26.773447  6995 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:26.774271  6995 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.735903  6825 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:26.791323  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 224902us
I20260709 13:01:26.793888  1658 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:26.795789  6825 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:26.807256  6825 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:26.811764  7095 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:26.812440  7095 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.815383  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:26.743322  1438 catalog_manager.cc:5697] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 8 to 12, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:26.819371  1438 catalog_manager.cc:5697] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 10 to 11, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:26.829454  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 257221us
W20260709 13:01:26.830658  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 235786us
I20260709 13:01:26.831749  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:26.832154  1614 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:26.732571  7220 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:01:26.842549  1614 raft_consensus.cc:1275] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:26.843791  1620 raft_consensus.cc:1275] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:01:26.837338  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 43526.3us
W20260709 13:01:26.870090  2242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.872203  1614 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:26.877099  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:26.821813  1438 catalog_manager.cc:5697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 3 to 10, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.741978  6519 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.863199  7119 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:26.862825  7078 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.869539  7113 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:26.806596  7094 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:26.883086  7095 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:26.884903  7138 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:01:26.899612  7183 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:01:26.898747  7026 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:26.927556  1438 catalog_manager.cc:5697] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 10 to 15, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:26.929327  1438 catalog_manager.cc:5697] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:26.934273  7094 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:26.938076  1438 catalog_manager.cc:5697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 6 to 9, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.939239  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.920472  7227 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:01:26.964147  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:26.944741  6825 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:26.945748  6519 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:26.905872  7078 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:26.987437  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:26.973202  7209 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:26.983745  7183 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:27.001472  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:26.963063  7143 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:27.010579  6825 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:27.019127  1438 catalog_manager.cc:5697] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 6 to 10, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:27.023579  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:27.034978  2269 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:27.056233  1620 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:01:27.063581  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 53858.2us
I20260709 13:01:27.069527  1659 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
W20260709 13:01:27.070850  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 187469us
I20260709 13:01:27.081823  7227 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:27.021338  1438 catalog_manager.cc:5697] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:27.109908  7227 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:27.093007  7228 consensus_queue.cc:1048] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:01:27.106622  7112 consensus_queue.cc:1048] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 13:01:27.150162  7237 log.cc:927] Time spent T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:27.169669  7143 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:27.170310  7143 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:27.170943  7143 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.173228  1686 raft_consensus.cc:1275] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:01:27.174923  1429 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82622e43412243cb95bf17b246050060 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5dd1b367d5dd4e6abfd29fc2df2bed07 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:27.179045  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:27.187320  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:27.194651  7242 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.194844  7227 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.195252  7242 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.197429  7242 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:27.199245  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:27.200848  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:27.201496  1539 raft_consensus.cc:2393] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 11: Already voted for candidate 0cccd9c43f9747529680a8e7463961c9 in this term.
I20260709 13:01:27.202427  1658 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:27.224941  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:27.226650  1612 raft_consensus.cc:2410] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:27.228040  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:27.234727  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:27.206854  7220 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.269452  2277 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:27.280256  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:27.285487  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 50847.7us
I20260709 13:01:27.285634  6258 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:27.249691  7138 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:27.291054  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:27.272893  7143 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:27.274785  7118 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:27.247996  7231 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.268771  7220 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.336308  2269 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:27.336844  1509 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:27.295684  6834 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:27.369815  1658 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:27.368238  7254 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:27.378182  6749 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:27.391294  7248 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:01:27.434456  1613 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.435396  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:27.436269  2268 raft_consensus.cc:2393] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 15: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:27.430315  7220 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:27.221606  1438 catalog_manager.cc:5697] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 10 to 13, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:27.337580  7118 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:27.444314  7232 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:01:27.455159  7236 log.cc:927] Time spent T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.360s	user 0.003s	sys 0.000s
I20260709 13:01:27.457103  1438 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:27.458752  1438 catalog_manager.cc:5697] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:27.445709  7147 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:01:27.471136  1613 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:27.444337  7116 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:27.460929  1438 catalog_manager.cc:5697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:27.365319  7231 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.478829  7116 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:27.493624  7250 log.cc:927] Time spent T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:01:27.493896  7116 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:27.461107  7139 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:01:27.536276  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 83725.9us
I20260709 13:01:27.538729  2273 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:27.539007   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:27.542687  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:27.543287  2273 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:27.544204  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:27.546375  7113 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:27.547341  7113 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.554033  7266 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:27.554634  7266 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.560573  7266 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:27.571870  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:27.570863  7232 log.cc:927] Time spent T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:27.503216  7139 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:27.598892  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 152084us
I20260709 13:01:27.607234  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:27.608539  6258 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:27.612676  2241 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:27.614432  6626 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:27.615928  1510 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:27.616969  7267 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:27.618523  7267 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:27.618923  7267 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.619247  7267 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:27.622826  7116 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:27.623639  7116 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:27.623929  7116 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:27.624711  7116 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:27.625849  7116 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:27.627667  1689 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:27.628268  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:27.636885  7231 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:27.640084  7118 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:27.645776  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:27.648203  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:27.648576  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:27.649326  1690 raft_consensus.cc:2393] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:27.651396  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:27.660192  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:27.660775  2270 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:27.653231  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:27.664915  1585 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:27.669720  1694 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:27.674744  7078 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:27.690856  1584 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:27.734858  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.741595  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 47922.2us
I20260709 13:01:27.683924  7143 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:27.661928  7147 consensus_queue.cc:1048] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:27.663502  7267 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.738162  7221 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.728438  7078 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:27.758549  7143 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:27.790226  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 60196.5us
I20260709 13:01:27.764258  7234 raft_consensus.cc:493] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.794637  1511 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:27.695443  7274 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 13:01:27.802261  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:27.796309  7143 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:27.798261  7227 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.797529  7266 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:27.830538  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:27.838378  7255 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.449s	user 0.000s	sys 0.007s
I20260709 13:01:27.830334  7227 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:27.791852  7221 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:27.802052  7234 raft_consensus.cc:515] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.875730  1690 raft_consensus.cc:1275] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:01:27.876194  1690 pending_rounds.cc:85] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 8
I20260709 13:01:27.876469  1690 pending_rounds.cc:107] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:01:27.876847  1690 raft_consensus.cc:2889] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:27.878647  7227 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:27.879747  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:27.880535  1545 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 14.
W20260709 13:01:27.881307  7273 log.cc:927] Time spent T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:01:27.882031  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:27.888136  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:27.871912  7263 log.cc:927] Time spent T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:01:27.867297  7266 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:27.885452  7227 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:27.895077  7227 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.895426  7227 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.898972  7266 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:27.901031  7266 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:27.904299  7221 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:27.906739  7267 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:27.907770  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:27.909627  1539 raft_consensus.cc:1240] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e12d7b3551014757ba7dda3e83605b83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:27.910614  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:27.914574  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:27.917752  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:27.918768  1543 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:27.870558  7139 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:27.925688  1510 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:27.926703  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:27.927482  1619 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:27.942390  1694 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:27.943341  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:27.945297  2275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a99308299b4d05a3b45157d06ba9bd" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:27.948514  1694 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:27.951823  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:27.952333  2270 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:27.959676  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:27.963006  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:27.970947  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:27.933431  6774 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:01:28.002614  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 47023.9us
I20260709 13:01:27.950194  7256 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:28.045912  2270 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:28.037423  7078 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:28.019345  6774 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.052175  6626 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:01:28.074793  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 134325us
I20260709 13:01:28.049012  7234 leader_election.cc:290] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:28.081555  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 155938us
W20260709 13:01:28.120793  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 182910us
I20260709 13:01:28.067186  7267 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:01:28.128183  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 176773us
I20260709 13:01:28.079713  7078 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.140241  1510 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:28.122903  6626 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.189911  6746 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:28.235960  7287 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:01:28.236176  7116 consensus_meta.cc:287] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.001s
I20260709 13:01:28.237041  1545 raft_consensus.cc:2410] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:01:28.237279  7238 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.149s	user 0.000s	sys 0.010s
I20260709 13:01:28.247479  6258 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:28.250090  7173 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.258093  7173 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.260645  7173 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.215641  6746 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:28.252281  7245 log.cc:927] Time spent T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 1.129s	user 0.003s	sys 0.005s
W20260709 13:01:28.455482  7292 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:01:28.457773  6774 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.475471  7241 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.483312  7301 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:28.493882  7143 consensus_meta.cc:287] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: Time spent flushing consensus metadata: real 0.664s	user 0.003s	sys 0.006s
I20260709 13:01:28.491384  7283 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:28.525578  7227 consensus_meta.cc:287] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.003s
W20260709 13:01:28.554853  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 75845.1us
I20260709 13:01:28.526463  7078 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.548660  7143 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:28.567579  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 468128us
I20260709 13:01:28.546398  6993 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:28.570806  1615 raft_consensus.cc:2368] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14.
I20260709 13:01:28.556196  6626 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.523658  7241 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.557235  7183 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
W20260709 13:01:28.577591  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 384756us
I20260709 13:01:28.559790  7227 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.579823  7241 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.580466  1693 raft_consensus.cc:2393] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cccd9c43f9747529680a8e7463961c9 in current term 15: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:28.581408  7227 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:28.579309  7143 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.592490  6626 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.593271  6982 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.601084  2268 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:28.555634  7283 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.602674  2276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:28.603729  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f35127b66604c1685f1fbe404840774" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:28.544898  7301 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.612661  2276 raft_consensus.cc:2393] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 13: Already voted for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in this term.
I20260709 13:01:28.573097  6993 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.614919  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:28.610548  7308 log.cc:927] Time spent T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:01:28.622816  1659 leader_election.cc:304] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:28.578437  7183 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.625224  6746 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:28.614540  6626 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.628748  7119 raft_consensus.cc:2749] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.618963  6610 consensus_queue.cc:1059] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:01:28.616956  6982 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.638350  6982 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.636150  6610 raft_consensus.cc:3055] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:28.639243  6610 raft_consensus.cc:740] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:28.640221  6993 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:28.640048  6610 consensus_queue.cc:260] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.641367  6610 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.643391  7301 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.644552  7283 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.649771  2272 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:28.653414  6626 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.656448  7183 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.658210  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:28.665509  7183 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.666141  7183 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.666482  7119 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.668859  1584 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:28.680787  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:28.682037  7319 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:28.682566  7319 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:28.683029  7319 raft_consensus.cc:3060] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.687481  7112 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:28.687951  7112 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.689829  7112 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.691413  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:28.697340  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:28.697912  1620 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:28.695823  7283 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:28.699779  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:28.702710  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:28.703495  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.707562  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:28.681394  7143 consensus_queue.cc:1059] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:28.681269  7306 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:01:28.695755  7119 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.722244  1620 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
I20260709 13:01:28.736749  7183 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.709477  7284 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:28.706805  6610 raft_consensus.cc:493] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:28.743503  1616 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 16: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
I20260709 13:01:28.703029  7319 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.765226  7143 raft_consensus.cc:3055] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:28.781904  7298 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.577s	user 0.001s	sys 0.000s
W20260709 13:01:28.796371  7322 log.cc:927] Time spent T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:01:28.799394  7119 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:28.801515  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:28.801942  7324 log.cc:927] Time spent T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:28.803194  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:28.743541  6610 raft_consensus.cc:515] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.811297  7284 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.834478  7284 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.836486  7284 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.812573  7143 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:28.837450  7143 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.838554  7143 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.839360  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53894 (request call id 2586) took 1010 ms. Trace:
I20260709 13:01:28.839846  1615 rpcz_store.cc:276] 0709 13:01:27.829177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.830078 (+   901us) service_pool.cc:224] Handling call
0709 13:01:28.839125 (+1009047us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54000578d4. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebda92fa 00007f29f0d6ab17 00007f29ea2e56d4 00007f29ea2e5662 00007f29ea2e5591 00007f29ea2e550c 00007f29ea2e47c2 00007f29ea0e048c 00007f29ea0df8c6 00007f29ea0df26f
0709 13:01:28.839293 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699111296}
I20260709 13:01:28.832125  7319 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.873713  2277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:28.833952  1616 raft_consensus.cc:2410] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:28.859113  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c330c505ed4e4efda5c94a1811c68633" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:28.880754  7312 log.cc:927] Time spent T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
I20260709 13:01:28.884557  7290 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:28.885933  7290 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:28.887068  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 746763us
I20260709 13:01:28.887589  1660 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:28.889724  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:28.889735  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:28.891572  2269 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:28.862828  6610 leader_election.cc:290] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.884747  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:28.863561  7285 log.cc:927] Time spent T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.659s	user 0.002s	sys 0.000s
I20260709 13:01:28.893564  2272 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:28.897629  1691 raft_consensus.cc:2368] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15.
I20260709 13:01:28.899397  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:28.900029  1690 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:28.903221  7049 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:28.907923  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:28.908438  7289 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:28.908663  6995 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:28.909309  6995 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:28.909912  7291 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.910470  7295 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.910323  6995 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.910988  7295 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.911427  7116 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.911918  7116 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.913218  7295 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.913717  7295 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:28.914886  7315 raft_consensus.cc:493] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.908988  7289 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.915385  7315 raft_consensus.cc:515] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.916049  7256 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.916858  7289 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.917395  7315 leader_election.cc:290] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.918025  7316 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.918509  7316 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.919673  7220 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.919711  6825 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.920342  7220 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.916554  7256 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.921054  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:28.922212  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:28.922364  7220 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.910039  7267 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:28.938323  7267 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.940352  7267 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.914217  7295 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:28.922515  7256 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.923369  1585 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:28.923892  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:28.923942  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:28.948776  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:28.924644  7116 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.924930  1539 raft_consensus.cc:1240] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:28.926218  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:28.926548  1509 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:28.920415  6825 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:28.928005  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:28.966243  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:28.966439  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:28.949693  1541 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:28.929458  1616 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:28.930076  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:28.930787  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:28.931033  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:28.930620  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38026 (request call id 2617) took 1721 ms. Trace:
I20260709 13:01:28.931401  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:28.932487  7316 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.936245  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:28.918697  1660 leader_election.cc:400] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14.
I20260709 13:01:28.918637  7113 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:28.976974  7113 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:28.977473  7295 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:28.979135  7113 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.970382  1536 rpcz_store.cc:276] 0709 13:01:27.208797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.209429 (+   632us) service_pool.cc:224] Handling call
0709 13:01:27.209684 (+   255us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:27.210038 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.210073 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:27.224053 (+ 13980us) log.cc:844] Serialized 52 byte log entry
0709 13:01:27.642694 (+418641us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b1800218380. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8c9ae07 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29eb93f20b 00007f29eb944d23 00007f29eb9450d1 00007f29ebd60a0f
0709 13:01:28.042216 (+399522us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:28.042264 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.042333 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.862903 (+820570us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29eb94086e 00007f29eb93fbb6 00007f29eb93f7d8 00007f29eb949221 00007f29eb9491d9 00007f29eb949169
0709 13:01:28.930443 (+ 67540us) raft_consensus.cc:1685] finished
0709 13:01:28.930461 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.930574 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":907,"raft.queue_time_us":13269,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":14452,"spinlock_wait_cycles":6333184,"thread_start_us":358368,"threads_started":1,"wal-append.queue_time_us":890425}
I20260709 13:01:28.951743  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:28.981390  1693 raft_consensus.cc:2393] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 13: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:28.983018  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:28.983716  7310 consensus_queue.cc:1048] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:28.986141  1536 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:28.972810  1660 leader_election.cc:403] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.975287  6825 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:28.979166  7220 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:28.989087  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 70534us
I20260709 13:01:28.963145  2269 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
I20260709 13:01:28.992070  1660 leader_election.cc:304] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:28.994961  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:28.998660  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:28.999303  1537 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
W20260709 13:01:29.001943  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 78629.6us
W20260709 13:01:29.002931  1429 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82622e43412243cb95bf17b246050060 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5dd1b367d5dd4e6abfd29fc2df2bed07 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:29.003047  1585 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
W20260709 13:01:29.018652  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 63585.3us
I20260709 13:01:29.020612  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:29.045668  1540 raft_consensus.cc:2468] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
I20260709 13:01:29.047502  1690 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
W20260709 13:01:29.052049  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 60033.3us
I20260709 13:01:29.057739  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.058060  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.059983  1658 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:29.066723  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 46158.1us
I20260709 13:01:29.036585  7274 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:29.070772  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1532fbff9860493fa0fbdf5eb1b21242" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.038035  7300 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:29.051097  6749 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) with higher term. Message: Invalid argument: T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 13. Current term is 14.
I20260709 13:01:29.078326  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:29.075620  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:29.054515  7234 raft_consensus.cc:493] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:29.083348  1584 leader_election.cc:400] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447) with higher term. Message: Invalid argument: T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15.
I20260709 13:01:29.066102  7094 raft_consensus.cc:2749] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:29.092754  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.093238  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.093238  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:29.099089  2269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:40644
I20260709 13:01:29.099649  2269 raft_consensus.cc:606] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:29.099939  2269 raft_consensus.cc:614] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:29.100118  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.100759  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.070086  7113 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:29.074222  7143 raft_consensus.cc:2764] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:29.077135  7300 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.104008  1658 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:29.108096  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.112239  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.115360  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:29.116215  1541 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 18.
W20260709 13:01:29.120178  7327 log.cc:927] Time spent T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:29.122056  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:29.124311  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:29.124583  1510 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.125300  7295 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:29.125809  7295 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:29.072706  6825 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:01:29.127007  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.129016  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:29.101514  7274 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:29.110884  7300 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.138214  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:29.154920  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:29.155105  2241 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:29.156279  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:29.157055  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:29.157207  6834 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:29.157572  6834 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:29.157918  6834 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:29.157990  6774 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.154498  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:29.159739  1541 raft_consensus.cc:606] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.160085  1541 raft_consensus.cc:614] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:29.093814  7234 raft_consensus.cc:515] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.162586  7234 leader_election.cc:290] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:29.111454  7113 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.163151  1584 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:29.165025  7113 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:29.168171  2270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90bfe669a290453597d79375d2aadae5"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
mode: GRACEFUL
new_leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
 from {username='slave'} at 127.0.0.1:40644
I20260709 13:01:29.168735  2270 raft_consensus.cc:606] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Received request to transfer leadership to TS e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.169032  2270 raft_consensus.cc:614] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:29.172214  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:29.178294  2269 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:29.181690  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:29.185194  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:29.189208  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:29.204437  6834 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.213289  7295 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.224963  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:46492
I20260709 13:01:29.225478  1543 raft_consensus.cc:606] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:29.225970  1543 raft_consensus.cc:614] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:29.225365  7274 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.231009  2271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6fc10a7f7a84904a1cc02696513828e"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:40644
I20260709 13:01:29.231829  2271 raft_consensus.cc:606] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:29.232333  2271 raft_consensus.cc:614] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:29.234452  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:29.168316  7220 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:29.242857  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:29.206413  6834 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:29.245265  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:29.245886  7139 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:29.243539  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 139587us
I20260709 13:01:29.243697  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:29.245970  1543 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:29.188242  7231 raft_consensus.cc:2804] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:29.270195  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 136620us
I20260709 13:01:29.281175  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:29.267846  7231 raft_consensus.cc:697] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:29.294691   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:29.297133   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:29.301717  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:29.275269  6746 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:29.308211  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:29.310169  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 59218.3us
I20260709 13:01:29.322356  1510 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:29.321096  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 49802.4us
I20260709 13:01:29.329303  1509 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:29.319315  7340 log.cc:927] Time spent T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.147s	user 0.003s	sys 0.000s
I20260709 13:01:29.343606  1510 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:29.352707  1658 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:29.312356  6825 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:01:29.319443  7333 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:29.356344  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.389340  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab387e7d0b0401eb317a86421cc1f80" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:29.351118  7336 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:01:29.390239  1509 leader_election.cc:304] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.392243  1658 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:29.354897  7267 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.398335  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.354004  7316 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:29.396723  7026 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.399291  7289 raft_consensus.cc:2749] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:29.393321  7330 log.cc:927] Time spent T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:01:29.360442  7315 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:29.399550  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 67509.6us
I20260709 13:01:29.416064  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.421849  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.422958  1509 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.396996  6867 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:29.389394  7090 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:29.425808  7266 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:29.449559  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.449741  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.451014  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.446635  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.428093  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.424515  1509 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.429760  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.388193  6993 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:01:29.428400  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.456388  7090 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.462790  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.459086  1584 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.464131  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.464828  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.418154  7116 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:29.474931  6655 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.475600  6655 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:29.475929  7315 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:29.365135  7231 consensus_queue.cc:237] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:29.449254  7267 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:29.474292  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 49840.9us
I20260709 13:01:29.455711  6867 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:29.453351  7094 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:29.453687  7316 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:29.479822  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:29.480950  1509 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.486927  6867 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:29.469803  7180 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:29.497822  7329 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.326s	user 0.000s	sys 0.002s
I20260709 13:01:29.467926  7225 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:29.512157  6867 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:29.502558  1660 leader_election.cc:304] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:29.515444  7306 raft_consensus.cc:2749] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:29.518553  6867 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:29.419827  7026 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:29.523267  7090 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:29.540732  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:29.550884  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:29.551527  1611 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:29.552537  1511 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:29.553500  7300 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.554522  1619 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:29.484254  1543 raft_consensus.cc:2468] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 19.
I20260709 13:01:29.556712  7307 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:29.557893  7026 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:29.570582  7256 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:29.571676  7297 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:29.572054  7297 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.572359  7315 consensus_queue.cc:1059] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:29.573274  7315 raft_consensus.cc:3055] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:29.573565  7315 raft_consensus.cc:740] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
W20260709 13:01:29.573884  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 257620us
I20260709 13:01:29.574208  7315 consensus_queue.cc:260] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.583997  7315 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.572374  7297 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:29.576120  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 95230.4us
I20260709 13:01:29.591511  7300 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:29.612473  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:29.613859  7297 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:29.624099  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:29.624603  1619 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.632018  1619 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:29.633045  1511 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:29.633986  7026 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:29.634500  7026 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:29.643666  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:29.647739  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.656565  1545 raft_consensus.cc:2410] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:29.659789  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:29.660492  1611 raft_consensus.cc:2393] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 16: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:01:29.671044  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 206232us
I20260709 13:01:29.673887  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe29c0d913c42cfb39d487a69abfd46" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.675261  1613 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:29.680239  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:29.680752  2273 raft_consensus.cc:3060] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.691354  2273 raft_consensus.cc:2468] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:29.697535  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.698751  7310 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:29.700119  2273 raft_consensus.cc:1240] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 14. Current term is 15. Ops: [13.11-14.12]
I20260709 13:01:29.701391  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.705587  1584 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:29.711422  7122 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.711692  7297 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:29.702831  7351 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:29.724165  1689 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:29.649734  7026 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:29.730806  1585 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:29.735037  7337 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:29.737108  1536 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:01:29.739121  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:29.747522  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:29.747530  1686 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:01:29.748488  1686 pending_rounds.cc:85] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting all ops after (but not including) 10
I20260709 13:01:29.748687  1686 pending_rounds.cc:107] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:29.748927  1686 raft_consensus.cc:2889] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:29.752206  7274 raft_consensus.cc:2804] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:29.752705  7274 raft_consensus.cc:697] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 15 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:29.753463  7274 consensus_queue.cc:237] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.757671  2241 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:29.765816  6834 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.767956  6774 raft_consensus.cc:2804] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:29.768448  6774 raft_consensus.cc:697] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 19 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:29.769197  6774 consensus_queue.cc:237] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.766301  6834 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.783224  2273 raft_consensus.cc:1240] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 19 LEADER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:29.785147  6834 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:29.797408  1538 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:29.798807  7234 consensus_queue.cc:1059] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:01:29.797211  7297 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:01:29.804030  7234 consensus_queue.cc:1243] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:01:29.805099  7096 raft_consensus.cc:3055] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:29.808841  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:29.809989  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
W20260709 13:01:29.811587  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 52140.6us
I20260709 13:01:29.817929  1538 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:29.806003  7096 raft_consensus.cc:740] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:29.825259  7096 consensus_queue.cc:260] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:29.826591  7096 raft_consensus.cc:3060] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:29.831983  2273 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:29.844672  7310 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:29.837891  7231 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:01:29.854513  1439 catalog_manager.cc:5697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.855764  7300 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:29.856976  1439 catalog_manager.cc:5697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 9 to 10, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.864220  1439 catalog_manager.cc:5697] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.866276  1439 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 8 to 15, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:29.871411  1439 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 9 to 11, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.874559  1439 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:29.876806  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 344) took 11261 ms (client timeout 15000 ms). Trace:
I20260709 13:01:29.879812  1439 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 7 to 9, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:29.883884  1439 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 12 to 13, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.898736  2271 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:01:29.877936  1438 rpcz_store.cc:269] 0709 13:01:18.615327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.632818 (+ 17491us) service_pool.cc:224] Handling call
0709 13:01:29.876746 (+11243928us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:27.948066 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:28.124942 (+176876us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:28.125728 (+   786us) write_op.cc:435] Acquired schema lock
0709 13:01:28.128500 (+  2772us) tablet.cc:662] Decoding operations
0709 13:01:28.526195 (+397695us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:28.528907 (+  2712us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:28.545099 (+ 16192us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:01:28.642561 (+ 97462us) tablet.cc:701] Row locks acquired
0709 13:01:28.642580 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:28.642725 (+   145us) write_op.cc:270] Start()
0709 13:01:28.642824 (+    99us) write_op.cc:276] Timestamp: P: 1783602088642665 usec, L: 0
0709 13:01:28.642843 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:01:28.643434 (+   591us) log.cc:844] Serialized 5910 byte log entry
0709 13:01:29.149319 (+505885us) op_driver.cc:464] REPLICATION: finished
0709 13:01:29.190112 (+ 40793us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8bdec85 00007f29e8bdf6a2 00007f29eb9511db 00007f29eb94caaf 00007f29e8c9b0ac 00007f29f1af5ab9 00007f29e8cb769b 00007f29e8cb593f 00007f29e8cb7c02 00007f29ef7dbef0
0709 13:01:29.401743 (+211631us) write_op.cc:301] APPLY: starting
0709 13:01:29.401832 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:29.537799 (+135967us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:29.537833 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:29.631009 (+ 93176us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:29.631346 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:01:29.631399 (+    53us) write_op.cc:312] APPLY: finished
0709 13:01:29.631766 (+   367us) log.cc:844] Serialized 139 byte log entry
0709 13:01:29.632577 (+   811us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:29.632773 (+   196us) write_op.cc:454] Released schema lock
0709 13:01:29.632839 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:29.635750 (+  2911us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:29.635778 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158835,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":252185,"apply.run_cpu_time_us":19317,"apply.run_wall_time_us":233927,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66737,"num_ops":15,"prepare.queue_time_us":63486,"prepare.run_cpu_time_us":30250,"prepare.run_wall_time_us":769112,"raft.queue_time_us":321430,"raft.run_cpu_time_us":11710,"raft.run_wall_time_us":165972,"replication_time_us":506347,"spinlock_wait_cycles":4943616,"thread_start_us":484639,"threads_started":4,"wal-append.queue_time_us":67299}]]}
I20260709 13:01:29.928013  1658 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:29.931831  7096 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:29.932145  7306 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:29.932392  7096 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:29.933291  7096 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:29.918519  7290 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:01:29.943789  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:29.964210  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:29.980937  7356 log.cc:927] Time spent T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.077s	user 0.003s	sys 0.000s
I20260709 13:01:29.981262  7310 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:30.082130  1692 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:30.083827  1539 raft_consensus.cc:1275] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:30.127529  7118 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:30.130095  7118 consensus_queue.cc:1048] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:30.280563  7362 log.cc:927] Time spent T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 13:01:30.313030  2269 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:30.315022  7118 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:30.350081   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:30.355592  1693 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 19 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:30.375711  1686 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.379637  1538 raft_consensus.cc:1275] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:01:30.380105  1538 pending_rounds.cc:85] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Aborting all ops after (but not including) 11
I20260709 13:01:30.380504  1538 pending_rounds.cc:107] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:01:30.380808  1538 raft_consensus.cc:2889] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:30.422514  1686 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:30.423388  6995 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.423772  7127 consensus_queue.cc:1048] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:01:30.424049  6995 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:30.427660  1538 raft_consensus.cc:1275] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:30.444787  7310 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:30.439395  7315 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:01:30.463491  6995 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:30.474188  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:30.484920  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:30.485806  1615 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:30.489645  1613 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:30.494261  7026 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:30.496527  1543 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:30.515964  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:30.523036  7293 consensus_queue.cc:1048] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:01:30.524921  7094 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:01:30.541596  1619 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:30.549058  7339 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:30.554535  7096 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:30.556308  7096 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:30.556699  7096 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:30.694229  7373 log.cc:927] Time spent T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: Append to log took a long time: real 0.127s	user 0.003s	sys 0.001s
I20260709 13:01:30.704722  7096 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:30.739295  7096 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:30.734505  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:30.847684  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:30.861097  1658 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:30.881273  7339 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:30.950866  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 52163.6us
I20260709 13:01:30.954131  1686 raft_consensus.cc:1240] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Rejecting Update request from peer 0cccd9c43f9747529680a8e7463961c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:30.978380  7381 consensus_queue.cc:1059] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:30.979290  7381 raft_consensus.cc:3055] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:30.979610  7381 raft_consensus.cc:740] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:30.980472  7381 consensus_queue.cc:260] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:30.981714  7381 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:31.015209  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 346) took 29538 ms (client timeout 15000 ms). Trace:
W20260709 13:01:31.015741  1439 rpcz_store.cc:269] 0709 13:01:01.505449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.505673 (+   224us) service_pool.cc:224] Handling call
0709 13:01:31.014977 (+29509304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:30.266451 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:30.267528 (+  1077us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:30.267577 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:01:30.267625 (+    48us) tablet.cc:662] Decoding operations
0709 13:01:30.268852 (+  1227us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:30.268949 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:30.268994 (+    45us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:01:30.318315 (+ 49321us) tablet.cc:701] Row locks acquired
0709 13:01:30.318384 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:01:30.318604 (+   220us) write_op.cc:270] Start()
0709 13:01:30.318778 (+   174us) write_op.cc:276] Timestamp: P: 1783602090318544 usec, L: 0
0709 13:01:30.318814 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:01:30.319900 (+  1086us) log.cc:844] Serialized 3244 byte log entry
0709 13:01:30.412604 (+ 92704us) op_driver.cc:464] REPLICATION: finished
0709 13:01:30.493498 (+ 80894us) write_op.cc:301] APPLY: starting
0709 13:01:30.493593 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:30.564916 (+ 71323us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:30.616138 (+ 51222us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:30.633063 (+ 16925us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:30.633407 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:01:30.633467 (+    60us) write_op.cc:312] APPLY: finished
0709 13:01:30.633814 (+   347us) log.cc:844] Serialized 81 byte log entry
0709 13:01:30.634003 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:30.634114 (+   111us) write_op.cc:454] Released schema lock
0709 13:01:30.634178 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:30.656358 (+ 22180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:30.665802 (+  9444us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":175770,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":80602,"apply.run_cpu_time_us":14414,"apply.run_wall_time_us":141151,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37519,"num_ops":8,"prepare.queue_time_us":318862,"prepare.run_cpu_time_us":5360,"prepare.run_wall_time_us":63956,"replication_time_us":93626,"thread_start_us":278187,"threads_started":2}]]}
I20260709 13:01:31.034142  1443 catalog_manager.cc:5697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.065197  1443 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:31.102988  1429 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82622e43412243cb95bf17b246050060 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5dd1b367d5dd4e6abfd29fc2df2bed07 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:31.297904  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38400 (request call id 238) took 18845 ms (client timeout 15000 ms). Trace:
I20260709 13:01:31.305449  1438 catalog_manager.cc:5697] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 4 to 7, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.307945  1438 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 10 to 16, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:31.298398  1443 rpcz_store.cc:269] 0709 13:01:12.453048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.502570 (+ 49522us) service_pool.cc:224] Handling call
0709 13:01:31.297834 (+18795264us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:31.140595 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:31.141148 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:31.141187 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:01:31.141206 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:31.141610 (+   404us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:31.141686 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:31.141716 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:31.142041 (+   325us) tablet.cc:701] Row locks acquired
0709 13:01:31.142061 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:31.142204 (+   143us) write_op.cc:270] Start()
0709 13:01:31.142322 (+   118us) write_op.cc:276] Timestamp: P: 1783602091142157 usec, L: 0
0709 13:01:31.142347 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:01:31.143044 (+   697us) log.cc:844] Serialized 919 byte log entry
0709 13:01:31.209080 (+ 66036us) op_driver.cc:464] REPLICATION: finished
0709 13:01:31.209440 (+   360us) write_op.cc:301] APPLY: starting
0709 13:01:31.209526 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:31.210845 (+  1319us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:31.210926 (+    81us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:31.212128 (+  1202us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:31.212284 (+   156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:01:31.212322 (+    38us) write_op.cc:312] APPLY: finished
0709 13:01:31.212502 (+   180us) log.cc:844] Serialized 33 byte log entry
0709 13:01:31.212648 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:31.212721 (+    73us) write_op.cc:454] Released schema lock
0709 13:01:31.212762 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:31.213091 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:31.213119 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":115,"apply.run_cpu_time_us":3598,"apply.run_wall_time_us":3608,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":24522,"prepare.run_cpu_time_us":2837,"prepare.run_wall_time_us":9837,"replication_time_us":66604,"spinlock_wait_cycles":9984,"thread_start_us":21718,"threads_started":1}]]}
I20260709 13:01:31.312104  1438 catalog_manager.cc:5697] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 13, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.315326  1438 catalog_manager.cc:5697] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 5 to 11, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.325448  1438 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 14 to 16, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.330233  1438 catalog_manager.cc:5697] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 13, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.332062  1438 catalog_manager.cc:5697] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.339836  1438 catalog_manager.cc:5697] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.341321  1438 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 9 to 12, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.342844  1438 catalog_manager.cc:5697] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.344195  1438 catalog_manager.cc:5697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.347430  1438 catalog_manager.cc:5697] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 12, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 12 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.351227  1438 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 9 to 17, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.373157  1438 catalog_manager.cc:5697] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.378412  1438 catalog_manager.cc:5697] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 14, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.380714  1438 catalog_manager.cc:5697] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.385495  1438 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 10 to 15, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.387452  1438 catalog_manager.cc:5697] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 13 to 16, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.399385  1438 catalog_manager.cc:5697] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.401300  1438 catalog_manager.cc:5697] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.402684  1438 catalog_manager.cc:5697] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 7 to 11, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.405954  1438 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } }
I20260709 13:01:31.408515  1438 catalog_manager.cc:5697] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 5 to 10, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.409929  1438 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 16, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.411535  1438 catalog_manager.cc:5697] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.412794  1438 catalog_manager.cc:5697] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 18, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.414146  1438 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 15, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.417951  1438 catalog_manager.cc:5697] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 10 to 12, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.420152  1438 catalog_manager.cc:5697] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 17 to 19, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.421533  1438 catalog_manager.cc:5697] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.422839  1438 catalog_manager.cc:5697] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.429272  1438 catalog_manager.cc:5697] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 12 to 15, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.439541  1438 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 12 to 15, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.441041  1438 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 9 to 11, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.442551  1438 catalog_manager.cc:5697] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.444067  1438 catalog_manager.cc:5697] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 7 to 14, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 14 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.449534  1438 catalog_manager.cc:5697] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 12 to 13, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:31.451040  1438 catalog_manager.cc:5697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 8 to 10, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
W20260709 13:01:31.884035  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 147527us
I20260709 13:01:31.969514  1440 catalog_manager.cc:5697] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 11 to 16, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.971635  1440 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.982365  1440 catalog_manager.cc:5697] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 10 to 11, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.985154  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 345) took 1247 ms. Trace:
I20260709 13:01:31.988935  1440 catalog_manager.cc:5697] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.993767  1440 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 11 to 12, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.996742  1440 catalog_manager.cc:5697] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 11 to 17, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:31.999142  1440 catalog_manager.cc:5697] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:32.000411   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:31.987121  1438 rpcz_store.cc:276] 0709 13:01:30.735209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.735534 (+   325us) service_pool.cc:224] Handling call
0709 13:01:31.982751 (+1247217us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:31.471210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:31.471759 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:31.471793 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:01:31.471813 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:31.473995 (+  2182us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:31.474031 (+    36us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:31.474047 (+    16us) tablet.cc:685] Acquiring locks for 38 operations
0709 13:01:31.476344 (+  2297us) tablet.cc:701] Row locks acquired
0709 13:01:31.476363 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:31.476497 (+   134us) write_op.cc:270] Start()
0709 13:01:31.476607 (+   110us) write_op.cc:276] Timestamp: P: 1783602091476453 usec, L: 0
0709 13:01:31.476630 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:01:31.478871 (+  2241us) log.cc:844] Serialized 14978 byte log entry
0709 13:01:31.485580 (+  6709us) op_driver.cc:464] REPLICATION: finished
0709 13:01:31.491377 (+  5797us) write_op.cc:301] APPLY: starting
0709 13:01:31.491447 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:31.644593 (+153146us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:31.646030 (+  1437us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:31.827158 (+181128us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:31.827535 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=76,key_file_lookups=76,delta_file_lookups=76,mrs_lookups=0
0709 13:01:31.827575 (+    40us) write_op.cc:312] APPLY: finished
0709 13:01:31.828080 (+   505us) log.cc:844] Serialized 324 byte log entry
0709 13:01:31.828244 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:31.828496 (+   252us) write_op.cc:454] Released schema lock
0709 13:01:31.828576 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:31.847253 (+ 18677us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:31.847294 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6884,"reported_tablets":45,"spinlock_wait_cycles":18176,"child_traces":[["op",{"apply.queue_time_us":2771,"apply.run_cpu_time_us":43967,"apply.run_wall_time_us":355824,"cfile_cache_hit":152,"cfile_cache_hit_bytes":158612,"num_ops":38,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":6505,"prepare.run_wall_time_us":10778,"replication_time_us":8814}]]}
I20260709 13:01:32.014405  1440 catalog_manager.cc:5697] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:32.020399  1440 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:32.085000  1438 catalog_manager.cc:5697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 9 to 13, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:32.086356  1438 catalog_manager.cc:5697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } }
I20260709 13:01:32.117026  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38400 (request call id 239) took 2332 ms. Trace:
I20260709 13:01:32.117400  1440 rpcz_store.cc:276] 0709 13:01:29.784757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.784951 (+   194us) service_pool.cc:224] Handling call
0709 13:01:32.116956 (+2332005us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:32.032762 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:32.033267 (+   505us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:32.033297 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:01:32.033314 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:32.034756 (+  1442us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:32.034839 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:32.034866 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:32.035607 (+   741us) tablet.cc:701] Row locks acquired
0709 13:01:32.035622 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:01:32.035759 (+   137us) write_op.cc:270] Start()
0709 13:01:32.035876 (+   117us) write_op.cc:276] Timestamp: P: 1783602092035713 usec, L: 0
0709 13:01:32.035896 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:32.037049 (+  1153us) log.cc:844] Serialized 3601 byte log entry
0709 13:01:32.065402 (+ 28353us) op_driver.cc:464] REPLICATION: finished
0709 13:01:32.065781 (+   379us) write_op.cc:301] APPLY: starting
0709 13:01:32.065858 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:32.070124 (+  4266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:32.070213 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:32.075084 (+  4871us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:32.075282 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:01:32.075323 (+    41us) write_op.cc:312] APPLY: finished
0709 13:01:32.075569 (+   246us) log.cc:844] Serialized 89 byte log entry
0709 13:01:32.075717 (+   148us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:32.075847 (+   130us) write_op.cc:454] Released schema lock
0709 13:01:32.075889 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:32.095410 (+ 19521us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:32.095447 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":136465,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":115,"apply.run_cpu_time_us":10433,"apply.run_wall_time_us":10435,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37566,"num_ops":9,"prepare.queue_time_us":7800,"prepare.run_cpu_time_us":3547,"prepare.run_wall_time_us":4597,"replication_time_us":29356,"thread_start_us":11894,"threads_started":1}]]}
I20260709 13:01:32.220387  7396 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:32.220891  7396 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.222748  7391 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.223145  7396 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:32.223344  7391 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.226150  7391 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:32.230571  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:32.231276  1693 raft_consensus.cc:2393] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 14: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:32.248806  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:32.249475  1619 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 13.
I20260709 13:01:32.256220  1511 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:32.259407  7403 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:32.259889  7403 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.260257  7403 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.272302  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:32.272967  1692 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:32.280296  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0cccd9c43f9747529680a8e7463961c9" is_pre_election: true
I20260709 13:01:32.292812  7403 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.294373  1540 raft_consensus.cc:2368] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15.
I20260709 13:01:32.318841  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:32.319672  1619 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.324476  7403 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:32.329445  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:01:32.330257  1693 raft_consensus.cc:606] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:32.330842  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 45246.5us
I20260709 13:01:32.333297  1584 leader_election.cc:400] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15.
I20260709 13:01:32.333577  1584 leader_election.cc:403] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:32.334414  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:01:32.335019  1692 raft_consensus.cc:606] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:32.341599  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:32.342180  1692 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.342862  2272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90bfe669a290453597d79375d2aadae5"
dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:40644
I20260709 13:01:32.343493  2272 raft_consensus.cc:606] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:32.342952  1440 catalog_manager.cc:5697] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 11 to 19, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.343892  2272 raft_consensus.cc:614] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:32.344931  1440 catalog_manager.cc:5697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 10 to 12, leader changed from 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:32.348953  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:01:32.349541  1686 raft_consensus.cc:606] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:32.338289  1619 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:01:32.350797  7396 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) with higher term. Message: Invalid argument: T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 for earlier term 14. Current term is 15.
I20260709 13:01:32.355620  1692 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 15.
I20260709 13:01:32.356818  1509 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:32.357537  7403 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:32.358003  7403 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:32.359361  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:01:32.360013  1686 raft_consensus.cc:606] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:32.358812  7403 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.361306   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:32.363102   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:32.371495  7306 raft_consensus.cc:993] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:32.372023  7306 raft_consensus.cc:1081] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:32.374169  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:01:32.374795  1540 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.375120  1540 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.382166  1540 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.384776  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:32.385324  1611 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.391117  1540 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:32.392623  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:32.393142  1686 raft_consensus.cc:3055] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:32.393467  1686 raft_consensus.cc:740] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:32.394223  1686 consensus_queue.cc:260] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.395493  1686 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.401602  1611 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:32.402992  1511 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:32.403731  7391 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:32.404263  7391 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:32.405099  7391 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.421248  1686 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 14.
I20260709 13:01:32.436367  1441 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38628 (request call id 354) took 3508 ms. Trace:
I20260709 13:01:32.436838  1441 rpcz_store.cc:276] 0709 13:01:28.925258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.925394 (+   136us) service_pool.cc:224] Handling call
0709 13:01:28.972183 (+ 46789us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5400230190. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29e8b40db1 00007f29e8c80b71 00007f29e8c810b2 00007f29f1bfaa89 00007f29f1b92da6 00007f29f1b64088 00007f29f1c6237e 00007f29f01232a4 00007f29f0123232 00007f29f0123161 00007f29f01230dc
0709 13:01:32.433822 (+3461639us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":45,"spinlock_wait_cycles":39735296}
I20260709 13:01:32.448715  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38652 (request call id 347) took 6614 ms. Trace:
I20260709 13:01:32.449131  1442 rpcz_store.cc:276] 0709 13:01:25.834632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.846070 (+ 11438us) service_pool.cc:224] Handling call
0709 13:01:32.448496 (+6602426us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":391698,"reported_tablets":47,"spinlock_wait_cycles":484608}
I20260709 13:01:32.489331  7387 raft_consensus.cc:993] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:32.489840  7306 raft_consensus.cc:1081] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:32.495942  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:01:32.496516  1540 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.496882  1540 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.509323  1540 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.518364  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:32.518927  1611 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.530233  1611 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:32.531325  1511 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:32.532703  7391 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:32.533192  7391 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:32.535514  1611 raft_consensus.cc:1240] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:32.537348  7387 consensus_queue.cc:1059] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:32.534055  7391 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.539116  7385 raft_consensus.cc:993] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 13:01:32.539572  7385 raft_consensus.cc:1081] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 13:01:32.543921  1540 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:32.543967  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:32.549621  1686 raft_consensus.cc:3055] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:32.550001  1686 raft_consensus.cc:740] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:32.550735  1686 consensus_queue.cc:260] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:32.551985  1686 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.559301  1442 catalog_manager.cc:5697] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.564702  1611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53894
I20260709 13:01:32.567008  1686 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 12.
I20260709 13:01:32.565253  1611 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.571151  1611 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:32.572402  7339 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:01:32.566964  1442 catalog_manager.cc:5697] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 13 to 14, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.607502  1611 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:32.633900  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:32.634604  2272 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:32.644891  1611 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:32.653858  2272 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
W20260709 13:01:32.713413  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 50458us
I20260709 13:01:32.716048  1585 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:32.716981  7412 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:32.717509  7412 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:32.722378  7412 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:32.726238  1442 catalog_manager.cc:5697] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 11 to 12, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.738464  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:32.739082  1686 raft_consensus.cc:3055] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:32.739380  1686 raft_consensus.cc:740] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:32.740095  1686 consensus_queue.cc:260] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:32.741321  1686 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:32.796451  1686 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
W20260709 13:01:32.809780  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 44708us
I20260709 13:01:32.815030  7414 raft_consensus.cc:993] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:32.827246  7339 raft_consensus.cc:1081] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
W20260709 13:01:32.826728  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 51590.7us
I20260709 13:01:32.839033  1692 consensus_queue.cc:237] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:32.844902  1619 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:32.847505  7391 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:32.861889  1442 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 15 to 16, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:32.892571  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 97530.2us
W20260709 13:01:32.945704  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 62574.3us
W20260709 13:01:32.950207  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 52307.3us
W20260709 13:01:32.958288  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 54024.5us
I20260709 13:01:32.982844  1545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:01:33.013751  1545 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.014627  1545 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:33.032691  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 73126.1us
W20260709 13:01:33.065837  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 48810.5us
I20260709 13:01:33.086150  1686 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:33.091193  1692 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:33.094528  1611 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:01:33.094395  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 106254us
I20260709 13:01:33.103852  2273 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:01:33.120103  7425 log.cc:927] Time spent T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:01:33.119997  1545 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:33.122759  1545 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:33.127669  1689 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:33.139864  7404 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:33.141314  7403 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:01:33.152470  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:33.153046  1689 raft_consensus.cc:3055] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:33.153343  1689 raft_consensus.cc:740] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:33.154078  1689 consensus_queue.cc:260] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:33.172259  1689 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.145929  7404 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:01:33.189018  7410 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:33.193550  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 101087us
W20260709 13:01:33.201363  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 104568us
I20260709 13:01:33.213833  7427 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:33.234880  1611 raft_consensus.cc:1275] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:01:33.246877  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 53483.8us
I20260709 13:01:33.247632  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:33.249320  1611 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.251026  1619 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:33.287101  1689 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
W20260709 13:01:33.289619  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 44246.6us
I20260709 13:01:33.270468  1611 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
I20260709 13:01:33.325726  7442 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:33.326736  7414 consensus_queue.cc:1048] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:33.316103  1509 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:33.364045   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:33.415800  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 105795us
W20260709 13:01:33.416914  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 73578.4us
I20260709 13:01:33.432379  7440 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:33.432966  7440 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:33.433881  7440 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:33.436081  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 74458.8us
W20260709 13:01:33.478921  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 136368us
W20260709 13:01:33.529121  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 48051.8us
W20260709 13:01:33.550446  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 126874us
I20260709 13:01:33.595438  1693 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:01:33.647064  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 105563us
I20260709 13:01:33.647915  7436 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:33.652432  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 206363us
I20260709 13:01:33.660187  2272 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:33.819445  7122 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:01:33.835070  1442 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 16 to 17, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:33.839749  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 97693.7us
W20260709 13:01:33.840469  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 97868.8us
W20260709 13:01:33.852039  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 109804us
I20260709 13:01:33.942206  7339 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:33.956748  1615 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:33.961436  1620 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:33.963135  7449 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:34.007987  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 93590.1us
I20260709 13:01:34.026770  7339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56376 (request call id 0) took 1284 ms. Trace:
W20260709 13:01:34.107199  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 64361.4us
W20260709 13:01:34.108515  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 65748.5us
W20260709 13:01:34.123512  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 80589.6us
I20260709 13:01:34.130081  1687 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:34.033548  7339 rpcz_store.cc:276] 0709 13:01:32.742456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.745076 (+  2620us) service_pool.cc:224] Handling call
0709 13:01:32.829408 (+ 84332us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b58006f7dd0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd010aa 00007f29ebd83447 00007f29ebda070a 00007f29ebda176a 00007f29ebda091b 00007f29ebdac03c 00007f29ebdab6b3 00007f29ebda39fa 00007f29f0d6b4c9 00007f29ea2e7c54
0709 13:01:32.837958 (+  8550us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b58006f7ad0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd010aa 00007f29ebd83447 00007f29ebda070a 00007f29ebda176a 00007f29ebda091b 00007f29ebdac03c 00007f29ebdab6b3 00007f29ebda39fa 00007f29f0d6b4c9 00007f29ea2e7c54
0709 13:01:32.841952 (+  3994us) log.cc:844] Serialized 501 byte log entry
0709 13:01:33.121377 (+279425us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b1800173b00. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29f1b80de1 00007f29f1b8d5b1 00007f29e8cb83f3 00007f29e8cba7c1 00007f29e8cba779 00007f29e8cba709 00007f29e8cba6d1 00007f29e8cb99cd 000000000038f354 000000000038f199 00007f29e8c9b83a
0709 13:01:34.026660 (+905283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6987,"raft.queue_time_us":14776,"raft.run_cpu_time_us":1273,"raft.run_wall_time_us":104661,"spinlock_wait_cycles":113114624,"thread_start_us":97242,"threads_started":1,"wal-append.queue_time_us":183196}
I20260709 13:01:34.138830  7403 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:01:34.168123  2269 raft_consensus.cc:2955] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:34.216297  1428 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dbe29c0d913c42cfb39d487a69abfd46 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:01:34.275182  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 47133.8us
W20260709 13:01:34.304960  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 58313.9us
I20260709 13:01:34.325492  1441 catalog_manager.cc:5697] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 7 to 8, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 11 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:34.335743  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 129541us
I20260709 13:01:34.385041  1526 tablet_service.cc:1558] Processing DeleteTablet for tablet dbe29c0d913c42cfb39d487a69abfd46 with delete_type TABLET_DATA_TOMBSTONED (TS 0cccd9c43f9747529680a8e7463961c9 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:39668
I20260709 13:01:34.402271  7484 tablet_replica.cc:333] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:34.403872  7484 raft_consensus.cc:2243] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:34.405529  7484 raft_consensus.cc:2272] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:34.409168  7484 ts_tablet_manager.cc:1916] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:34.458901  7484 ts_tablet_manager.cc:1929] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.7
I20260709 13:01:34.459510  7484 log.cc:1199] T dbe29c0d913c42cfb39d487a69abfd46 P 0cccd9c43f9747529680a8e7463961c9: Deleting WAL directory at /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601902018772-431-0/minicluster-data/ts-0-root/wals/dbe29c0d913c42cfb39d487a69abfd46
I20260709 13:01:34.462867  1428 catalog_manager.cc:5028] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): tablet dbe29c0d913c42cfb39d487a69abfd46 (table test-workload [id=283a38c2957e452fa4a15a6485bdf23d]) successfully deleted
I20260709 13:01:34.650334   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:34.816962  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:01:34.817602  1692 raft_consensus.cc:606] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:34.820972  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:01:34.821565  1692 raft_consensus.cc:606] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:34.824191  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:01:34.824770  1692 raft_consensus.cc:606] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:34.832311  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:01:34.832844  1693 raft_consensus.cc:606] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Received request to transfer leadership to TS 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:34.838308  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3"
dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
mode: GRACEFUL
new_leader_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:01:34.847184  1692 raft_consensus.cc:606] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Received request to transfer leadership to TS e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:34.849076   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:34.850878   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:35.020561  7476 raft_consensus.cc:993] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:35.021148  7422 raft_consensus.cc:1081] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:35.024767  7339 raft_consensus.cc:993] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:35.025192  7339 raft_consensus.cc:1081] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:35.030656  1536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:01:35.031236  1536 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.031550  1536 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:35.041455  1545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:01:35.041999  1545 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.042361  1545 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.059154  1545 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:35.061630  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:35.062183  1620 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.063957  1536 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:35.065826  1545 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:35.066321  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:35.066854  1611 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:35.067016  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:35.067621  1693 raft_consensus.cc:3055] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:35.067893  1693 raft_consensus.cc:740] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:35.068619  1693 consensus_queue.cc:260] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:35.069804  1693 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.073485  1536 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:35.073638  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:35.074180  1692 raft_consensus.cc:3055] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:35.074440  1692 raft_consensus.cc:740] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:35.075133  1692 consensus_queue.cc:260] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:35.076227  1692 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:35.077196  1620 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:35.077373  1611 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 16.
I20260709 13:01:35.078296  1511 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:35.079208  1511 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:35.080021  7449 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:35.080842  7482 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:35.083010  1693 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 11.
I20260709 13:01:35.083716  1692 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 16.
I20260709 13:01:35.087137  7449 raft_consensus.cc:697] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:35.088132  7449 consensus_queue.cc:237] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:35.107193  7482 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 16 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:35.108184  7482 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:35.111779  1441 catalog_manager.cc:5697] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 10 to 11, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.138849  7476 raft_consensus.cc:993] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:35.139334  7422 raft_consensus.cc:1081] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:35.141031  1545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:01:35.141569  1545 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.141908  1545 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:35.160964  1545 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:35.164331  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:35.164891  1692 raft_consensus.cc:3055] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:35.164805  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:35.165321  1692 raft_consensus.cc:740] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:35.165482  2273 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:35.166083  1692 consensus_queue.cc:260] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:35.167157  1692 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:35.174311  2273 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
I20260709 13:01:35.175758  1545 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:35.177260  7422 raft_consensus.cc:993] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 13:01:35.177764  7422 raft_consensus.cc:1081] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Signalling peer e12d7b3551014757ba7dda3e83605b83 to start an election
I20260709 13:01:35.193017  1510 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 
I20260709 13:01:35.195130  7486 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:35.195655  7486 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:35.196501  7486 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:35.202980  1611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3"
dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
 from {username='slave'} at 127.0.0.1:53894
I20260709 13:01:35.203578  1611 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.203903  1611 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:35.218590  1692 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
I20260709 13:01:35.239452  1611 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:35.236929  1428 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 82622e43412243cb95bf17b246050060 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 0cccd9c43f9747529680a8e7463961c9 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 15 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:35.261246  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
I20260709 13:01:35.261821  1545 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:35.275549  1545 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 17.
I20260709 13:01:35.276595  1584 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83; no voters: 
I20260709 13:01:35.277356  7122 raft_consensus.cc:2804] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:35.277916  7122 raft_consensus.cc:697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 17 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:35.278743  7122 consensus_queue.cc:237] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:35.285420  1611 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:35.307463  1441 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 15 to 16, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.309589  1441 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 16 to 17, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.313305  1545 raft_consensus.cc:1240] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Rejecting Update request from peer e2a2b76c98ee44ff95e6508c34da0e3d for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:35.319196  7435 consensus_queue.cc:1059] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:35.320238  7435 raft_consensus.cc:3055] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:35.320621  7435 raft_consensus.cc:740] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:35.321478  7435 consensus_queue.cc:260] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:35.323508  7435 raft_consensus.cc:3060] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:35.335101  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 53167.1us
I20260709 13:01:35.336566  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:35.369285  1692 raft_consensus.cc:2468] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 17.
W20260709 13:01:35.407943  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 59219.8us
I20260709 13:01:35.409265  7339 raft_consensus.cc:993] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: : Instructing follower 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:35.414813  7476 raft_consensus.cc:1081] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Signalling peer 0cccd9c43f9747529680a8e7463961c9 to start an election
I20260709 13:01:35.420269  1441 catalog_manager.cc:5697] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 16 to 17, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.424196  1545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8"
dest_uuid: "0cccd9c43f9747529680a8e7463961c9"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:01:35.424750  1545 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.425060  1545 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:35.432192  1545 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:35.435022  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:35.435604  1692 raft_consensus.cc:3055] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:35.435901  1692 raft_consensus.cc:740] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:35.436688  1692 consensus_queue.cc:260] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:35.437608  1692 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:35.449331  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 72307.2us
I20260709 13:01:35.453958  1545 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:35.487859  1692 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
I20260709 13:01:35.489074  1509 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:35.490305  7486 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:35.492322  7486 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Becoming Leader. State: Replica: 0cccd9c43f9747529680a8e7463961c9, State: Running, Role: LEADER
I20260709 13:01:35.493258  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:35.493206  7486 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:35.493856  1611 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:35.500438  1611 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cccd9c43f9747529680a8e7463961c9 in term 17.
W20260709 13:01:35.509018  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 61245.1us
I20260709 13:01:35.531498  1441 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 reported cstate change: term changed from 16 to 17, leader changed from e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195) to 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:35.607872  1692 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:35.609225  7486 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:35.623230  1611 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:35.624569  7486 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:35.678901  1545 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:35.680675  7498 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:35.687543  2273 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:35.702075  1688 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:35.704660  7482 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:01:35.725559  7485 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:35.744009  1688 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:35.744336  1687 raft_consensus.cc:1275] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:35.746002  7496 consensus_queue.cc:1048] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:35.780154  1611 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:35.757268  7485 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:01:35.851769   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:35.846972  1543 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:01:35.863463  7504 log.cc:927] Time spent T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:01:35.997035  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 46645.9us
W20260709 13:01:36.082183  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 128795us
W20260709 13:01:36.090601  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 150593us
I20260709 13:01:36.220140   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:36.254570  1658 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 16 similar messages]
W20260709 13:01:36.272181  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 84434.4us
W20260709 13:01:36.272622  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 96012.2us
W20260709 13:01:36.315498  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.005s	sys 0.006s
W20260709 13:01:36.316011  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.005s	sys 0.006s
W20260709 13:01:36.316341  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 548195us
I20260709 13:01:36.324822  1620 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:36.336697  1611 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:36.353814  1686 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:01:36.362479  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 58160.6us
W20260709 13:01:36.372150  1510 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea97e615db7549b797908560563dd608. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:36.376681  7486 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:36.395072  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 140495us
I20260709 13:01:36.452926  1693 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Refusing update from remote peer 0cccd9c43f9747529680a8e7463961c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:36.432540  7525 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:01:36.413551  7535 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:36.431638  7548 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
W20260709 13:01:36.467399  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 102014us
I20260709 13:01:36.492022  7525 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:01:36.565090  1658 consensus_peers.cc:597] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.565811  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 69112.1us
W20260709 13:01:36.537142  2241 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.580745  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 101721us
W20260709 13:01:36.580456  2241 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.601068  1658 consensus_peers.cc:597] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.594626  2241 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.630370  2241 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.642467  1658 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.648463  1658 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.649433  2241 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.651669  1658 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.665817  1658 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.666446  1658 consensus_peers.cc:597] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.667042  1658 consensus_peers.cc:597] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.668592  1658 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.670619  2241 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.690243  1658 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.689860  1584 consensus_peers.cc:597] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.690972  1658 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.700050  1584 consensus_peers.cc:597] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.706660  1584 consensus_peers.cc:597] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.708191  1584 consensus_peers.cc:597] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.709275  1584 consensus_peers.cc:597] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.709831  1584 consensus_peers.cc:597] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.715122  1584 consensus_peers.cc:597] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:36.715955  7486 raft_consensus.cc:2955] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 13:01:36.724491  1584 consensus_peers.cc:597] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.716563  1658 consensus_peers.cc:597] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.725989  2241 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.726475  1584 consensus_peers.cc:597] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:36.739267  1687 raft_consensus.cc:2955] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 13:01:36.785665  1611 raft_consensus.cc:2955] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 13:01:36.805302  1658 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.813063  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:36.851074  7548 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:36.851613  7548 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:36.854188  7548 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:36.860045  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:36.866618  7510 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:36.896236  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:36.899446  7510 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:36.901412  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:36.910701  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:36.912395  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:36.906703  7510 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:36.912977  1509 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:36.913033  7485 raft_consensus.cc:493] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:36.919682  7485 raft_consensus.cc:515] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:36.921681  7485 leader_election.cc:290] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:36.890180  7511 raft_consensus.cc:493] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:36.911245  7482 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:36.934818  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:36.945086  7486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39918 (request call id 0) took 1193 ms. Trace:
I20260709 13:01:36.945585  7486 rpcz_store.cc:276] 0709 13:01:35.751478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.751950 (+   472us) service_pool.cc:224] Handling call
0709 13:01:35.888412 (+136462us) log.cc:844] Serialized 506 byte log entry
0709 13:01:36.244475 (+356063us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b54001e9ea0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd25b26 00007f29ebd1f49a 00007f29ebd1e714 00007f29ebcfeeaa 00007f29ebd05d53 00007f29ebd05cd9 00007f29ebd05c69 00007f29ebd05c31 00007f29ebd04dfd 000000000038f354
0709 13:01:36.365290 (+120815us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b54001e9ea0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ebd0e571 00007f29ebd25b26 00007f29ebd1f49a 00007f29ebd1e714 00007f29ebcfeeaa 00007f29ebd05d53 00007f29ebd05cd9 00007f29ebd05c69 00007f29ebd05c31 00007f29ebd04dfd 000000000038f354
0709 13:01:36.944984 (+579694us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":337,"raft.queue_time_us":17283,"raft.run_cpu_time_us":4729,"raft.run_wall_time_us":338210,"spinlock_wait_cycles":14674560,"thread_start_us":255586,"threads_started":1,"wal-append.queue_time_us":266522}
I20260709 13:01:36.954757  7548 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:36.959682  7482 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:36.961989  7482 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:36.976337  1511 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:36.978283  7548 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:36.980108  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:36.985430  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb2b0bb91ba4b59bba638c371a86a1e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:36.939246  7535 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:36.996881  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e20996757d4784ade11fe9799f7a13" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:36.995707  1441 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 12, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "0cccd9c43f9747529680a8e7463961c9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 13:01:37.004698  7548 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:37.025249  1509 leader_election.cc:304] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.027076  7486 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:37.026988  7548 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.027637  7486 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.029139  7548 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.029503  7486 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.029664  7548 raft_consensus.cc:2749] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:36.966921  7511 raft_consensus.cc:515] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:37.031597  7511 leader_election.cc:290] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:37.032033  7511 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:37.043089  7570 ts_tablet_manager.cc:933] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:37.032511  7511 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:37.048991  1615 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:37.009989  7535 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.069062  7535 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.070990  7548 raft_consensus.cc:493] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:37.071715  7548 raft_consensus.cc:515] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:37.074180  7548 leader_election.cc:290] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:37.111971  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.121228  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.106946  7548 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:01:37.124933  1509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 99765.1us
I20260709 13:01:37.125943  1509 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:37.127565  2241 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:37.131053  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.132607  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef93a23494e4934beefa28be227bc72" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.135442  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeb3a1da10b4e5a8070d908a280055c" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.139400  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a483be3e3ee4d5381336b0877760ca9" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.155637  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.157096  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.159425  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f214986b534c7ea670b8ff7960e691" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.160758  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.131866  7571 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.165581  1510 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.130388  7548 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.169811  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9be6d7fbe2348e4a1be13e50f487f82" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.169919  7570 tablet_copy_client.cc:323] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:42041
I20260709 13:01:37.179986  7548 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.170843  7531 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:37.187776  1585 consensus_peers.cc:597] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e5e0874051d4aa6807636e553d51e6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:37.173606  7571 raft_consensus.cc:493] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:37.191846  7571 raft_consensus.cc:515] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.193878  7571 leader_election.cc:290] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.203040  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.204277  7486 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:37.204797  7482 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:37.204878  7486 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.205441  7482 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:37.206547  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.170909  7485 raft_consensus.cc:493] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:37.207800  7571 raft_consensus.cc:493] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:37.207926  7485 raft_consensus.cc:515] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:37.209740  7571 raft_consensus.cc:515] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.209770  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0105ba6bf14860a95121a73725f62e" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.210243  7511 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:37.213444  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3485ff8d284d46bea80fa498e5f6d34a" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.212375  7571 leader_election.cc:290] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.212556  7486 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.260859  7482 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:37.262089  7485 leader_election.cc:290] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:37.276254  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.276268  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.277865  1509 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.287595  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24aaf5c9514244ae333d411f1fb4f5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:37.294787  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 89570.8us
I20260709 13:01:37.296315  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.297684  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.298832  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21865842c3d4eafba995dd02f14b489" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.299059  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044356f91b2d4fe4a34deeb351b2fbac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.300809  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e51c69bdb8c4616a20162792bc3e235" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.303009  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45eebdd49441fa87ca7768bae03d64" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.312781  7485 raft_consensus.cc:493] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:37.313443  7482 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:37.313397  7485 raft_consensus.cc:515] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.314464  7531 raft_consensus.cc:493] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:37.315040  7531 raft_consensus.cc:515] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.315548  7485 leader_election.cc:290] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.316742  1510 leader_election.cc:304] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.316990  7531 leader_election.cc:290] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.317788  1510 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.318382  7486 raft_consensus.cc:2749] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.318492  7580 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:37.319993  1509 leader_election.cc:304] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.320700  7580 raft_consensus.cc:2749] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.321100  1509 leader_election.cc:304] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.321893  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.322162  1509 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.322324  7580 raft_consensus.cc:2749] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:37.323828  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.327972  7571 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:37.334995  1510 leader_election.cc:304] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.335744  7580 raft_consensus.cc:2749] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.337911  1693 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:37.328267  1509 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.349427  1509 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.353530  1509 leader_election.cc:304] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.355262  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b4609f4058b459f804e03408773bd69" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.353605  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e675a1020ff48279e061c44c1a368ae" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.358580  7573 raft_consensus.cc:2749] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.360169  1509 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.363297  7573 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:37.364344  1510 leader_election.cc:304] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.365022  7580 raft_consensus.cc:2749] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.369463  7580 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:37.369894  7580 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:37.371719  7573 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:37.371955  7580 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:37.348178  7571 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:37.377820  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.383512  7549 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:01:37.372315  7573 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.385404  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccb59a831c424786ae1c9dfd1db1f6d3" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.387212  7573 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.383492  1510 leader_election.cc:304] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.357107  7518 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.388772  7571 raft_consensus.cc:2749] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:37.391537  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.391978  7531 raft_consensus.cc:493] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:37.392480  7531 raft_consensus.cc:515] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.394364  7531 leader_election.cc:290] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.402228  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b3c7e5df794f4baecc6be830fb8f80" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.402392  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.408989  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9fc6a855e249298263a94d04de35a4" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.415169  1511 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.419468  7482 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:37.428571  1510 leader_election.cc:304] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.429651  7482 raft_consensus.cc:2749] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:37.442915  1509 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.447482  7580 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:37.462584  7486 raft_consensus.cc:493] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:37.463219  7486 raft_consensus.cc:515] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.465653  7486 leader_election.cc:290] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.478605  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.480625  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f81118a8e62c4910be3913ae0e3f240d" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:37.485421  1584 consensus_peers.cc:597] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:37.487782  1509 leader_election.cc:304] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.501528  7580 raft_consensus.cc:2749] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:37.522594  7581 raft_consensus.cc:2955] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
W20260709 13:01:37.524991  1430 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d53120c1adf947fd992e5950edf26301 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer e12d7b3551014757ba7dda3e83605b83 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 11 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:37.532275  1688 raft_consensus.cc:2955] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 13:01:37.537560   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:37.541481   431 tablet_replica.cc:333] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.542357   431 raft_consensus.cc:2243] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.543023   431 raft_consensus.cc:2272] T 1532fbff9860493fa0fbdf5eb1b21242 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:37.543037  1491 auto_rebalancer.cc:629] Failed to schedule move for tablet 17c95b4249214135b23fe0bcbdcf8ad3: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:37.551664   431 tablet_replica.cc:333] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.552983   431 raft_consensus.cc:2243] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.553650   431 raft_consensus.cc:2272] T 83a99308299b4d05a3b45157d06ba9bd P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.565901   431 tablet_replica.cc:333] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.566794   431 raft_consensus.cc:2243] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:37.572759  7486 raft_consensus.cc:493] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:37.572597  1441 catalog_manager.cc:5697] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index -1 to 9, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 11 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:37.573367  7486 raft_consensus.cc:515] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:37.576434  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.577800  7486 leader_election.cc:290] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:37.583679   431 raft_consensus.cc:2272] T 17c95b4249214135b23fe0bcbdcf8ad3 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.583940  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486718b388ed49eaafdc2e13d168a057" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.586455   431 tablet_replica.cc:333] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.589139   431 raft_consensus.cc:2243] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.589759   431 raft_consensus.cc:2272] T 96e20996757d4784ade11fe9799f7a13 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.592129  1511 leader_election.cc:304] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.592516   431 tablet_replica.cc:333] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.594084  7486 raft_consensus.cc:2749] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:37.596668  7580 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:37.597257  7580 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.599496  7580 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.600390  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.601886  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1669ae3f986d428ca0a51760ca20bc70" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.604300  1510 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.605000   431 raft_consensus.cc:2243] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.606168  7580 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:37.606254   431 raft_consensus.cc:2272] T 486718b388ed49eaafdc2e13d168a057 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.610472   431 tablet_replica.cc:333] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.622157   431 raft_consensus.cc:2243] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.622892   431 raft_consensus.cc:2272] T 7a24aaf5c9514244ae333d411f1fb4f5 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.635649  7580 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:37.636302  7580 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.636538  1688 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:37.635653   431 tablet_replica.cc:333] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.639386  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.642335  7580 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.642859  7486 raft_consensus.cc:493] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:37.643450  7486 raft_consensus.cc:515] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.645605  7486 leader_election.cc:290] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.642588  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bfe669a290453597d79375d2aadae5" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.639528   431 raft_consensus.cc:2243] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.647078   431 raft_consensus.cc:2272] T 9f61c89956d24976b4d464550172cd55 P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.647854  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.649220  1510 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.649880   431 tablet_replica.cc:333] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.650787   431 raft_consensus.cc:2243] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.651340   431 raft_consensus.cc:2272] T 1669ae3f986d428ca0a51760ca20bc70 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.651453  7486 raft_consensus.cc:493] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:37.651767  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece2ab6676aa475ba1e5a5d1b13fc569" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.651978  7486 raft_consensus.cc:515] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.653406  1511 leader_election.cc:304] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.654088   431 tablet_replica.cc:333] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.654393  7531 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.655103  7531 raft_consensus.cc:2749] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.655130  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.656502  7486 leader_election.cc:290] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.657112  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d969afe49dd43c2902adb01b5aa223b" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:37.659087  1509 leader_election.cc:304] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:37.660483  7580 raft_consensus.cc:2749] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.661484   431 raft_consensus.cc:2243] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.662184   431 raft_consensus.cc:2272] T 8f45eebdd49441fa87ca7768bae03d64 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:37.674458  1658 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:37.677876  1659 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a24aaf5c9514244ae333d411f1fb4f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:37.677295  1620 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:37.680241  7578 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:37.692936   431 tablet_replica.cc:333] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.693928   431 raft_consensus.cc:2243] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.694576   431 raft_consensus.cc:2272] T 8d969afe49dd43c2902adb01b5aa223b P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.711006  7580 raft_consensus.cc:493] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5dd1b367d5dd4e6abfd29fc2df2bed07)
I20260709 13:01:37.711678  7580 raft_consensus.cc:515] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:37.713958  7580 leader_election.cc:290] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:37.715095   431 tablet_replica.cc:333] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.715250  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:37.716337  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d6c15d42494c1cbf1914151dcfb5ac" candidate_uuid: "0cccd9c43f9747529680a8e7463961c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:37.718272   431 raft_consensus.cc:2243] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.719141  1510 leader_election.cc:304] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cccd9c43f9747529680a8e7463961c9; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:37.720243   431 raft_consensus.cc:2272] T ccb59a831c424786ae1c9dfd1db1f6d3 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.724231  7587 ts_tablet_manager.cc:933] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:37.721292  7580 raft_consensus.cc:2749] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:37.725999   431 tablet_replica.cc:333] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.727133   431 raft_consensus.cc:2243] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.728044   431 raft_consensus.cc:2272] T ce9fc6a855e249298263a94d04de35a4 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.736303  7578 raft_consensus.cc:2955] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 13:01:37.740031   431 tablet_replica.cc:333] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.742842  1620 raft_consensus.cc:2955] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } }
I20260709 13:01:37.754478   431 raft_consensus.cc:2243] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:37.755714   431 raft_consensus.cc:2272] T b2590e3864b048c4b1d12cec239acf7a P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.765413  1442 catalog_manager.cc:5697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index -1 to 11, NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:37.791687   431 tablet_replica.cc:333] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.792791   431 raft_consensus.cc:2243] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.793514   431 raft_consensus.cc:2272] T 6ef93a23494e4934beefa28be227bc72 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.805114  7587 tablet_copy_client.cc:323] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:46485
I20260709 13:01:37.809098   431 tablet_replica.cc:333] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.810248   431 raft_consensus.cc:2243] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.810892  1630 tablet_copy_service.cc:140] P e12d7b3551014757ba7dda3e83605b83: Received BeginTabletCopySession request for tablet 9e5e0874051d4aa6807636e553d51e6c from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:43404)
I20260709 13:01:37.811103   431 raft_consensus.cc:2272] T 5fb2b0bb91ba4b59bba638c371a86a1e P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.811499  1630 tablet_copy_service.cc:161] P e12d7b3551014757ba7dda3e83605b83: Beginning new tablet copy session on tablet 9e5e0874051d4aa6807636e553d51e6c from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:43404: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-9e5e0874051d4aa6807636e553d51e6c
I20260709 13:01:37.826467  1630 tablet_copy_source_session.cc:215] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:37.830607   431 tablet_replica.cc:333] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.848593   431 raft_consensus.cc:2243] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.849411   431 raft_consensus.cc:2272] T c21865842c3d4eafba995dd02f14b489 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.852339   431 tablet_replica.cc:333] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.853078   431 raft_consensus.cc:2243] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.861068   431 raft_consensus.cc:2272] T 90bfe669a290453597d79375d2aadae5 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.864352  7587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5e0874051d4aa6807636e553d51e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.865777   431 tablet_replica.cc:333] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.866761   431 raft_consensus.cc:2243] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.867437   431 raft_consensus.cc:2272] T 4e51c69bdb8c4616a20162792bc3e235 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.899428   431 tablet_replica.cc:333] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.900249   431 raft_consensus.cc:2243] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:37.901219   431 raft_consensus.cc:2272] T 0de7551eb2ca4d369ae826fcaebd0301 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.903905   431 tablet_replica.cc:333] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.904680   431 raft_consensus.cc:2243] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.905405   431 raft_consensus.cc:2272] T 7aeb3a1da10b4e5a8070d908a280055c P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.910226   431 tablet_replica.cc:333] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.910944   431 raft_consensus.cc:2243] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:37.911926   431 raft_consensus.cc:2272] T 1c3db709fac1489b928f0a9df67f0426 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.914462   431 tablet_replica.cc:333] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.915158   431 raft_consensus.cc:2243] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.915654   431 raft_consensus.cc:2272] T 4a0105ba6bf14860a95121a73725f62e P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.918061   431 tablet_replica.cc:333] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.918890   431 raft_consensus.cc:2243] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:37.919886   431 raft_consensus.cc:2272] T daa50dd25c7f47639f933e047d81de75 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.954938   431 tablet_replica.cc:333] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.955709   431 raft_consensus.cc:2243] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.973877   431 raft_consensus.cc:2272] T b3d6c15d42494c1cbf1914151dcfb5ac P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:37.971125  7587 tablet_copy_client.cc:806] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:37.977607  7587 tablet_copy_client.cc:670] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:37.981268   431 tablet_replica.cc:333] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:37.981814  7587 tablet_copy_client.cc:538] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:37.982497   431 raft_consensus.cc:2243] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:37.983263   431 raft_consensus.cc:2272] T f81118a8e62c4910be3913ae0e3f240d P 0cccd9c43f9747529680a8e7463961c9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.000453   431 tablet_replica.cc:333] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.001332   431 raft_consensus.cc:2243] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.002422   431 raft_consensus.cc:2272] T b37b7f2c08b145c6b88f543822a1cf5c P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.012236   431 tablet_replica.cc:333] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.013113   431 raft_consensus.cc:2243] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.014190   431 raft_consensus.cc:2272] T 4c492e0f519d422fb3a26617a5a4dbe6 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.023152   431 tablet_replica.cc:333] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.024057   431 raft_consensus.cc:2243] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.024833   431 raft_consensus.cc:2272] T 48f214986b534c7ea670b8ff7960e691 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.027695   431 tablet_replica.cc:333] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.028613   431 raft_consensus.cc:2243] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.046056   431 raft_consensus.cc:2272] T cba7ca1546e44219b4872d2d3ae34040 P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.048933   431 tablet_replica.cc:333] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.049777   431 raft_consensus.cc:2243] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.050514   431 raft_consensus.cc:2272] T 044356f91b2d4fe4a34deeb351b2fbac P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.053458   431 tablet_replica.cc:333] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.054281   431 raft_consensus.cc:2243] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.055378   431 raft_consensus.cc:2272] T 8f9fcd10c7c244bf918f2218237f5b3a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.049834  7587 tablet_bootstrap.cc:492] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 13:01:38.068234   431 tablet_replica.cc:333] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.069108   431 raft_consensus.cc:2243] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.073256   431 raft_consensus.cc:2272] T 4d3947e120494929a5b22c639f5d830c P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.076143   431 tablet_replica.cc:333] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.077037   431 raft_consensus.cc:2243] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.078274   431 raft_consensus.cc:2272] T ea97e615db7549b797908560563dd608 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.081122   431 tablet_replica.cc:333] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.081992   431 raft_consensus.cc:2243] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.090756   431 raft_consensus.cc:2272] T d9be6d7fbe2348e4a1be13e50f487f82 P 0cccd9c43f9747529680a8e7463961c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.108412   431 tablet_replica.cc:333] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.109237   431 raft_consensus.cc:2243] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.109899   431 raft_consensus.cc:2272] T 3485ff8d284d46bea80fa498e5f6d34a P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.136452   431 tablet_replica.cc:333] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.137337   431 raft_consensus.cc:2243] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.138513   431 raft_consensus.cc:2272] T 165cabe60a114b9ca5fda64711bd3163 P 0cccd9c43f9747529680a8e7463961c9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.155627   431 tablet_replica.cc:333] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.156374   431 raft_consensus.cc:2243] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.157414   431 raft_consensus.cc:2272] T 60ed567c64f3422894e8776f5815e0b8 P 0cccd9c43f9747529680a8e7463961c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.169194   431 tablet_replica.cc:333] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.169976   431 raft_consensus.cc:2243] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.172278   431 raft_consensus.cc:2272] T 5b4609f4058b459f804e03408773bd69 P 0cccd9c43f9747529680a8e7463961c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.176035   431 tablet_replica.cc:333] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.176806   431 raft_consensus.cc:2243] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.177443   431 raft_consensus.cc:2272] T 9e5e0874051d4aa6807636e553d51e6c P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.189276   431 tablet_replica.cc:333] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.219568  7592 ts_tablet_manager.cc:933] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:38.229879   431 raft_consensus.cc:2243] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:38.230527  7592 tablet_copy_client.cc:323] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 13:01:38.231316   431 raft_consensus.cc:2272] T 82622e43412243cb95bf17b246050060 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.242588  1703 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet 7a24aaf5c9514244ae333d411f1fb4f5 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 13:01:38.243368  1703 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet 7a24aaf5c9514244ae333d411f1fb4f5 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-7a24aaf5c9514244ae333d411f1fb4f5
I20260709 13:01:38.267153  1703 tablet_copy_source_session.cc:215] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:38.270614  7592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a24aaf5c9514244ae333d411f1fb4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:38.280809   431 tablet_replica.cc:333] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.281596   431 raft_consensus.cc:2243] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.282138   431 raft_consensus.cc:2272] T 5e675a1020ff48279e061c44c1a368ae P 0cccd9c43f9747529680a8e7463961c9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:38.284209  2241 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.300043  7592 tablet_copy_client.cc:806] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:38.300654  7592 tablet_copy_client.cc:670] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:38.305433  7592 tablet_copy_client.cc:538] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:38.329434   431 tablet_replica.cc:333] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.330375   431 raft_consensus.cc:2243] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.331022   431 raft_consensus.cc:2272] T 69b3c7e5df794f4baecc6be830fb8f80 P 0cccd9c43f9747529680a8e7463961c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.334622   431 tablet_replica.cc:333] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.335443   431 raft_consensus.cc:2243] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.336025   431 raft_consensus.cc:2272] T ece2ab6676aa475ba1e5a5d1b13fc569 P 0cccd9c43f9747529680a8e7463961c9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.372725  7587 tablet_bootstrap.cc:492] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:38.373646  7587 tablet_bootstrap.cc:492] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 13:01:38.374348  7587 ts_tablet_manager.cc:1403] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.325s	user 0.032s	sys 0.018s
I20260709 13:01:38.377909  7587 raft_consensus.cc:359] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:38.378813  7587 raft_consensus.cc:740] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 13:01:38.378996   431 tablet_replica.cc:333] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.379913   431 raft_consensus.cc:2243] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.380591   431 raft_consensus.cc:2272] T d53120c1adf947fd992e5950edf26301 P 0cccd9c43f9747529680a8e7463961c9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.383253   431 tablet_replica.cc:333] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9: stopping tablet replica
I20260709 13:01:38.384099   431 raft_consensus.cc:2243] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:38.385006   431 raft_consensus.cc:2272] T 8a483be3e3ee4d5381336b0877760ca9 P 0cccd9c43f9747529680a8e7463961c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:38.390202  7592 tablet_bootstrap.cc:492] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
I20260709 13:01:38.403715  7587 consensus_queue.cc:260] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:38.415196  7587 ts_tablet_manager.cc:1434] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.001s
I20260709 13:01:38.417148  1630 tablet_copy_service.cc:342] P e12d7b3551014757ba7dda3e83605b83: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-9e5e0874051d4aa6807636e553d51e6c received from {username='slave'} at 127.0.0.1:43404
I20260709 13:01:38.417634  1630 tablet_copy_service.cc:434] P e12d7b3551014757ba7dda3e83605b83: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-9e5e0874051d4aa6807636e553d51e6c on tablet 9e5e0874051d4aa6807636e553d51e6c with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:38.435417  1658 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.444394  2272 raft_consensus.cc:1217] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
W20260709 13:01:38.444656  2241 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.519205  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.525493  1658 consensus_peers.cc:597] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.606817  2241 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.618697  7592 tablet_bootstrap.cc:492] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:38.619766  7592 tablet_bootstrap.cc:492] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
I20260709 13:01:38.620541  7592 ts_tablet_manager.cc:1403] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.231s	user 0.031s	sys 0.011s
W20260709 13:01:38.621804  1658 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.645761  7592 raft_consensus.cc:359] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:38.646826  7592 raft_consensus.cc:740] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 13:01:38.647581  7592 consensus_queue.cc:260] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:01:38.658234  1584 consensus_peers.cc:597] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.673184  7592 ts_tablet_manager.cc:1434] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:01:38.676764  7422 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:38.677333  7422 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:38.680442  7422 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:38.683871  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:38.688341  1703 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-7a24aaf5c9514244ae333d411f1fb4f5 received from {username='slave'} at 127.0.0.1:52426
W20260709 13:01:38.688663  1658 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:38.688777  1703 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-7a24aaf5c9514244ae333d411f1fb4f5 on tablet 7a24aaf5c9514244ae333d411f1fb4f5 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:38.689180  1658 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:38.689877  7422 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:38.719390  1584 consensus_peers.cc:597] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.723121  2272 raft_consensus.cc:1217] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
W20260709 13:01:38.741711  1658 consensus_peers.cc:597] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.750460  1658 consensus_peers.cc:597] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.807597  2241 connection.cc:573] client connection to 127.0.107.193:42041 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:01:38.810082  7570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45390 (request call id 1381) took 1950 ms. Trace:
I20260709 13:01:38.810460  7570 rpcz_store.cc:276] 0709 13:01:36.859547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.859681 (+   134us) service_pool.cc:224] Handling call
0709 13:01:37.043458 (+183777us) ts_tablet_manager.cc:934] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
0709 13:01:37.268352 (+224894us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4c003713c0. stack: 00007f29e8c86343 00007f29e8c86240 00007f29e86151d4 00007f29f2353304 00007f29f2353299 00007f29ea071a20 00007f29ea082a29 00007f29ea08313f 00007f29ea0472ab 00007f29ea074f3c 00007f29ea075461 00007f29ea075768 00007f29efdfb2eb 00007f29f0d20d3b 00007f29f0d1b008 00007f29f0d1a405
0709 13:01:38.809976 (+1541624us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":34835,"spinlock_wait_cycles":12821376,"tablet-copy.queue_time_us":182904,"thread_start_us":213603,"threads_started":2}
W20260709 13:01:38.812045  2243 connection.cc:466] server connection from 127.0.0.1:45390 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45390 (request call id 1381) could send its response
W20260709 13:01:38.832013  2241 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.832742  1658 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.835631  7495 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:38.836154  7495 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:38.840886  7495 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:38.859431  1658 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.880200  7536 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:38.880774  7536 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:38.881861  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:38.882491  1688 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:38.882956  7536 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:38.884377  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:38.890756  1658 leader_election.cc:336] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:38.891182  1658 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:38.892266  7536 raft_consensus.cc:2749] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:38.893224  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:38.897294  7522 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:38.897701  7522 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:38.898026  7522 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:38.901325  2241 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.906620  1584 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:38.906862  7522 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:38.907500  1584 consensus_peers.cc:597] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.908861  7522 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:38.911355  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c95b4249214135b23fe0bcbdcf8ad3" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:38.911931  1688 raft_consensus.cc:3060] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:38.913005  1584 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:38.918282  1688 raft_consensus.cc:2468] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:38.919624  1584 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:38.920670  7522 raft_consensus.cc:2804] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:38.921833  7522 raft_consensus.cc:697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:38.923045  7522 consensus_queue.cc:237] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:38.974287  1584 consensus_peers.cc:597] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.982343  7524 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:01:38.982546  1584 consensus_peers.cc:597] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.982955  7524 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:38.984897  7524 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:38.987829  1442 catalog_manager.cc:5697] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 15 to 16, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:38.995555  2241 leader_election.cc:336] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:38.995440  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:39.003177  1584 consensus_peers.cc:597] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:39.006124  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:39.006881  7501 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:39.015460  7422 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.016044  7422 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.018525  7422 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:39.022328  1658 consensus_peers.cc:597] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:39.024921  2241 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:39.028632  1658 leader_election.cc:336] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.036362  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:39.039122  1659 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:39.040283  7422 raft_consensus.cc:2749] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.068286  7495 raft_consensus.cc:1064] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 13:01:39.072885  7495 consensus_queue.cc:237] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.090917  7522 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.091518  7522 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
W20260709 13:01:39.092721  1658 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:39.093195  1658 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:39.101239  1584 leader_election.cc:336] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.103227  7522 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.104373  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.105726  1584 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:39.106986  7522 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:39.119674  2272 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEARNER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:39.121042  7522 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:39.151234  1686 raft_consensus.cc:1275] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:39.154007  7606 consensus_queue.cc:1048] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:39.155140  1584 consensus_peers.cc:597] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:39.169142  1584 consensus_peers.cc:597] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.174293  7524 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.174922  7524 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.176934  7524 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:39.185065  2241 leader_election.cc:336] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.186353  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.187080  1688 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:39.188403  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:39.189172  7524 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:39.189555  7524 raft_consensus.cc:493] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.189927  7524 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.196913  7524 raft_consensus.cc:515] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:39.205461  2241 leader_election.cc:336] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.208333  1658 consensus_peers.cc:597] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:39.220374  1658 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:39.222409  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2590e3864b048c4b1d12cec239acf7a" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:39.223004  1687 raft_consensus.cc:3060] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.235113  1687 raft_consensus.cc:2468] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:39.236057  2241 leader_election.cc:304] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:39.237401  7536 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.237955  7536 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.239950  7536 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:39.241298  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:39.242029  7536 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.242527  7536 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.245378  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:39.245994  2272 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:39.246969  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.247732  7422 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:39.248101  7422 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.248468  7422 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:39.252722  7536 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:39.259986  7422 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.260485  7536 raft_consensus.cc:1064] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 13:01:39.273834  7610 raft_consensus.cc:2804] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:39.277271  7613 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
W20260709 13:01:39.278853  7607 log.cc:927] Time spent T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:39.252827  7524 leader_election.cc:290] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.277777  7613 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:39.284029  2243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 54337.2us
I20260709 13:01:39.281083  7610 raft_consensus.cc:697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:39.287724  7610 consensus_queue.cc:237] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:39.291483  1658 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.291930  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:39.292801  1658 leader_election.cc:336] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.297133  7611 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.298488  7611 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.295074  7609 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:39.324658  7422 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:39.325197  7422 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.325424  7611 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:39.325661  7422 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.310105  7536 consensus_queue.cc:237] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.327572  7606 raft_consensus.cc:2955] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:39.328980  7422 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:39.331151  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7551eb2ca4d369ae826fcaebd0301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:39.331705  2272 raft_consensus.cc:3060] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:39.344074  7501 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.344673  7501 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.346719  7501 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.353205  7613 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:39.354285  2241 leader_election.cc:336] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.362709  2241 leader_election.cc:336] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.365254  2241 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:39.375011  2272 raft_consensus.cc:2468] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 18.
I20260709 13:01:39.377820  1659 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.379638  7422 raft_consensus.cc:2804] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:39.380167  7422 raft_consensus.cc:697] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:39.380245  7495 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.382196  7495 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.382416  7422 consensus_queue.cc:237] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.383000  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:39.384335  7495 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:39.385864  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 77916.3us
I20260709 13:01:39.386842  7610 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.387384  7610 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.390125  7609 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.390623  7609 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:39.392045  7610 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.391950  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:39.394090  7609 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:39.390632  7615 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.395021  7615 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.395947  1615 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:39.397033  7615 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.400170  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:39.405269  2241 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.408495  2241 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:39.410365  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:39.410105  1442 catalog_manager.cc:5697] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 12 to 13, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.415308  2243 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:39.416141  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.416275  7612 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:39.416875  7422 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:39.417238  7422 raft_consensus.cc:493] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.417562  7422 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:39.420465  1584 consensus_peers.cc:597] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:39.426616  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:39.428885  7422 raft_consensus.cc:515] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.431486  2272 raft_consensus.cc:2955] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:39.436873  7422 leader_election.cc:290] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:39.437441  7615 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.438084  7615 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.439735  7422 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.440021  7615 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.440232  7422 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.443274  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:39.443778  1611 raft_consensus.cc:3060] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:39.450394  7620 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.450981  7620 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.452859  7612 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.453394  7612 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.455439  7612 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.456836  7620 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.457641  1611 raft_consensus.cc:2468] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 18.
I20260709 13:01:39.462406  7620 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.462893  7620 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.463130  1660 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.467269  7609 raft_consensus.cc:2804] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:39.467763  7609 raft_consensus.cc:697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:39.468576  7609 consensus_queue.cc:237] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.471776  7611 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.472280  7611 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.474427  7611 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:39.474824  1442 catalog_manager.cc:5697] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 9 to 10, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.492203  7611 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.496037  7622 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.496615  7622 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.496490  7611 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:39.498926  7620 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.499732  7622 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:39.491343  1441 catalog_manager.cc:5697] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 17 to 18, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.500989  7611 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:39.494891  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:39.504812  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:39.509102  2272 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:39.505117  7422 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:39.506851  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
W20260709 13:01:39.494925  1584 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.507476  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:39.510357  1620 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
W20260709 13:01:39.510488  1584 consensus_peers.cc:597] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.510572  1615 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
W20260709 13:01:39.513125  2241 leader_election.cc:336] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.511565  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:39.523537  2273 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 15.
W20260709 13:01:39.511236  1584 leader_election.cc:336] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.525239  7495 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.525739  7495 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:39.527701  7495 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
I20260709 13:01:39.528772  7422 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.531276  7422 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.533622  7422 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:39.554530  1584 leader_election.cc:336] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.555145  1584 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.560153  1687 raft_consensus.cc:2955] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:39.575338  1584 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.588465  1584 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.591585  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.592260  1693 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 12.
I20260709 13:01:39.593453  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa50dd25c7f47639f933e047d81de75" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.594973  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.595155  1693 raft_consensus.cc:1275] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:39.595528  1687 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 11.
I20260709 13:01:39.597149  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.598304  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.598615  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.597391  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.599066  1689 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 13.
I20260709 13:01:39.599251  1692 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 12.
I20260709 13:01:39.599472  1686 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 17.
I20260709 13:01:39.598374  1688 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 14.
W20260709 13:01:39.599872  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 94952.1us
I20260709 13:01:39.596509  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.600281  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.600854  1687 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:39.600952  1694 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:39.608299  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:39.608865  2271 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:39.610049  2273 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:39.615945  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.616684  7622 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:39.617033  7622 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.617378  7622 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.625098  7622 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.627147  7622 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:39.628182  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.629168  7626 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:39.630102  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:39.630851  7626 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.631011  2273 raft_consensus.cc:3060] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.631285  7626 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.629992  7627 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:39.629604  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 122431us
I20260709 13:01:39.641194  1615 raft_consensus.cc:1275] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:39.646174  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.648645  7616 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.649088  7616 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.649451  7616 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.655063  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.655869  7628 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:39.656291  7628 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.656675  7628 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.657691  7495 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.658236  7495 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.663223  7625 consensus_queue.cc:1048] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:39.637738  2273 raft_consensus.cc:2468] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
W20260709 13:01:39.667625  1584 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.669020  7628 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:39.674451  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:39.674959  7495 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:39.675081  2271 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:39.675601  7628 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:39.679941  1659 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.680932  7622 raft_consensus.cc:2804] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:39.681399  7622 raft_consensus.cc:697] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:39.682384  7622 consensus_queue.cc:237] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.685385  7626 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.695921  7626 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:39.699790  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165cabe60a114b9ca5fda64711bd3163" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.701360  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3db709fac1489b928f0a9df67f0426" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:39.701931  2273 raft_consensus.cc:3060] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:39.707151  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46485, user_credentials={real_user=slave}} blocked reactor thread for 44160.4us
I20260709 13:01:39.710876  2273 raft_consensus.cc:2468] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:39.711019  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea97e615db7549b797908560563dd608" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:39.711634  1620 raft_consensus.cc:3060] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.711841  1659 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.716791  7625 raft_consensus.cc:2804] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:39.678115  7616 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.718662  7625 raft_consensus.cc:697] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:39.720286  1620 raft_consensus.cc:2468] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:39.720048  7625 consensus_queue.cc:237] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.728056  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:39.728890  7610 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:39.729262  7610 raft_consensus.cc:493] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.729460  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:39.730268  7612 raft_consensus.cc:2764] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:39.729643  7610 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.731858  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:39.733114  1584 leader_election.cc:304] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:39.734771  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:39.734921  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:39.735816  1693 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:39.736622  1660 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:39.737605  7606 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:39.738798  7615 raft_consensus.cc:2749] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:39.739687  7620 consensus_queue.cc:1048] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:39.741400  7606 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.741925  7606 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.741358  7615 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.742091  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:39.742650  7615 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.743028  7613 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.743080  7615 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:39.745491  1658 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.745975  1658 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:39.746308  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:39.747162  7495 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:39.747606  7495 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.747967  7495 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:39.753139  7615 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.753650  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:39.755211  7615 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.755775  7620 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:39.756166  7620 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.756531  7620 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:39.759526  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:39.758881  7536 raft_consensus.cc:2804] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:39.763370  7610 raft_consensus.cc:515] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:39.765627  7610 leader_election.cc:290] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:39.770543  2241 leader_election.cc:336] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.770654  7495 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:39.774354  7616 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:39.778367  7536 raft_consensus.cc:697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:39.779359  7536 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:39.780140  7620 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.782111  7620 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.783052  7627 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:39.783282  1658 leader_election.cc:336] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.784082  1658 leader_election.cc:336] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.785580  1658 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.785969  1658 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:39.787276  7627 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:39.788491  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:39.789239  1611 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e2a2b76c98ee44ff95e6508c34da0e3d in current term 12: Already voted for candidate e12d7b3551014757ba7dda3e83605b83 in this term.
W20260709 13:01:39.789911  1658 leader_election.cc:336] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.775615  7495 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 election: Requested vote from peers e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
W20260709 13:01:39.798787  1584 leader_election.cc:336] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.800817  1658 leader_election.cc:336] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.801679  1658 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.802103  1658 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:39.804100  1658 leader_election.cc:336] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.805126  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:01:39.805166  1658 leader_election.cc:336] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.806080  1658 leader_election.cc:336] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.806770  1658 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.807291  1658 leader_election.cc:336] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.803764  7620 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:39.804250  7628 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:39.820369  1584 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.823422  7617 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:39.824865  7617 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.821924  7620 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0cccd9c43f9747529680a8e7463961c9)
I20260709 13:01:39.825232  7617 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:39.826252  1584 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.828492   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1566)
I20260709 13:01:39.822970  7606 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.836848  7606 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.837430  7620 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.836522  7617 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:39.841614  1584 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.843794  7617 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:39.845206  1658 leader_election.cc:336] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.845158  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:39.846976  2271 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:39.847097  1658 leader_election.cc:336] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:39.853586  1584 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.860769  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:39.861605  1688 raft_consensus.cc:2393] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e12d7b3551014757ba7dda3e83605b83 in current term 12: Already voted for candidate e2a2b76c98ee44ff95e6508c34da0e3d in this term.
I20260709 13:01:39.871893  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ed567c64f3422894e8776f5815e0b8" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:39.872524  1694 raft_consensus.cc:3060] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:39.874197  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba7ca1546e44219b4872d2d3ae34040" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:39.874806  1688 raft_consensus.cc:3060] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:39.876025  1611 raft_consensus.cc:2955] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:39.879868  1694 raft_consensus.cc:2468] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 18.
W20260709 13:01:39.883081  2241 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.884008  1688 raft_consensus.cc:2468] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 15.
I20260709 13:01:39.874440  7628 raft_consensus.cc:2955] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:39.891830  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3947e120494929a5b22c639f5d830c" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:39.892526  1694 raft_consensus.cc:3060] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.893451  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:39.894006  1688 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.895123  2271 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:39.900517  1694 raft_consensus.cc:2468] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 13.
W20260709 13:01:39.904299  1658 leader_election.cc:336] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.904675  1658 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:39.906729  1688 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 16.
I20260709 13:01:39.910162  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b7f2c08b145c6b88f543822a1cf5c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:39.910755  1689 raft_consensus.cc:3060] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.910784  7622 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.912842  1685 raft_consensus.cc:1275] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:39.907791  7620 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:39.918664  7620 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:39.934707  1689 raft_consensus.cc:2468] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:39.934870  2271 raft_consensus.cc:1275] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:01:39.936393  1584 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:39.937551  1441 catalog_manager.cc:5697] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 17 to 18, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.934125  1442 catalog_manager.cc:5697] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: config changed from index 11 to 12, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:39.946517  7622 consensus_queue.cc:1048] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:39.944350  1441 catalog_manager.cc:5697] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 12 to 13, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.949136  1441 catalog_manager.cc:5697] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 12 to 13, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:39.953869  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 45068.2us
I20260709 13:01:39.959070  1611 raft_consensus.cc:1275] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:39.961772  7625 consensus_queue.cc:1048] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:39.980712  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9fcd10c7c244bf918f2218237f5b3a" candidate_uuid: "e12d7b3551014757ba7dda3e83605b83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:39.981436  1689 raft_consensus.cc:3060] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:39.990491  1658 consensus_peers.cc:597] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.005545  1584 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:40.013783  1584 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:40.014873  1584 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:40.015275  7606 raft_consensus.cc:2749] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.008071  7610 consensus_queue.cc:1048] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:01:40.002298  1689 raft_consensus.cc:2468] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12d7b3551014757ba7dda3e83605b83 in term 17.
I20260709 13:01:40.031167  7606 raft_consensus.cc:2804] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:40.039152  7606 raft_consensus.cc:697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 18 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:40.040159  7606 consensus_queue.cc:237] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:40.030956  7617 raft_consensus.cc:2804] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:40.043394  7617 raft_consensus.cc:697] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 15 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:40.044261  7617 consensus_queue.cc:237] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:40.046800  2241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 64724.3us
I20260709 13:01:40.047715  2241 leader_election.cc:304] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:40.054807  7612 raft_consensus.cc:2804] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:40.064848  1441 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 16 to 17, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:40.099627  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35447, user_credentials={real_user=slave}} blocked reactor thread for 72081us
I20260709 13:01:40.140925  2271 raft_consensus.cc:2955] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:40.131968  7612 raft_consensus.cc:697] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:40.152799  1584 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
W20260709 13:01:40.165431  1658 consensus_peers.cc:597] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.181161  7643 raft_consensus.cc:2804] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:40.181744  7643 raft_consensus.cc:697] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:40.182642  7643 consensus_queue.cc:237] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:40.186182  1584 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:40.187106  7612 consensus_queue.cc:237] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:40.187856  1584 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:40.188741  7522 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:40.189250  7522 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:40.189497  7615 raft_consensus.cc:2804] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:40.192369  1658 consensus_peers.cc:597] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.190203  7615 raft_consensus.cc:697] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 17 LEADER]: Becoming Leader. State: Replica: e12d7b3551014757ba7dda3e83605b83, State: Running, Role: LEADER
I20260709 13:01:40.194816  7615 consensus_queue.cc:237] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:40.198300  2272 raft_consensus.cc:1275] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:40.200659  7626 consensus_queue.cc:1048] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:40.190248  7522 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:40.314208  1611 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:40.360993  7609 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:40.414878  1442 catalog_manager.cc:5697] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 13 to 14, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:40.431983  1659 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801): Couldn't send request to peer 5dd1b367d5dd4e6abfd29fc2df2bed07. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea97e615db7549b797908560563dd608. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.436852  2274 raft_consensus.cc:1275] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:01:40.439113  1658 consensus_peers.cc:597] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:40.448289  1658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 57870us
I20260709 13:01:40.453661  7626 consensus_queue.cc:1048] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:40.562136  1689 raft_consensus.cc:1275] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:01:40.563283  1658 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.623998  7606 consensus_queue.cc:1048] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:40.631937  1689 raft_consensus.cc:1275] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:40.654973  7606 consensus_queue.cc:1048] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:40.659996  1685 raft_consensus.cc:1275] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:01:40.661522  1584 consensus_peers.cc:597] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:40.673722  2241 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.666757  1442 catalog_manager.cc:5697] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 17 to 18, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.690155  7606 consensus_queue.cc:1048] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:40.696302  1442 catalog_manager.cc:5697] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 12 to 13, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.703284  1442 catalog_manager.cc:5697] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 14 to 15, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:40.713992  1584 consensus_peers.cc:597] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.728263  1689 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:40.736696  1689 raft_consensus.cc:1275] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:40.738651  7641 consensus_queue.cc:1048] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:40.714834  1442 catalog_manager.cc:5697] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 16 to 17, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.745599  7606 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:01:40.756338  1584 consensus_peers.cc:597] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.741374  1442 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 reported cstate change: term changed from 15 to 16, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e12d7b3551014757ba7dda3e83605b83 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.765600  1688 raft_consensus.cc:1275] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:40.772289  7606 consensus_queue.cc:1048] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:40.824043  1584 consensus_peers.cc:597] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:40.829069   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1566)
W20260709 13:01:40.844966  1584 consensus_peers.cc:597] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.894345  2272 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:40.898506  7495 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:40.931612  1658 consensus_peers.cc:597] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:40.935031  1658 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:40.945741  2241 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:40.969316  2241 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:40.978719  7669 ts_tablet_manager.cc:933] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Initiating tablet copy from peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:41.015129  7669 tablet_copy_client.cc:323] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:35447
I20260709 13:01:41.018347  1703 tablet_copy_service.cc:140] P e2a2b76c98ee44ff95e6508c34da0e3d: Received BeginTabletCopySession request for tablet ea97e615db7549b797908560563dd608 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 ({username='slave'} at 127.0.0.1:52426)
I20260709 13:01:41.019035  1703 tablet_copy_service.cc:161] P e2a2b76c98ee44ff95e6508c34da0e3d: Beginning new tablet copy session on tablet ea97e615db7549b797908560563dd608 from peer 5dd1b367d5dd4e6abfd29fc2df2bed07 at {username='slave'} at 127.0.0.1:52426: session id = 5dd1b367d5dd4e6abfd29fc2df2bed07-ea97e615db7549b797908560563dd608
W20260709 13:01:41.027536  1658 consensus_peers.cc:597] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:41.053755  1703 tablet_copy_source_session.cc:215] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:41.065688  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea97e615db7549b797908560563dd608. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:41.082298  2241 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.084777  1584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42041, user_credentials={real_user=slave}} blocked reactor thread for 109926us
I20260709 13:01:41.150063  7669 tablet_copy_client.cc:806] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:41.150863  7669 tablet_copy_client.cc:670] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Starting download of 1 WAL segments...
W20260709 13:01:41.411523  1584 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111) [suppressed 375 similar messages]
W20260709 13:01:41.486629  2241 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.503492  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 45296.1us
I20260709 13:01:41.571038  7673 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.571758  7673 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:41.574862  7673 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:41.577899  1584 consensus_peers.cc:597] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.579025  1584 consensus_peers.cc:597] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.586460  1584 consensus_peers.cc:597] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.595218  1584 consensus_peers.cc:597] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.606657  1584 consensus_peers.cc:597] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.668890  1584 consensus_peers.cc:597] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:41.716256  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83" is_pre_election: true
I20260709 13:01:41.717061  1616 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:41.728376  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:41.729362  7686 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:41.729780  7686 raft_consensus.cc:493] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.730095  7686 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.754155  7669 tablet_copy_client.cc:538] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:41.764104  7669 tablet_bootstrap.cc:492] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap starting.
W20260709 13:01:41.771875  1658 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.772661  1658 consensus_peers.cc:597] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:41.767491  7686 raft_consensus.cc:515] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:41.773073  1658 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.773526  1658 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:41.781553  7686 leader_election.cc:290] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:41.781847  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c492e0f519d422fb3a26617a5a4dbe6" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e12d7b3551014757ba7dda3e83605b83"
I20260709 13:01:41.782476  1615 raft_consensus.cc:3060] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:41.787850  1658 leader_election.cc:336] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:41.790968  1658 leader_election.cc:336] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:41.791457  1615 raft_consensus.cc:2468] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:41.795634  1660 leader_election.cc:304] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9
I20260709 13:01:41.798525  7625 raft_consensus.cc:2804] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:41.799084  7625 raft_consensus.cc:697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:41.800096  7625 consensus_queue.cc:237] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:41.806161  1584 consensus_peers.cc:597] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.829630   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1566)
W20260709 13:01:41.833081  2241 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:41.837677  1440 catalog_manager.cc:5697] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 11 to 13, leader changed from 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:41.895622  2241 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.942278  1658 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:41.959836  1584 consensus_peers.cc:597] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:41.963493  1658 consensus_peers.cc:597] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:42.016032  7669 tablet_bootstrap.cc:492] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:42.017115  7669 tablet_bootstrap.cc:492] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Bootstrap complete.
W20260709 13:01:42.021026  1658 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:42.025672  7669 ts_tablet_manager.cc:1403] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent bootstrapping tablet: real 0.262s	user 0.061s	sys 0.015s
I20260709 13:01:42.032043  7669 raft_consensus.cc:359] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:42.035678  7669 raft_consensus.cc:740] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Initialized, Role: LEARNER
I20260709 13:01:42.036321  7669 consensus_queue.cc:260] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } }
I20260709 13:01:42.039184  7669 ts_tablet_manager.cc:1434] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
W20260709 13:01:42.046598  2241 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:42.058988  1703 tablet_copy_service.cc:342] P e2a2b76c98ee44ff95e6508c34da0e3d: Request end of tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-ea97e615db7549b797908560563dd608 received from {username='slave'} at 127.0.0.1:52426
I20260709 13:01:42.059445  1703 tablet_copy_service.cc:434] P e2a2b76c98ee44ff95e6508c34da0e3d: ending tablet copy session 5dd1b367d5dd4e6abfd29fc2df2bed07-ea97e615db7549b797908560563dd608 on tablet ea97e615db7549b797908560563dd608 with peer 5dd1b367d5dd4e6abfd29fc2df2bed07
W20260709 13:01:42.060848  1658 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:42.098552  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:42.120795  1584 consensus_peers.cc:597] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:42.160830  2241 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:42.171718  2274 raft_consensus.cc:1217] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 LEARNER]: Deduplicated request from leader. Original: 16.12->[17.13-17.13]   Dedup: 17.13->[]
W20260709 13:01:42.181538  1584 consensus_peers.cc:597] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:42.188274  1658 consensus_peers.cc:597] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:42.192178  1641 debug-util.cc:398] Leaking SignalData structure 0x7b0800269840 after lost signal to thread 434
W20260709 13:01:42.193315  1641 debug-util.cc:398] Leaking SignalData structure 0x7b08002864e0 after lost signal to thread 1477
W20260709 13:01:42.194656  1641 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9980 after lost signal to thread 1644
W20260709 13:01:42.195851  1641 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba520 after lost signal to thread 1718
W20260709 13:01:42.197103  1641 debug-util.cc:398] Leaking SignalData structure 0x7b0800278000 after lost signal to thread 2301
W20260709 13:01:42.313642  1658 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:42.419271  1658 consensus_peers.cc:597] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.432727  1616 raft_consensus.cc:1275] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:42.436069  7686 consensus_queue.cc:1048] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:42.517946  1658 consensus_peers.cc:597] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:42.636791  7675 raft_consensus.cc:1064] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: attempting to promote NON_VOTER 5dd1b367d5dd4e6abfd29fc2df2bed07 to VOTER
I20260709 13:01:42.639575  7675 consensus_queue.cc:237] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:42.641595  2241 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:42.694823  1615 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:42.695242  2274 raft_consensus.cc:1275] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 LEARNER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:42.697754  7673 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:42.700495  7673 consensus_queue.cc:1048] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:42.775404  7704 raft_consensus.cc:2955] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 12 to 14, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:42.802521  1658 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:42.802467  1616 raft_consensus.cc:2955] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 12 to 14, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:42.811349  2274 raft_consensus.cc:2955] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 12 to 14, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:42.820500  1440 catalog_manager.cc:5697] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: config changed from index 12 to 14, 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:42.830060   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1566)
W20260709 13:01:43.066293  1658 consensus_peers.cc:597] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:43.097826  1658 consensus_peers.cc:597] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:43.189888  1584 consensus_peers.cc:597] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:43.233296  1658 consensus_peers.cc:597] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.245602  1584 consensus_peers.cc:597] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:43.279870  1584 consensus_peers.cc:597] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:43.339318  2241 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:43.342897  1658 consensus_peers.cc:597] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:43.466868  1615 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:43.474803  2241 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.491446  1584 consensus_peers.cc:597] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:43.491856  2274 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:43.505838  7606 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:43.522825  1688 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Refusing update from remote peer e12d7b3551014757ba7dda3e83605b83: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:43.526270  7606 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 5 to 14, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:43.529915  2274 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 5 to 14, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
I20260709 13:01:43.554701  7654 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:43.555444  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82622e43412243cb95bf17b246050060 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 13:01:43.564503  1442 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: config changed from index 5 to 14, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New cstate: current_term: 16 leader_uuid: "e12d7b3551014757ba7dda3e83605b83" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:43.581380  1658 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:43.606231  1688 raft_consensus.cc:2955] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 5 to 14, VOTER 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } } }
W20260709 13:01:43.611292  1584 consensus_peers.cc:597] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.628751  1658 consensus_peers.cc:597] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.629462  1658 consensus_peers.cc:597] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.656284  2241 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.693629  1658 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.768960  1584 consensus_peers.cc:597] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.813365  2241 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.830540   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1566)
W20260709 13:01:43.838330  1428 catalog_manager.cc:4755] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 82622e43412243cb95bf17b246050060: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:43.848641  1658 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.904435  1584 consensus_peers.cc:597] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:43.933986  2241 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.036827  2241 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.061180  1658 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.086408  1584 consensus_peers.cc:597] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.103396  1584 consensus_peers.cc:597] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.188800  1584 consensus_peers.cc:597] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.301478  1584 consensus_peers.cc:597] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.340173  2241 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.463356  2241 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.516834  1658 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.530421  1584 consensus_peers.cc:597] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:44.579022  1658 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.588229  1658 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.631016  1658 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:44.678257  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.714855  1658 consensus_peers.cc:597] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.714911  1584 consensus_peers.cc:597] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:44.731359  1658 consensus_peers.cc:597] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.745379  1584 consensus_peers.cc:597] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.765933  2241 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:44.831002   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1566)
W20260709 13:01:44.986084  1658 consensus_peers.cc:597] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:45.047091  1658 consensus_peers.cc:597] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:45.116073  1658 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:45.154734  1428 catalog_manager.cc:4755] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 82622e43412243cb95bf17b246050060: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:45.380990  2241 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:45.408110  1658 consensus_peers.cc:597] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:45.522781  1658 consensus_peers.cc:597] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:45.554651  1658 consensus_peers.cc:597] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:45.580547  1584 consensus_peers.cc:597] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:45.642544  1584 consensus_peers.cc:597] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:45.685339  1584 consensus_peers.cc:597] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:45.831698   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1566)
W20260709 13:01:45.929589  1658 consensus_peers.cc:597] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:45.962978  1584 consensus_peers.cc:597] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:45.970955  1658 consensus_peers.cc:597] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:45.980291  2241 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:46.010538  1584 consensus_peers.cc:597] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:46.016323  1658 consensus_peers.cc:597] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:46.035339  1658 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.152326  2241 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.156538  1658 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.170885  1584 consensus_peers.cc:597] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.190470  2241 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.276981  1428 catalog_manager.cc:4755] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 82622e43412243cb95bf17b246050060: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:46.298772  1658 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.370121  2241 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.409904  2241 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.415941  1584 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111) [suppressed 461 similar messages]
W20260709 13:01:46.422870  1584 consensus_peers.cc:597] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.428663  2241 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.631158  1658 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.666170  1584 consensus_peers.cc:597] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.768520  1584 consensus_peers.cc:597] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.824132  1584 consensus_peers.cc:597] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.852514  2241 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:46.982577  1584 consensus_peers.cc:597] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:47.012048  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.041389  1584 consensus_peers.cc:597] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.091590  1658 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:47.096179  1658 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.132335  1658 consensus_peers.cc:597] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.132876  1658 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.136406  2241 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.185896  1658 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.339936  1584 consensus_peers.cc:597] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.398293  1658 consensus_peers.cc:597] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.432984  1584 consensus_peers.cc:597] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:47.499958  2241 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:47.535368  1658 consensus_peers.cc:597] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:47.673933  1658 consensus_peers.cc:597] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:47.695353  2241 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:47.756683  1658 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:48.030571  1658 consensus_peers.cc:597] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:48.071640  1584 consensus_peers.cc:597] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:48.093825  1584 consensus_peers.cc:597] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:48.170495  1658 consensus_peers.cc:597] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:48.226150   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:48.271708  1658 consensus_peers.cc:597] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:48.352064  1584 consensus_peers.cc:597] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:48.353003  1658 consensus_peers.cc:597] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:48.364342  2241 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:48.369475  1428 catalog_manager.cc:4755] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 82622e43412243cb95bf17b246050060: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:48.471963   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:48.481142  2243 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.481825  1658 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:48.482791  1584 consensus_peers.cc:597] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:48.491444  2243 consensus_peers.cc:597] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.514690  2243 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.523995  1660 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.531605  1660 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.528651  1658 consensus_peers.cc:597] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:48.551275  2243 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.591624  2243 consensus_peers.cc:597] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.591745  1660 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.632586  1584 consensus_peers.cc:597] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:48.648455  1584 consensus_peers.cc:597] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:48.651014  1660 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.680835  1658 consensus_peers.cc:597] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:48.687525  2243 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.700172   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:48.710984   431 tablet_replica.cc:333] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.712044   431 raft_consensus.cc:2243] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.713199   431 raft_consensus.cc:2272] T 3cd03248480b4bfd8a76471850708909 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.716323   431 tablet_replica.cc:333] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.717270   431 raft_consensus.cc:2243] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.717958   431 raft_consensus.cc:2272] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.721091   431 tablet_replica.cc:333] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
W20260709 13:01:48.721148  1658 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:48.722054   431 raft_consensus.cc:2243] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.722873   431 raft_consensus.cc:2272] T 486718b388ed49eaafdc2e13d168a057 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.725433   431 tablet_replica.cc:333] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.731012   431 raft_consensus.cc:2243] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.731699   431 raft_consensus.cc:2272] T 1532fbff9860493fa0fbdf5eb1b21242 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.734884  1660 consensus_peers.cc:597] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.748243   431 tablet_replica.cc:333] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.749359   431 raft_consensus.cc:2243] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.750595   431 raft_consensus.cc:2272] T b25acf355940411ba0ffd6483b7467c3 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.753218   431 tablet_replica.cc:333] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.754103   431 raft_consensus.cc:2243] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.754740   431 raft_consensus.cc:2272] T ce9fc6a855e249298263a94d04de35a4 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.757324   431 tablet_replica.cc:333] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.758142   431 raft_consensus.cc:2243] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.758880   431 raft_consensus.cc:2272] T 1f35127b66604c1685f1fbe404840774 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.761663   431 tablet_replica.cc:333] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
W20260709 13:01:48.762771  2243 consensus_peers.cc:597] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.768020  1660 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.769774   431 raft_consensus.cc:2243] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.770753   431 raft_consensus.cc:2272] T 7a24aaf5c9514244ae333d411f1fb4f5 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.773494  2243 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.773569   431 tablet_replica.cc:333] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.783203   431 raft_consensus.cc:2243] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.794116   431 raft_consensus.cc:2272] T 35e8bc6e059f4dc3b59e584357979e78 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.796705   431 tablet_replica.cc:333] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.797430   431 raft_consensus.cc:2243] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.798142   431 raft_consensus.cc:2272] T 9f61c89956d24976b4d464550172cd55 P e12d7b3551014757ba7dda3e83605b83 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.804728  1660 consensus_peers.cc:597] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.808599  2243 consensus_peers.cc:597] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.812274   431 tablet_replica.cc:333] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.813194   431 raft_consensus.cc:2243] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.814010   431 raft_consensus.cc:2272] T 8f45eebdd49441fa87ca7768bae03d64 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.819167   431 tablet_replica.cc:333] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.819907   431 raft_consensus.cc:2243] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:01:48.820019  1658 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:48.820967   431 raft_consensus.cc:2272] T ccb59a831c424786ae1c9dfd1db1f6d3 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.827504  2243 consensus_peers.cc:597] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.827656   431 tablet_replica.cc:333] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.828496   431 raft_consensus.cc:2243] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:01:48.832654  1660 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.833304  1660 consensus_peers.cc:597] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.837909   431 raft_consensus.cc:2272] T f99348e8926940e29e1f3d35bef36868 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.838999  1584 consensus_peers.cc:597] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:48.840726   431 tablet_replica.cc:333] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.845850   431 raft_consensus.cc:2243] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:01:48.846639  2243 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.847157   431 raft_consensus.cc:2272] T 1669ae3f986d428ca0a51760ca20bc70 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.848184  1660 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.850176   431 tablet_replica.cc:333] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.854861   431 raft_consensus.cc:2243] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.855937   431 raft_consensus.cc:2272] T dbe29c0d913c42cfb39d487a69abfd46 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.858551   431 tablet_replica.cc:333] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
W20260709 13:01:48.850425  1660 consensus_peers.cc:597] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.872573   431 raft_consensus.cc:2243] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.873221   431 raft_consensus.cc:2272] T 4e51c69bdb8c4616a20162792bc3e235 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.875792   431 tablet_replica.cc:333] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.876573   431 raft_consensus.cc:2243] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.877573   431 raft_consensus.cc:2272] T c21865842c3d4eafba995dd02f14b489 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.886494   431 tablet_replica.cc:333] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.887321   431 raft_consensus.cc:2243] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.888022   431 raft_consensus.cc:2272] T 5fb2b0bb91ba4b59bba638c371a86a1e P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.889817  1660 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.892438  1660 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.905687   431 tablet_replica.cc:333] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.907562   431 raft_consensus.cc:2243] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.908836   431 raft_consensus.cc:2272] T c0cd29b6c17d47e6bfaba57728b3b725 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.911520   431 tablet_replica.cc:333] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.912339   431 raft_consensus.cc:2243] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.913477   431 raft_consensus.cc:2272] T 0644dffc23e84f7da7f8c0aac9e1c859 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.916108  2243 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.918632  2243 consensus_peers.cc:597] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.917191   431 tablet_replica.cc:333] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.923867   431 raft_consensus.cc:2243] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.928587   431 raft_consensus.cc:2272] T 5b4609f4058b459f804e03408773bd69 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.927899  2241 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:48.935632   431 tablet_replica.cc:333] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.936535   431 raft_consensus.cc:2243] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.939316   431 raft_consensus.cc:2272] T 9e5e0874051d4aa6807636e553d51e6c P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.950935   431 tablet_replica.cc:333] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.952425   431 raft_consensus.cc:2243] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.953169   431 raft_consensus.cc:2272] T 4ab387e7d0b0401eb317a86421cc1f80 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.959856   431 tablet_replica.cc:333] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:48.960777   431 raft_consensus.cc:2243] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.962190   431 raft_consensus.cc:2272] T 83a99308299b4d05a3b45157d06ba9bd P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.965029   431 tablet_replica.cc:333] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
W20260709 13:01:48.970991  2241 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:48.970619   431 raft_consensus.cc:2243] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:01:48.973363  2241 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:48.974172   431 raft_consensus.cc:2272] T 17c95b4249214135b23fe0bcbdcf8ad3 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:49.006163  2241 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:49.042174   431 tablet_replica.cc:333] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.049542   431 raft_consensus.cc:2243] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.051373   431 raft_consensus.cc:2272] T b3d6c15d42494c1cbf1914151dcfb5ac P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.054059   431 tablet_replica.cc:333] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
W20260709 13:01:49.050590  1658 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:49.067577   431 raft_consensus.cc:2243] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.070287   431 raft_consensus.cc:2272] T 6ef93a23494e4934beefa28be227bc72 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.073213   431 tablet_replica.cc:333] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
W20260709 13:01:49.121825  2241 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:49.140998   431 raft_consensus.cc:2243] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.142953   431 raft_consensus.cc:2272] T c330c505ed4e4efda5c94a1811c68633 P e12d7b3551014757ba7dda3e83605b83 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.148698   431 tablet_replica.cc:333] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.163482   431 raft_consensus.cc:2243] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.164428   431 raft_consensus.cc:2272] T f6fc10a7f7a84904a1cc02696513828e P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.171092   431 tablet_replica.cc:333] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.171918   431 raft_consensus.cc:2243] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.173470   431 raft_consensus.cc:2272] T daa50dd25c7f47639f933e047d81de75 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.176075   431 tablet_replica.cc:333] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.181155   431 raft_consensus.cc:2243] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.188259   431 raft_consensus.cc:2272] T 4a0105ba6bf14860a95121a73725f62e P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.191638   431 tablet_replica.cc:333] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.201601   431 raft_consensus.cc:2243] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.202888   431 raft_consensus.cc:2272] T cba7ca1546e44219b4872d2d3ae34040 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.205615   431 tablet_replica.cc:333] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.206423   431 raft_consensus.cc:2243] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.215023   431 raft_consensus.cc:2272] T d53120c1adf947fd992e5950edf26301 P e12d7b3551014757ba7dda3e83605b83 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.224287   431 tablet_replica.cc:333] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.225019   431 raft_consensus.cc:2243] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.226035   431 raft_consensus.cc:2272] T 60ed567c64f3422894e8776f5815e0b8 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:49.230628  1584 consensus_peers.cc:597] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:49.243371  2241 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:49.248145   431 tablet_replica.cc:333] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.251765   431 raft_consensus.cc:2243] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.252411   431 raft_consensus.cc:2272] T 48f214986b534c7ea670b8ff7960e691 P e12d7b3551014757ba7dda3e83605b83 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.255409   431 tablet_replica.cc:333] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.270089   431 raft_consensus.cc:2243] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.270763   431 raft_consensus.cc:2272] T c48135c32120406e945bec13a16ae327 P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.273428   431 tablet_replica.cc:333] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.274621   431 raft_consensus.cc:2243] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.275377   431 raft_consensus.cc:2272] T 4c492e0f519d422fb3a26617a5a4dbe6 P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.278766   431 tablet_replica.cc:333] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.279546   431 raft_consensus.cc:2243] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.281687   431 raft_consensus.cc:2272] T 82622e43412243cb95bf17b246050060 P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.284427   431 tablet_replica.cc:333] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.285236   431 raft_consensus.cc:2243] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.285970   431 raft_consensus.cc:2272] T 4d3b81d89af143c88a2c3179213662ff P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.288985   431 tablet_replica.cc:333] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.289831   431 raft_consensus.cc:2243] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.290365   431 raft_consensus.cc:2272] T 5e675a1020ff48279e061c44c1a368ae P e12d7b3551014757ba7dda3e83605b83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.299304   431 tablet_replica.cc:333] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.300058   431 raft_consensus.cc:2243] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.302209   431 raft_consensus.cc:2272] T 69b3c7e5df794f4baecc6be830fb8f80 P e12d7b3551014757ba7dda3e83605b83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.308876   431 tablet_replica.cc:333] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.309666   431 raft_consensus.cc:2243] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.311766   431 raft_consensus.cc:2272] T 4d3947e120494929a5b22c639f5d830c P e12d7b3551014757ba7dda3e83605b83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.315532   431 tablet_replica.cc:333] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.316311   431 raft_consensus.cc:2243] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.317155   431 raft_consensus.cc:2272] T ea97e615db7549b797908560563dd608 P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.319818   431 tablet_replica.cc:333] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.320564   431 raft_consensus.cc:2243] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.321254   431 raft_consensus.cc:2272] T d9be6d7fbe2348e4a1be13e50f487f82 P e12d7b3551014757ba7dda3e83605b83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.324266   431 tablet_replica.cc:333] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.325037   431 raft_consensus.cc:2243] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.326184   431 raft_consensus.cc:2272] T 8f9fcd10c7c244bf918f2218237f5b3a P e12d7b3551014757ba7dda3e83605b83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.328964   431 tablet_replica.cc:333] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.329698   431 raft_consensus.cc:2243] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.330358   431 raft_consensus.cc:2272] T ece2ab6676aa475ba1e5a5d1b13fc569 P e12d7b3551014757ba7dda3e83605b83 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.339962   431 tablet_replica.cc:333] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83: stopping tablet replica
I20260709 13:01:49.340678   431 raft_consensus.cc:2243] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.341804   431 raft_consensus.cc:2272] T 3485ff8d284d46bea80fa498e5f6d34a P e12d7b3551014757ba7dda3e83605b83 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:49.422708  1658 consensus_peers.cc:597] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:49.437778  2241 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:49.457916  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:49.492494  1658 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:49.523218  1658 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:49.595350  1658 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:49.723294  7729 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:49.723825  7729 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:49.727325  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:49.727814  7729 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:49.731290  2243 leader_election.cc:336] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:49.731724  2243 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:49.732561  7741 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:49.745774  1658 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:49.784610  1658 consensus_peers.cc:597] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:49.880471  7724 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:49.881031  7724 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:49.882958  7724 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:49.885365  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
W20260709 13:01:49.891201  1660 leader_election.cc:336] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:49.891638  1660 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:49.897382  7741 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:49.897891  7741 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:49.899801  7741 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:49.906080  7724 raft_consensus.cc:2749] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:49.907616  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
W20260709 13:01:49.912426  2243 leader_election.cc:336] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:49.917207  2243 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:49.924674  1658 consensus_peers.cc:597] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:49.927654  7741 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:49.925926  7724 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:49.928686  7724 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:49.931587  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:49.932161  2273 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 16.
I20260709 13:01:49.933269  1659 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:49.934252  7740 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:49.934636  7740 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:49.935011  7740 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:49.949859  7740 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:49.970629  7724 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:49.977241  1660 leader_election.cc:336] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:50.001838  7740 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:50.002453  1660 leader_election.cc:336] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:50.012949  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99348e8926940e29e1f3d35bef36868" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:50.013540  2273 raft_consensus.cc:3060] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.020414  2273 raft_consensus.cc:2468] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:50.021567  1659 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:50.022665  7740 raft_consensus.cc:2804] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:50.023695  7740 raft_consensus.cc:697] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:50.024658  7740 consensus_queue.cc:237] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.061650  7724 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.062202  7724 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.064106  7724 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.070060  7742 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.070533  7742 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.072402  7742 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.113677  7741 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.114507  7741 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.116544  7741 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:50.133131  7742 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.133890  7742 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:50.135759  7742 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:50.143172  7741 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.143746  7741 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.145709  7741 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:50.154888  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:50.155124  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:50.155508  2273 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:50.157483  7729 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.158034  7729 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.159852  7729 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:50.167080  7746 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.167619  7746 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.180837  7724 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.181419  7724 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:50.183583  7724 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:50.191395  1659 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.192158  7742 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:50.198766  7746 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.199561  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:50.188711  7745 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.205355  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:50.206022  1688 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 14.
I20260709 13:01:50.208050  7745 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:50.204602  7737 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.209575  7737 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.211583  7737 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:50.206038  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:50.215929  7745 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:50.204277  7729 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.219063  7729 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.220141  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.221024  7729 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:50.221580  7729 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.221923  7729 raft_consensus.cc:493] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.222278  7729 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:50.223683  1658 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:50.227020  1440 catalog_manager.cc:5697] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 16 to 17, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:50.225103  1658 consensus_peers.cc:597] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:50.229224  1658 leader_election.cc:336] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:50.233284  1658 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.203837  7742 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
W20260709 13:01:50.233842  1658 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:50.234304  1658 leader_election.cc:336] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.235106  7737 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.235626  7737 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.237600  7737 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:50.239317  7737 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.240015  7742 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.239871  7737 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.250074  7737 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:50.250967  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33801, user_credentials={real_user=slave}} blocked reactor thread for 46715.6us
I20260709 13:01:50.260376  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:50.268271  1659 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, 5dd1b367d5dd4e6abfd29fc2df2bed07
I20260709 13:01:50.277148  7742 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.267686  7748 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.279098  7748 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.281088  7748 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.281189  7742 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.284497  7740 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.284957  7729 raft_consensus.cc:515] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.290030  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:50.290614  1688 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 16.
W20260709 13:01:50.290658  2241 leader_election.cc:336] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:50.291280  2241 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:50.293046  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:50.293423  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25acf355940411ba0ffd6483b7467c3" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:50.293587  2273 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 17.
I20260709 13:01:50.293972  2271 raft_consensus.cc:3060] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.296689  7729 leader_election.cc:290] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:50.302088  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.303246  7750 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:50.303776  7750 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.304152  7750 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:50.305099  2241 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.305660  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd03248480b4bfd8a76471850708909" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:50.306195  1688 raft_consensus.cc:3060] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.310665  7750 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.311336  7741 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:50.311786  7741 raft_consensus.cc:493] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.312183  7741 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.303212  2271 raft_consensus.cc:2468] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 13.
I20260709 13:01:50.312980  1688 raft_consensus.cc:2468] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 15.
I20260709 13:01:50.315730  7750 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.319725  7741 raft_consensus.cc:515] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:50.322325  2241 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:50.322762  2241 leader_election.cc:336] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:50.323154  2241 leader_election.cc:336] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.323983  1659 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.324899  7750 raft_consensus.cc:2804] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:50.325347  7750 raft_consensus.cc:697] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:50.326121  7750 consensus_queue.cc:237] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.327881  7742 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.328397  7742 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.330488  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e8bc6e059f4dc3b59e584357979e78" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:50.329912  7741 leader_election.cc:290] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:50.331064  2271 raft_consensus.cc:3060] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:50.331471  7729 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.332106  7742 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.333128  7729 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.333693  2241 leader_election.cc:304] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.334510  7752 raft_consensus.cc:2804] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:50.335052  7752 raft_consensus.cc:697] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:50.335752  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0644dffc23e84f7da7f8c0aac9e1c859" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:50.336226  7729 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:50.336361  1688 raft_consensus.cc:3060] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.335944  7752 consensus_queue.cc:237] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.338641  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:50.339443  2273 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:50.342995  1688 raft_consensus.cc:2468] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 17.
I20260709 13:01:50.343012  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.348869  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:50.349481  1688 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:50.351202  7740 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:50.351662  7740 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.352013  7740 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.353209  2241 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.353825  7749 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.353902  7729 raft_consensus.cc:2804] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:50.354527  7729 raft_consensus.cc:697] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:50.354435  7749 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:50.355461  7729 consensus_queue.cc:237] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:50.357371  2241 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:50.361385  1658 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.361812  2271 raft_consensus.cc:2468] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 18.
I20260709 13:01:50.363186  1659 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.361842  7749 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:50.371625  7740 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.365064  7742 raft_consensus.cc:2804] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:50.374061  7742 raft_consensus.cc:697] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:50.374473  7740 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.374897  7742 consensus_queue.cc:237] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.381390  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0cd29b6c17d47e6bfaba57728b3b725" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07"
I20260709 13:01:50.381918  2271 raft_consensus.cc:3060] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.391060  2271 raft_consensus.cc:2468] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 12.
I20260709 13:01:50.392148  1659 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.368731  7752 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.393741  7748 raft_consensus.cc:2804] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:50.401610  7748 raft_consensus.cc:697] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Becoming Leader. State: Replica: e2a2b76c98ee44ff95e6508c34da0e3d, State: Running, Role: LEADER
I20260709 13:01:50.402669  7748 consensus_queue.cc:237] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.394636  7752 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.413884  7752 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:50.418601  7750 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.419229  7750 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:50.421916  7750 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
W20260709 13:01:50.423813  2241 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.507381  1441 catalog_manager.cc:5697] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 14 to 15, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:50.516860  1658 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:50.522961   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1641)
I20260709 13:01:50.517005  7724 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.531113  1441 catalog_manager.cc:5697] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 16 to 17, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.531190  7724 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:50.547835  7724 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:50.547008  1440 catalog_manager.cc:5697] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 12 to 13, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:50.553357  1658 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.552552  1440 catalog_manager.cc:5697] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 17 to 18, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.554944  1440 catalog_manager.cc:5697] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d reported cstate change: term changed from 11 to 12, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195). New cstate: current_term: 12 leader_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:50.566392  1658 consensus_peers.cc:597] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:50.626075  2273 raft_consensus.cc:1275] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:50.627720  7749 consensus_queue.cc:1048] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:50.627907  7763 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.630538  7763 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.636408  7763 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:50.639380  7749 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.637252  7763 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.640019  7749 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.640565  7763 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:50.642632  2241 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.643967  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:50.644852  1694 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:50.645758  7750 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.646355  7750 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.647578  7749 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.649187  7750 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
I20260709 13:01:50.650628  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:50.652175  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:50.652791  2272 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
W20260709 13:01:50.652792  2241 leader_election.cc:336] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.654012  7763 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:50.657791  1658 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.677932  7763 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.679863  7763 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.694060  7763 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:50.695720  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:50.696558  1694 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 16.
I20260709 13:01:50.698096  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.699505  7762 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:50.699898  7762 raft_consensus.cc:493] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.700341  7762 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.715834  7762 raft_consensus.cc:515] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.729839  7762 leader_election.cc:290] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Requested vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:50.730851  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82622e43412243cb95bf17b246050060" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d"
I20260709 13:01:50.733693  1694 raft_consensus.cc:3060] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.735424  7749 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:50.736151  7749 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:50.738916  7749 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:50.746662  1658 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:50.750183  1694 raft_consensus.cc:2468] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 17.
W20260709 13:01:50.751993  1658 consensus_peers.cc:597] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:50.753814  2241 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 
I20260709 13:01:50.754654  7762 raft_consensus.cc:2804] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:50.755213  7762 raft_consensus.cc:697] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 LEADER]: Becoming Leader. State: Replica: 5dd1b367d5dd4e6abfd29fc2df2bed07, State: Running, Role: LEADER
I20260709 13:01:50.756589  7762 consensus_queue.cc:237] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:50.762276  1689 raft_consensus.cc:1275] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:50.763657  7763 consensus_queue.cc:1048] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:50.817610  1440 catalog_manager.cc:5697] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 reported cstate change: term changed from 16 to 17, leader changed from e12d7b3551014757ba7dda3e83605b83 (127.0.107.194) to 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.822669  2272 raft_consensus.cc:1275] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:50.826005  7750 consensus_queue.cc:1048] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:01:50.826812  1658 consensus_peers.cc:597] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:50.847361  1689 raft_consensus.cc:1275] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:50.849874  7762 consensus_queue.cc:1048] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:01:50.855896  1658 consensus_peers.cc:597] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:50.874472  2271 raft_consensus.cc:1275] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:50.886477  7746 consensus_queue.cc:1048] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:50.904917  2271 raft_consensus.cc:1275] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Refusing update from remote peer e2a2b76c98ee44ff95e6508c34da0e3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:50.923207  7749 consensus_queue.cc:1048] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:51.013281  1658 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.023820  2241 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:51.109788  1658 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.116533  2243 leader_election.cc:336] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.117136  2243 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.118068  7737 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:51.118902  1660 leader_election.cc:336] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.119822  2243 leader_election.cc:336] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.120448  1660 leader_election.cc:336] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.120985  2243 leader_election.cc:336] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.121260  1660 leader_election.cc:304] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.121563  2243 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:51.122223  7749 raft_consensus.cc:2749] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:51.123682  1660 leader_election.cc:336] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.124208  1660 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.125018  7749 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:51.126194  1660 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.126894  7737 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:51.127569  1660 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.128093  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:51.128574  2243 leader_election.cc:336] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.128903  7749 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.129123  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.130080  7737 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:51.130501  1660 leader_election.cc:336] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.131021  1660 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.131773  7749 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:51.133893  1660 leader_election.cc:336] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.136157  1660 leader_election.cc:336] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.136492  2243 leader_election.cc:336] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.137065  2243 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.139196  7737 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:51.141741  2243 leader_election.cc:336] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.142436  2243 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:51.145754  7737 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:51.146838  2243 leader_election.cc:336] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.147876  2243 leader_election.cc:336] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.148734  2243 leader_election.cc:336] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.149724  2243 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.150139  2243 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:51.153475  1660 leader_election.cc:336] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.154563  1660 leader_election.cc:336] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.155710  1660 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.156185  1660 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.156915  7749 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:51.158008  1660 leader_election.cc:336] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.159076  1660 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.159518  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.160254  7749 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:51.162926  1660 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.163368  1660 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.164057  7749 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:51.165104  1660 consensus_peers.cc:597] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.165753  1660 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.166177  1660 leader_election.cc:304] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.166981  7749 raft_consensus.cc:2749] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.167050  7737 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:51.168602  2243 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.169122  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.169910  7737 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:51.169939  1660 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.173688  1660 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.176129  7749 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:51.174952  2243 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.178133  2243 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:51.176543  1660 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.178949  1660 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:51.179493  7737 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.181542  7749 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:51.180228  2243 leader_election.cc:336] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:51.182902  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:51.182535  1660 consensus_peers.cc:597] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.183882  1660 consensus_peers.cc:597] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.184352  7737 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:51.185386  2243 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.186507  2243 leader_election.cc:336] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:51.187256  2243 consensus_peers.cc:597] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.187708  2243 consensus_peers.cc:597] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.185845  1660 consensus_peers.cc:597] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.206959  1658 consensus_peers.cc:597] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.232192  1658 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.231405  2243 consensus_peers.cc:597] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.237767  2243 consensus_peers.cc:597] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.274295  1658 consensus_peers.cc:597] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.375623  1658 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:51.385426  1689 raft_consensus.cc:1275] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Refusing update from remote peer 5dd1b367d5dd4e6abfd29fc2df2bed07: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:51.388317  7762 consensus_queue.cc:1048] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:01:51.432753  1660 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111) [suppressed 564 similar messages]
W20260709 13:01:51.477540  2241 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.499082  1660 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.507287  2241 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.523550   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1641)
W20260709 13:01:51.597787  2243 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.609504  2243 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.625401  1660 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.630537  2243 consensus_peers.cc:597] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.652493  1660 consensus_peers.cc:597] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.658064  2243 consensus_peers.cc:597] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.703220  2243 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.724056  1660 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.749672  2241 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.758025  1660 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.773931  2241 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.775674  2241 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.775118  2243 consensus_peers.cc:597] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.797871  2241 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.802315  1660 consensus_peers.cc:597] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.832814  1658 consensus_peers.cc:597] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.872797  1660 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.876871  2241 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.892089  2243 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.896785  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.899080  2243 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.899583  2243 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.900059  1660 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.917135  1660 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.917721  1660 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.931962  1658 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:51.990448  1660 consensus_peers.cc:597] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.991820  1660 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.998979  2243 consensus_peers.cc:597] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.024158  2243 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.034648  1660 consensus_peers.cc:597] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.137352  2243 consensus_peers.cc:597] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.217018  1658 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:52.325206  1658 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:52.379691  1658 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:52.507818  1658 consensus_peers.cc:597] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:52.513839  1658 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:52.523972   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1641)
W20260709 13:01:52.545553  1658 consensus_peers.cc:597] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:52.550153  1428 catalog_manager.cc:4755] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 82622e43412243cb95bf17b246050060: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:52.606971  2241 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:52.708813  7737 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.710489  7737 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:52.714104  7737 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:52.714916  7750 raft_consensus.cc:493] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.720620  7750 raft_consensus.cc:515] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:52.724717  7750 leader_election.cc:290] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:52.730379  1660 leader_election.cc:336] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:52.704149  1658 consensus_peers.cc:597] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:52.755347  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:52.756162  1689 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
I20260709 13:01:52.771966  7750 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.772665  7750 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:52.775228  2241 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:52.775853  2241 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:52.775241  7750 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:52.801261  2243 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:52.810568  7762 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.811245  7762 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:52.813288  7762 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:52.813961  7762 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.815009  7762 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:52.818706  2241 leader_election.cc:336] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:52.820941  7762 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:52.810570  2243 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07, e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:52.823437  1658 leader_election.cc:336] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:52.824543  2241 leader_election.cc:336] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:52.825853  7762 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.826592  1658 leader_election.cc:304] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:52.829938  7750 raft_consensus.cc:2749] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:52.834069  1660 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:52.839601  7737 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.840176  7737 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:52.842062  7737 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:52.848483  1658 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:52.850375  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:52.852896  7750 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:52.855834  7750 raft_consensus.cc:493] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.856447  7750 raft_consensus.cc:515] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:52.858847  7750 leader_election.cc:290] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:52.851017  2241 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:52.868317  7737 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.868788  7737 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:52.870908  7737 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:52.878206  2243 leader_election.cc:336] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:52.878770  2243 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:52.879585  7737 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.881495  7737 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.882354  7737 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:52.884971  7737 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:52.881091  2243 leader_election.cc:336] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:52.885766  2243 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:52.900997  2241 leader_election.cc:336] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:52.903129  7737 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:52.881604  1660 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:52.907902  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5e0874051d4aa6807636e553d51e6c" candidate_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" is_pre_election: true
I20260709 13:01:52.908643  1689 raft_consensus.cc:2468] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd1b367d5dd4e6abfd29fc2df2bed07 in term 11.
W20260709 13:01:52.909502  2243 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:52.913162  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:52.915632  7737 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:52.919385  2243 leader_election.cc:336] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:52.919824  2243 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:52.920439  7737 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:52.923508  2243 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:52.925987  1658 leader_election.cc:336] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:52.926422  1658 leader_election.cc:304] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:52.928939  7750 raft_consensus.cc:2749] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:52.937719  2241 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:52.938134  2241 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:52.939054  7737 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.941049  7750 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.941689  7750 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:52.943667  7776 raft_consensus.cc:493] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:52.944274  7776 raft_consensus.cc:515] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:52.946607  7776 leader_election.cc:290] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:52.950276  7750 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:52.952356  1660 leader_election.cc:336] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:52.960747  1660 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:53.006917  1658 leader_election.cc:336] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:53.007355  1658 leader_election.cc:304] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
W20260709 13:01:53.013317  1658 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:53.013778  1658 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:53.017138  7776 raft_consensus.cc:2749] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:53.017817  7776 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:53.042328  1658 consensus_peers.cc:597] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:53.172700  7737 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:53.173285  7737 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:53.175297  7737 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:53.181666  2243 leader_election.cc:336] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:53.185019  2241 leader_election.cc:336] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:53.185480  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:53.186230  7737 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:53.192054  7776 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:53.192623  7776 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:53.199330  7776 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:53.200708  1660 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:53.218302  1658 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:53.219110  1658 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:53.223373  7776 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:53.271493  1660 consensus_peers.cc:597] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:53.274123  1660 consensus_peers.cc:597] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:53.287689  1658 consensus_peers.cc:597] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:53.315338  1660 consensus_peers.cc:597] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:53.340687  7776 raft_consensus.cc:493] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:53.341310  7776 raft_consensus.cc:515] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } }
I20260709 13:01:53.343679  7776 leader_election.cc:290] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041)
W20260709 13:01:53.355105  1658 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:53.356695  1660 leader_election.cc:336] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:53.361848  1660 leader_election.cc:304] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:53.368460  7776 raft_consensus.cc:2749] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:53.378144  1658 consensus_peers.cc:597] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:53.379860  2243 consensus_peers.cc:597] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:53.506973  1658 consensus_peers.cc:597] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:53.514569  2243 consensus_peers.cc:597] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:53.557497  2241 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:53.577735  1658 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:53.637826  1658 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:53.676373  1660 consensus_peers.cc:597] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:53.687036  2243 consensus_peers.cc:597] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:53.720698  2243 consensus_peers.cc:597] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:53.792030  1658 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:53.794916  1658 consensus_peers.cc:597] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:53.855403  1658 consensus_peers.cc:597] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:53.866421  1660 consensus_peers.cc:597] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:53.884194  2241 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:53.972730  1660 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:53.983299  1430 catalog_manager.cc:4755] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): ChangeConfig:REMOVE_PEER RPC failed for tablet d53120c1adf947fd992e5950edf26301: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:54.033363  1658 consensus_peers.cc:597] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.080410  2243 consensus_peers.cc:597] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.090909  2241 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.092682  1660 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.109200  1658 consensus_peers.cc:597] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.177112  1660 consensus_peers.cc:597] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.177393  2243 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.197623  2243 consensus_peers.cc:597] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.219645  2243 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.241894  2243 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.248123  1660 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.254420  2241 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.266557  2243 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.285444  2241 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.287047  1660 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.305004  2241 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.316133  2243 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.318070  1658 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.321827  2243 consensus_peers.cc:597] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.325789  2241 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.340631  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.344336  1660 consensus_peers.cc:597] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.368131  2243 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.390178  1658 consensus_peers.cc:597] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:54.390420   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:01:54.421561  1660 consensus_peers.cc:597] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.497206  1660 consensus_peers.cc:597] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.500742  2241 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:54.502574  1660 consensus_peers.cc:597] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.503674  2243 consensus_peers.cc:597] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.539026  1660 consensus_peers.cc:597] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:54.556036   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:54.557510  2243 consensus_peers.cc:597] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.561960  2241 consensus_peers.cc:597] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:54.577203  7779 raft_consensus.cc:493] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:54.577814  7779 raft_consensus.cc:515] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
I20260709 13:01:54.579953  7779 leader_election.cc:290] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:54.587262  1658 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:54.588238  1660 leader_election.cc:336] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:54.588634  1660 leader_election.cc:304] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:54.589787  7779 raft_consensus.cc:2749] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:54.615361  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:54.625409  2241 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:54.677446  1660 consensus_peers.cc:597] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.695992  1660 consensus_peers.cc:597] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.707815  2241 consensus_peers.cc:597] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:54.712112  2241 consensus_peers.cc:597] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:54.716352   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:54.728955   431 tablet_replica.cc:333] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:54.731362   431 raft_consensus.cc:2243] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.732666   431 raft_consensus.cc:2272] T 1532fbff9860493fa0fbdf5eb1b21242 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:54.740077  1658 consensus_peers.cc:597] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:54.747467  2241 consensus_peers.cc:597] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:54.748875  2243 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:54.756187  2241 consensus_peers.cc:597] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:54.760480  2241 consensus_peers.cc:597] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:54.763242   431 tablet_replica.cc:333] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:54.774117   431 raft_consensus.cc:2243] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.774919   431 raft_consensus.cc:2272] T 8a0b1eaf4f774ec3b24c196f0234dff9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.778352   431 tablet_replica.cc:333] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:54.780411   431 raft_consensus.cc:2243] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.782850   431 raft_consensus.cc:2272] T 486718b388ed49eaafdc2e13d168a057 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.794066  7762 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:54.794569  7762 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:54.800427  2241 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:54.801705   431 tablet_replica.cc:333] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
W20260709 13:01:54.802757  2241 leader_election.cc:336] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:54.796535  7762 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:54.803532   431 raft_consensus.cc:2243] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.804597   431 raft_consensus.cc:2272] T 3cd03248480b4bfd8a76471850708909 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.807013   431 tablet_replica.cc:333] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
W20260709 13:01:54.811606  2243 leader_election.cc:336] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:54.815976  2243 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:54.816397   431 raft_consensus.cc:2243] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.817067   431 raft_consensus.cc:2272] T 4ab387e7d0b0401eb317a86421cc1f80 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.817289  7762 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:54.815090  1658 consensus_peers.cc:597] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:54.819797   431 tablet_replica.cc:333] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
W20260709 13:01:54.826350  2241 consensus_peers.cc:597] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:54.830444   431 raft_consensus.cc:2243] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.837203   431 raft_consensus.cc:2272] T 9f61c89956d24976b4d464550172cd55 P e2a2b76c98ee44ff95e6508c34da0e3d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.875186  7762 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:54.875689  7762 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:54.877672  7762 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:54.882103  2241 consensus_peers.cc:597] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:54.883085  2241 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:54.884845  2243 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:54.885217  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:54.886310  7783 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:54.895892   431 tablet_replica.cc:333] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
W20260709 13:01:54.896394  1658 consensus_peers.cc:597] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:54.907956   431 raft_consensus.cc:2243] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.908852   431 raft_consensus.cc:2272] T 1f35127b66604c1685f1fbe404840774 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.916924   431 tablet_replica.cc:333] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:54.918406   431 raft_consensus.cc:2243] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.920049   431 raft_consensus.cc:2272] T 7a24aaf5c9514244ae333d411f1fb4f5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.934049   431 tablet_replica.cc:333] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:54.934939   431 raft_consensus.cc:2243] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.936055   431 raft_consensus.cc:2272] T 35e8bc6e059f4dc3b59e584357979e78 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.939633  7782 raft_consensus.cc:493] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:54.940116  7782 raft_consensus.cc:515] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:54.950906  1660 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:54.952028  1658 leader_election.cc:336] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:54.952965  1658 leader_election.cc:304] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:54.952461  7782 leader_election.cc:290] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:54.953869  7779 raft_consensus.cc:2749] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:54.956492   431 tablet_replica.cc:333] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:54.961781   431 raft_consensus.cc:2243] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:54.963948  2241 consensus_peers.cc:597] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:54.966439  7782 raft_consensus.cc:493] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:54.967307  7782 raft_consensus.cc:515] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } }
W20260709 13:01:54.978812  1660 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:54.979944  7782 leader_election.cc:290] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:54.980594  1658 leader_election.cc:336] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:54.981350  1658 leader_election.cc:304] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:54.982638  7779 raft_consensus.cc:2749] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:54.988729  2241 consensus_peers.cc:597] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:54.989825   431 raft_consensus.cc:2272] T 17c95b4249214135b23fe0bcbdcf8ad3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.996507   431 tablet_replica.cc:333] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:54.997298   431 raft_consensus.cc:2243] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.998314   431 raft_consensus.cc:2272] T b2590e3864b048c4b1d12cec239acf7a P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.001361   431 tablet_replica.cc:333] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.002532   431 raft_consensus.cc:2243] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.003885   431 raft_consensus.cc:2272] T b25acf355940411ba0ffd6483b7467c3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.006888   431 tablet_replica.cc:333] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.007982   431 raft_consensus.cc:2243] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.008641   431 raft_consensus.cc:2272] T 8d969afe49dd43c2902adb01b5aa223b P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.022096   431 tablet_replica.cc:333] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.023005   431 raft_consensus.cc:2243] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.023658   431 raft_consensus.cc:2272] T ccb59a831c424786ae1c9dfd1db1f6d3 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.026522   431 tablet_replica.cc:333] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.027377   431 raft_consensus.cc:2243] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.028631   431 raft_consensus.cc:2272] T f99348e8926940e29e1f3d35bef36868 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.031320   431 tablet_replica.cc:333] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.032120   431 raft_consensus.cc:2243] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.037277   431 raft_consensus.cc:2272] T dbe29c0d913c42cfb39d487a69abfd46 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.040547   431 tablet_replica.cc:333] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.041374   431 raft_consensus.cc:2243] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.042078   431 raft_consensus.cc:2272] T c21865842c3d4eafba995dd02f14b489 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.048365  7737 raft_consensus.cc:493] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:55.048903  7737 raft_consensus.cc:515] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:55.053925  7737 leader_election.cc:290] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:55.055688   431 tablet_replica.cc:333] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.058569   431 raft_consensus.cc:2243] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.059783   431 raft_consensus.cc:2272] T 90bfe669a290453597d79375d2aadae5 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:55.060915  2243 leader_election.cc:336] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:55.062477   431 tablet_replica.cc:333] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.063386   431 raft_consensus.cc:2243] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.064512   431 raft_consensus.cc:2272] T 5fb2b0bb91ba4b59bba638c371a86a1e P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.067238   431 tablet_replica.cc:333] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.068003   431 raft_consensus.cc:2243] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.072590  7782 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:55.073194  7782 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:55.082898  1658 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:55.084364  7782 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), 5dd1b367d5dd4e6abfd29fc2df2bed07 (127.0.107.196:33801)
W20260709 13:01:55.088677  1660 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:55.089174  1660 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2a2b76c98ee44ff95e6508c34da0e3d; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:55.090350  7782 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:55.094431  2241 leader_election.cc:336] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:55.095347  2241 leader_election.cc:304] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:55.096448  7737 raft_consensus.cc:2749] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.098114   431 raft_consensus.cc:2272] T c0cd29b6c17d47e6bfaba57728b3b725 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.101017  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53120c1adf947fd992e5950edf26301" candidate_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" is_pre_election: true
I20260709 13:01:55.101651  2274 raft_consensus.cc:2468] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a2b76c98ee44ff95e6508c34da0e3d in term 11.
I20260709 13:01:55.109532   431 tablet_replica.cc:333] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.111469   431 raft_consensus.cc:2243] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.112187   431 raft_consensus.cc:2272] T c330c505ed4e4efda5c94a1811c68633 P e2a2b76c98ee44ff95e6508c34da0e3d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.121742   431 tablet_replica.cc:333] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.123137   431 raft_consensus.cc:2243] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:01:55.123904  1658 consensus_peers.cc:597] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:55.124333   431 raft_consensus.cc:2272] T 1c3db709fac1489b928f0a9df67f0426 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.127290   431 tablet_replica.cc:333] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.128028   431 raft_consensus.cc:2243] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.129340   431 raft_consensus.cc:2272] T 7aeb3a1da10b4e5a8070d908a280055c P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.132511   431 tablet_replica.cc:333] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.133273   431 raft_consensus.cc:2243] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.134809   431 raft_consensus.cc:2272] T daa50dd25c7f47639f933e047d81de75 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:55.136173  2241 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:55.137192   431 tablet_replica.cc:333] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.137971   431 raft_consensus.cc:2243] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.139058   431 raft_consensus.cc:2272] T 96e20996757d4784ade11fe9799f7a13 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.141618   431 tablet_replica.cc:333] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.142395   431 raft_consensus.cc:2243] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.143091   431 raft_consensus.cc:2272] T f81118a8e62c4910be3913ae0e3f240d P e2a2b76c98ee44ff95e6508c34da0e3d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.145781   431 tablet_replica.cc:333] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.146535   431 raft_consensus.cc:2243] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.147452   431 raft_consensus.cc:2272] T 82622e43412243cb95bf17b246050060 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.149641   431 tablet_replica.cc:333] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.150367   431 raft_consensus.cc:2243] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.151489   431 raft_consensus.cc:2272] T 4c492e0f519d422fb3a26617a5a4dbe6 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.158995   431 tablet_replica.cc:333] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.159775   431 raft_consensus.cc:2243] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.160837   431 raft_consensus.cc:2272] T 48f214986b534c7ea670b8ff7960e691 P e2a2b76c98ee44ff95e6508c34da0e3d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.165593   431 tablet_replica.cc:333] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.166393  7737 raft_consensus.cc:493] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:55.166462   431 raft_consensus.cc:2243] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.166967  7737 raft_consensus.cc:515] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:55.167554   431 raft_consensus.cc:2272] T c48135c32120406e945bec13a16ae327 P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.169523  7737 leader_election.cc:290] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:55.176908  2243 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:55.177778  2241 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:55.178156  2241 leader_election.cc:304] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:55.179518  7737 raft_consensus.cc:2749] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:55.181866  2241 leader_election.cc:336] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:55.196592   431 tablet_replica.cc:333] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.197407   431 raft_consensus.cc:2243] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.204071   431 raft_consensus.cc:2272] T 4e51c69bdb8c4616a20162792bc3e235 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.206310   431 tablet_replica.cc:333] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.209311   431 raft_consensus.cc:2243] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.210304   431 raft_consensus.cc:2272] T 0de7551eb2ca4d369ae826fcaebd0301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.215106   431 tablet_replica.cc:333] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.217474   431 raft_consensus.cc:2243] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.218950   431 raft_consensus.cc:2272] T d53120c1adf947fd992e5950edf26301 P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.221649   431 tablet_replica.cc:333] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.222366   431 raft_consensus.cc:2243] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.223470   431 raft_consensus.cc:2272] T 044356f91b2d4fe4a34deeb351b2fbac P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.225908   431 tablet_replica.cc:333] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.226570   431 raft_consensus.cc:2243] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.227067   431 raft_consensus.cc:2272] T cba7ca1546e44219b4872d2d3ae34040 P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.229321   431 tablet_replica.cc:333] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.229959   431 raft_consensus.cc:2243] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.230479   431 raft_consensus.cc:2272] T 4d3947e120494929a5b22c639f5d830c P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.232821   431 tablet_replica.cc:333] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.233520   431 raft_consensus.cc:2243] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.234119   431 raft_consensus.cc:2272] T 8f9fcd10c7c244bf918f2218237f5b3a P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.236459   431 tablet_replica.cc:333] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.237107   431 raft_consensus.cc:2243] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.240172   431 raft_consensus.cc:2272] T ea97e615db7549b797908560563dd608 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.243393   431 tablet_replica.cc:333] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.244127   431 raft_consensus.cc:2243] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.245417   431 raft_consensus.cc:2272] T d9be6d7fbe2348e4a1be13e50f487f82 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.249198   431 tablet_replica.cc:333] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.249847   431 raft_consensus.cc:2243] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.255445   431 raft_consensus.cc:2272] T f6fc10a7f7a84904a1cc02696513828e P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.258494   431 tablet_replica.cc:333] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
W20260709 13:01:55.258874  2241 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:01:55.259192   431 raft_consensus.cc:2243] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.260686   431 raft_consensus.cc:2272] T b37b7f2c08b145c6b88f543822a1cf5c P e2a2b76c98ee44ff95e6508c34da0e3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.263463   431 tablet_replica.cc:333] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.264132   431 raft_consensus.cc:2243] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.265313   431 raft_consensus.cc:2272] T 165cabe60a114b9ca5fda64711bd3163 P e2a2b76c98ee44ff95e6508c34da0e3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.267839   431 tablet_replica.cc:333] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.268728   431 raft_consensus.cc:2243] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.269243   431 raft_consensus.cc:2272] T 60ed567c64f3422894e8776f5815e0b8 P e2a2b76c98ee44ff95e6508c34da0e3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.271643   431 tablet_replica.cc:333] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.272377   431 raft_consensus.cc:2243] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.273279   431 raft_consensus.cc:2272] T 9e5e0874051d4aa6807636e553d51e6c P e2a2b76c98ee44ff95e6508c34da0e3d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.282028   431 tablet_replica.cc:333] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.282713   431 raft_consensus.cc:2243] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.283239   431 raft_consensus.cc:2272] T 0644dffc23e84f7da7f8c0aac9e1c859 P e2a2b76c98ee44ff95e6508c34da0e3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.285539   431 tablet_replica.cc:333] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.286535   431 raft_consensus.cc:2243] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.287124   431 raft_consensus.cc:2272] T 4d3b81d89af143c88a2c3179213662ff P e2a2b76c98ee44ff95e6508c34da0e3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.289343   431 tablet_replica.cc:333] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d: stopping tablet replica
I20260709 13:01:55.289928   431 raft_consensus.cc:2243] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.291141   431 raft_consensus.cc:2272] T 8a483be3e3ee4d5381336b0877760ca9 P e2a2b76c98ee44ff95e6508c34da0e3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.437239  7783 raft_consensus.cc:493] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:55.437709  7783 raft_consensus.cc:515] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:55.439787  7783 leader_election.cc:290] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:55.448130  2243 leader_election.cc:336] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:55.448902  2241 leader_election.cc:336] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:55.449261  2241 leader_election.cc:304] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:55.450277  7783 raft_consensus.cc:2749] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:55.867172  2243 consensus_peers.cc:597] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:55.976907  7783 raft_consensus.cc:493] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:55.977468  7783 raft_consensus.cc:515] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:55.979812  7783 leader_election.cc:290] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:55.985352  2241 leader_election.cc:336] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:55.986271  2243 leader_election.cc:336] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:55.986745  2243 leader_election.cc:304] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:55.987922  7783 raft_consensus.cc:2749] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:56.087204  2243 consensus_peers.cc:597] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:56.103303  7783 raft_consensus.cc:493] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.103941  7783 raft_consensus.cc:515] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.106182  7783 leader_election.cc:290] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.116999  2241 leader_election.cc:336] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:56.117719  2243 leader_election.cc:336] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:56.118149  2243 leader_election.cc:304] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.119184  7783 raft_consensus.cc:2749] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:56.143245  2243 consensus_peers.cc:597] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:56.164078  7783 raft_consensus.cc:493] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:56.164641  7783 raft_consensus.cc:515] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.166846  7783 leader_election.cc:290] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
I20260709 13:01:56.170259  7762 raft_consensus.cc:493] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.170857  7762 raft_consensus.cc:515] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.173043  7762 leader_election.cc:290] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:56.173542  7762 raft_consensus.cc:493] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.173983  7762 raft_consensus.cc:515] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.174808  7737 raft_consensus.cc:493] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.175311  7737 raft_consensus.cc:515] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.177354  7737 leader_election.cc:290] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:56.181123  7762 leader_election.cc:290] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.187491  2241 leader_election.cc:336] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
I20260709 13:01:56.188843  7787 raft_consensus.cc:493] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.189493  7787 raft_consensus.cc:515] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.192039  7787 leader_election.cc:290] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.198987  2241 leader_election.cc:336] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:56.200182  2243 leader_election.cc:336] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:56.203387  2241 leader_election.cc:336] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:56.205991  2241 leader_election.cc:336] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:56.211272  2243 leader_election.cc:336] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:56.217983  2243 leader_election.cc:304] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.218730  7787 raft_consensus.cc:2749] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:56.218991  2243 leader_election.cc:336] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:56.221071  2243 leader_election.cc:304] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.221773  7787 raft_consensus.cc:2749] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:56.221954  2243 leader_election.cc:336] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:56.222450  2243 leader_election.cc:304] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.223147  7787 raft_consensus.cc:2749] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:56.225468  7787 raft_consensus.cc:493] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.225980  7787 raft_consensus.cc:515] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.228847  7787 leader_election.cc:290] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:56.232995  7787 raft_consensus.cc:493] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.233549  7787 raft_consensus.cc:515] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:56.234491  2241 leader_election.cc:336] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
I20260709 13:01:56.228463  7788 raft_consensus.cc:493] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.236321  7787 leader_election.cc:290] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.242079  2241 leader_election.cc:336] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
I20260709 13:01:56.235973  7788 raft_consensus.cc:515] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.255560  7788 leader_election.cc:290] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.262926  2243 leader_election.cc:336] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:56.265724  2241 leader_election.cc:336] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
I20260709 13:01:56.282043  2243 leader_election.cc:304] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
W20260709 13:01:56.283804  2243 leader_election.cc:336] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:56.283830  7787 raft_consensus.cc:2749] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:56.289305  2243 leader_election.cc:304] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.290786  7787 raft_consensus.cc:2749] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:56.303516  2243 consensus_peers.cc:597] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:56.311168  7788 raft_consensus.cc:493] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.311776  7788 raft_consensus.cc:515] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.313966  7788 leader_election.cc:290] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.319787  2241 leader_election.cc:336] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
I20260709 13:01:56.349131  7788 raft_consensus.cc:493] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.349756  7788 raft_consensus.cc:515] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:56.359562  2241 leader_election.cc:336] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:56.363654  2243 leader_election.cc:336] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:56.364152  2243 leader_election.cc:304] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: e12d7b3551014757ba7dda3e83605b83, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.364905  7787 raft_consensus.cc:2749] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.367668  7788 leader_election.cc:290] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.374908  2243 consensus_peers.cc:597] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:56.444964  2243 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111) [suppressed 631 similar messages]
I20260709 13:01:56.448654  7788 raft_consensus.cc:493] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.449198  7788 raft_consensus.cc:515] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:56.457315  2241 leader_election.cc:336] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
I20260709 13:01:56.458040  7788 leader_election.cc:290] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:56.460594  7788 raft_consensus.cc:493] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.461133  7788 raft_consensus.cc:515] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:56.468523  2241 leader_election.cc:336] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
I20260709 13:01:56.469338  7788 leader_election.cc:290] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.490972  2243 consensus_peers.cc:597] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:56.546960  7788 raft_consensus.cc:493] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.547500  7788 raft_consensus.cc:515] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.555195  7787 raft_consensus.cc:493] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.555757  7787 raft_consensus.cc:515] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.557636  7788 leader_election.cc:290] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:56.564077  7787 leader_election.cc:290] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.569113  2241 leader_election.cc:336] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:56.569609  2241 leader_election.cc:336] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:56.591845  2243 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:56.595227  2243 consensus_peers.cc:597] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:56.673323  7788 raft_consensus.cc:493] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2a2b76c98ee44ff95e6508c34da0e3d)
I20260709 13:01:56.673823  7788 raft_consensus.cc:515] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:56.687340  7788 leader_election.cc:290] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
W20260709 13:01:56.694794  2241 leader_election.cc:336] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:56.735308  2241 leader_election.cc:336] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:56.735751  2241 leader_election.cc:304] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:56.736493  7788 raft_consensus.cc:2749] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:56.736650  2241 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:56.737141  2241 leader_election.cc:336] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:56.737474  2241 leader_election.cc:304] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.750859  7788 raft_consensus.cc:2749] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:56.752964  2241 leader_election.cc:336] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:56.753712  2241 leader_election.cc:336] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:56.754380  2241 leader_election.cc:336] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:56.754756  2241 leader_election.cc:304] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.755493  7787 raft_consensus.cc:2749] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:56.755631  2241 leader_election.cc:336] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:56.756096  2241 leader_election.cc:304] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.756736  7787 raft_consensus.cc:2749] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:56.756894  2241 leader_election.cc:336] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:56.757547  2241 leader_election.cc:304] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.758185  7787 raft_consensus.cc:2749] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:56.758325  2241 leader_election.cc:336] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:56.758819  2241 leader_election.cc:304] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.759441  7787 raft_consensus.cc:2749] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:56.759598  2241 leader_election.cc:336] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:56.760182  2241 leader_election.cc:304] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.760802  7787 raft_consensus.cc:2749] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:56.760938  2241 leader_election.cc:336] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:56.761412  2241 leader_election.cc:304] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.762075  7787 raft_consensus.cc:2749] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:56.762217  2241 leader_election.cc:336] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:56.762820  2241 leader_election.cc:304] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e2a2b76c98ee44ff95e6508c34da0e3d
I20260709 13:01:56.763425  7787 raft_consensus.cc:2749] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:56.800725  2243 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:56.812065  2241 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:56.886271  2243 consensus_peers.cc:597] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:56.927389  2243 consensus_peers.cc:597] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:56.927832  2243 consensus_peers.cc:597] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:56.956293  2243 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:57.020218  2241 consensus_peers.cc:597] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:57.037247  2241 consensus_peers.cc:597] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:57.063990  2241 consensus_peers.cc:597] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:57.072007   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:01:57.106572  2241 consensus_peers.cc:597] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:57.112733  2243 consensus_peers.cc:597] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:57.113540  7788 raft_consensus.cc:493] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:57.114179  7788 raft_consensus.cc:515] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:57.116562  7788 leader_election.cc:290] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:57.124837  2241 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:57.125659  2243 leader_election.cc:336] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:57.126044  2243 leader_election.cc:304] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:57.126765  7788 raft_consensus.cc:2749] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:57.217316  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:57.223542  2243 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:57.236804  2241 consensus_peers.cc:597] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:57.238540  2241 consensus_peers.cc:597] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:57.239025  2241 consensus_peers.cc:597] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:57.241787  7788 raft_consensus.cc:493] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:57.242486  7788 raft_consensus.cc:515] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } attrs { replace: true } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
I20260709 13:01:57.245467  7788 leader_election.cc:290] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485), e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447)
I20260709 13:01:57.248373   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:01:57.250818  2243 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:01:57.281448  7788 raft_consensus.cc:493] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e12d7b3551014757ba7dda3e83605b83)
I20260709 13:01:57.282009  7788 raft_consensus.cc:515] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: false } }
W20260709 13:01:57.283577  2241 consensus_peers.cc:597] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:57.284454  7788 leader_election.cc:290] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041), e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485)
W20260709 13:01:57.291211  2243 leader_election.cc:336] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
W20260709 13:01:57.293066  2241 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
I20260709 13:01:57.293478  2241 leader_election.cc:304] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:57.294255  7788 raft_consensus.cc:2749] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:57.294763  2241 leader_election.cc:336] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111)
W20260709 13:01:57.307957  2241 leader_election.cc:336] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:01:57.308027  2243 consensus_peers.cc:597] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): Couldn't send request to peer e12d7b3551014757ba7dda3e83605b83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:57.308454  2241 leader_election.cc:304] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dd1b367d5dd4e6abfd29fc2df2bed07; no voters: 0cccd9c43f9747529680a8e7463961c9, e12d7b3551014757ba7dda3e83605b83
I20260709 13:01:57.310153  7787 raft_consensus.cc:2749] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:57.318450  2241 consensus_peers.cc:597] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:57.322639  2241 consensus_peers.cc:597] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:57.332412   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:57.333328   431 tablet_replica.cc:333] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.334437   431 raft_consensus.cc:2243] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.335227   431 raft_consensus.cc:2272] T 7a24aaf5c9514244ae333d411f1fb4f5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.338362   431 tablet_replica.cc:333] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.339175   431 raft_consensus.cc:2243] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.340364   431 raft_consensus.cc:2272] T 82622e43412243cb95bf17b246050060 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.343048   431 tablet_replica.cc:333] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.343804   431 raft_consensus.cc:2243] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.344501   431 raft_consensus.cc:2272] T 6ef93a23494e4934beefa28be227bc72 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.347465   431 tablet_replica.cc:333] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.348366   431 raft_consensus.cc:2243] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.349660   431 raft_consensus.cc:2272] T b2590e3864b048c4b1d12cec239acf7a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.352520   431 tablet_replica.cc:333] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
W20260709 13:01:57.352626  2241 consensus_peers.cc:597] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:57.353544   431 raft_consensus.cc:2243] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.354787   431 raft_consensus.cc:2272] T 3cd03248480b4bfd8a76471850708909 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.357901   431 tablet_replica.cc:333] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.358770   431 raft_consensus.cc:2243] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.359433   431 raft_consensus.cc:2272] T 1669ae3f986d428ca0a51760ca20bc70 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.362488   431 tablet_replica.cc:333] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.363363   431 raft_consensus.cc:2243] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.363996   431 raft_consensus.cc:2272] T 8a483be3e3ee4d5381336b0877760ca9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.366832   431 tablet_replica.cc:333] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.367708   431 raft_consensus.cc:2243] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.368285   431 raft_consensus.cc:2272] T c0cd29b6c17d47e6bfaba57728b3b725 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.370985   431 tablet_replica.cc:333] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.371781   431 raft_consensus.cc:2243] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.373001   431 raft_consensus.cc:2272] T 4a0105ba6bf14860a95121a73725f62e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.375890   431 tablet_replica.cc:333] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.376725   431 raft_consensus.cc:2243] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.377772   431 raft_consensus.cc:2272] T f81118a8e62c4910be3913ae0e3f240d P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.386206   431 tablet_replica.cc:333] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.387336   431 raft_consensus.cc:2243] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.388090   431 raft_consensus.cc:2272] T ea97e615db7549b797908560563dd608 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.391239   431 tablet_replica.cc:333] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.392081   431 raft_consensus.cc:2243] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.393159   431 raft_consensus.cc:2272] T ece2ab6676aa475ba1e5a5d1b13fc569 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.396332   431 tablet_replica.cc:333] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.397200   431 raft_consensus.cc:2243] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.397781   431 raft_consensus.cc:2272] T b25acf355940411ba0ffd6483b7467c3 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.400599   431 tablet_replica.cc:333] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.401371   431 raft_consensus.cc:2243] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.407045   431 raft_consensus.cc:2272] T ce9fc6a855e249298263a94d04de35a4 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.414652   431 tablet_replica.cc:333] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.415472   431 raft_consensus.cc:2243] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.416067   431 raft_consensus.cc:2272] T 90bfe669a290453597d79375d2aadae5 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.419044   431 tablet_replica.cc:333] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.419806   431 raft_consensus.cc:2243] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.420914   431 raft_consensus.cc:2272] T 8a0b1eaf4f774ec3b24c196f0234dff9 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.423909   431 tablet_replica.cc:333] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.424783   431 raft_consensus.cc:2243] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Raft consensus shutting down.
I20260709 13:01:57.425259   431 pending_rounds.cc:70] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Trying to abort 1 pending ops.
I20260709 13:01:57.425561   431 pending_rounds.cc:77] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7305633669838753792 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "4e51c69bdb8c4616a20162792bc3e235" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0cccd9c43f9747529680a8e7463961c9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42041 } } peers { permanent_uuid: "e12d7b3551014757ba7dda3e83605b83" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46485 } } peers { permanent_uuid: "e2a2b76c98ee44ff95e6508c34da0e3d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35447 } attrs { replace: true } } peers { permanent_uuid: "5dd1b367d5dd4e6abfd29fc2df2bed07" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33801 } attrs { promote: true } } } }
I20260709 13:01:57.426807   431 raft_consensus.cc:2917] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 LEARNER]: Aborting config change with OpId 2.3: Aborted: Op aborted
I20260709 13:01:57.427239   431 raft_consensus.cc:2889] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:01:57.427597   431 raft_consensus.cc:2272] T 4e51c69bdb8c4616a20162792bc3e235 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
W20260709 13:01:57.433470  2241 consensus_peers.cc:597] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer e2a2b76c98ee44ff95e6508c34da0e3d (127.0.107.195:35447): Couldn't send request to peer e2a2b76c98ee44ff95e6508c34da0e3d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:57.434688   431 tablet_replica.cc:333] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.435565   431 raft_consensus.cc:2243] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.436406   431 raft_consensus.cc:2272] T 0de7551eb2ca4d369ae826fcaebd0301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.439328   431 tablet_replica.cc:333] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.440136   431 raft_consensus.cc:2243] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.440869   431 raft_consensus.cc:2272] T 9e5e0874051d4aa6807636e553d51e6c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.444099   431 tablet_replica.cc:333] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.445197   431 raft_consensus.cc:2243] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.446626   431 raft_consensus.cc:2272] T 5b4609f4058b459f804e03408773bd69 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.449436   431 tablet_replica.cc:333] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.450645   431 raft_consensus.cc:2243] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.456693   431 raft_consensus.cc:2272] T 0644dffc23e84f7da7f8c0aac9e1c859 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.465420   431 tablet_replica.cc:333] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.466509   431 raft_consensus.cc:2243] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.467703   431 raft_consensus.cc:2272] T 4d3b81d89af143c88a2c3179213662ff P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.470836   431 tablet_replica.cc:333] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.471673   431 raft_consensus.cc:2243] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.472942   431 raft_consensus.cc:2272] T 5e675a1020ff48279e061c44c1a368ae P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.476213   431 tablet_replica.cc:333] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.477061   431 raft_consensus.cc:2243] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.477720   431 raft_consensus.cc:2272] T 69b3c7e5df794f4baecc6be830fb8f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.480871   431 tablet_replica.cc:333] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.481680   431 raft_consensus.cc:2243] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.482271   431 raft_consensus.cc:2272] T 35e8bc6e059f4dc3b59e584357979e78 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.485317   431 tablet_replica.cc:333] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.486398   431 raft_consensus.cc:2243] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.487061   431 raft_consensus.cc:2272] T 83a99308299b4d05a3b45157d06ba9bd P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.495396   431 tablet_replica.cc:333] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.497576   431 raft_consensus.cc:2243] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.498420   431 raft_consensus.cc:2272] T 7aeb3a1da10b4e5a8070d908a280055c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.507761   431 tablet_replica.cc:333] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.508643   431 raft_consensus.cc:2243] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.509857   431 raft_consensus.cc:2272] T 4ab387e7d0b0401eb317a86421cc1f80 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.513492   431 tablet_replica.cc:333] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.519814   431 raft_consensus.cc:2243] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.526811   431 raft_consensus.cc:2272] T d53120c1adf947fd992e5950edf26301 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.530453   431 tablet_replica.cc:333] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
W20260709 13:01:57.535378  2241 consensus_peers.cc:597] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 -> Peer 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): Couldn't send request to peer 0cccd9c43f9747529680a8e7463961c9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:57.536576   431 raft_consensus.cc:2243] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.537832   431 raft_consensus.cc:2272] T 8d969afe49dd43c2902adb01b5aa223b P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.541028   431 tablet_replica.cc:333] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.541913   431 raft_consensus.cc:2243] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.543197   431 raft_consensus.cc:2272] T 1f35127b66604c1685f1fbe404840774 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.546425   431 tablet_replica.cc:333] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.547310   431 raft_consensus.cc:2243] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.547935   431 raft_consensus.cc:2272] T 165cabe60a114b9ca5fda64711bd3163 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.550949   431 tablet_replica.cc:333] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.551764   431 raft_consensus.cc:2243] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.552853   431 raft_consensus.cc:2272] T c48135c32120406e945bec13a16ae327 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.555759   431 tablet_replica.cc:333] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.556573   431 raft_consensus.cc:2243] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.557654   431 raft_consensus.cc:2272] T dbe29c0d913c42cfb39d487a69abfd46 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.561014   431 tablet_replica.cc:333] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.561882   431 raft_consensus.cc:2243] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.562733   431 raft_consensus.cc:2272] T f99348e8926940e29e1f3d35bef36868 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.565994   431 tablet_replica.cc:333] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.566748   431 raft_consensus.cc:2243] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.567493   431 raft_consensus.cc:2272] T 044356f91b2d4fe4a34deeb351b2fbac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.570384   431 tablet_replica.cc:333] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.571183   431 raft_consensus.cc:2243] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.572527   431 raft_consensus.cc:2272] T b3d6c15d42494c1cbf1914151dcfb5ac P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.575758   431 tablet_replica.cc:333] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.576589   431 raft_consensus.cc:2243] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.577522   431 raft_consensus.cc:2272] T 96e20996757d4784ade11fe9799f7a13 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.580402   431 tablet_replica.cc:333] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.581087   431 raft_consensus.cc:2243] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.582199   431 raft_consensus.cc:2272] T c330c505ed4e4efda5c94a1811c68633 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.584920   431 tablet_replica.cc:333] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.585961   431 raft_consensus.cc:2243] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.586797   431 raft_consensus.cc:2272] T 1c3db709fac1489b928f0a9df67f0426 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.591434   431 tablet_replica.cc:333] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.592453   431 raft_consensus.cc:2243] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.594041   431 raft_consensus.cc:2272] T 8f45eebdd49441fa87ca7768bae03d64 P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.600126   431 tablet_replica.cc:333] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.601107   431 raft_consensus.cc:2243] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:57.602445   431 raft_consensus.cc:2272] T b37b7f2c08b145c6b88f543822a1cf5c P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.605592   431 tablet_replica.cc:333] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.606251   431 raft_consensus.cc:2243] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.606827   431 raft_consensus.cc:2272] T f6fc10a7f7a84904a1cc02696513828e P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:57.609521   431 tablet_replica.cc:333] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07: stopping tablet replica
I20260709 13:01:57.610126   431 raft_consensus.cc:2243] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:57.610841   431 raft_consensus.cc:2272] T 3485ff8d284d46bea80fa498e5f6d34a P 5dd1b367d5dd4e6abfd29fc2df2bed07 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:58.120038   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:01:58.227301   431 master.cc:562] Master@127.0.107.254:40935 shutting down...
W20260709 13:01:58.277912  1491 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:01:58.278220  1491 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:01:58.278439  1491 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:01:59.454155  1474 debug-util.cc:398] Leaking SignalData structure 0x7b080009b640 after lost signal to thread 434
W20260709 13:01:59.454756  1474 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1ac0 after lost signal to thread 1477
W20260709 13:02:00.759683  1428 catalog_manager.cc:4755] TS 0cccd9c43f9747529680a8e7463961c9 (127.0.107.193:42041): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 82622e43412243cb95bf17b246050060: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42041: connect: Connection refused (error 111)
W20260709 13:02:26.789243  1430 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111) [suppressed 112 similar messages]
W20260709 13:02:26.792881  1430 catalog_manager.cc:4755] TS e12d7b3551014757ba7dda3e83605b83 (127.0.107.194:46485): ChangeConfig:REMOVE_PEER RPC failed for tablet d53120c1adf947fd992e5950edf26301: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46485: connect: Connection refused (error 111)
I20260709 13:02:31.472483   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:31.473575   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.473912   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0c5fc33855324cbf8fc0fd695f8cc99b: stopping tablet replica
I20260709 13:02:31.659819   431 master.cc:584] Master@127.0.107.254:40935 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (226744 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:02:31.771410   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34449
I20260709 13:02:31.772595   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:31.778384  7798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:31.778851  7801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:31.779174  7799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:31.780258   431 server_base.cc:1061] running on GCE node
I20260709 13:02:31.783313   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:31.783526   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:31.783707   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602151783690 us; error 0 us; skew 500 ppm
I20260709 13:02:31.784253   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:31.786542   431 webserver.cc:533] Webserver started at http://127.0.107.254:39941/ using document root <none> and password file <none>
I20260709 13:02:31.787084   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:31.787284   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:31.787549   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:31.788800   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/master-0-root/instance:
uuid: "7d9d53d74e944dc38d0ff7befa59eaab"
format_stamp: "Formatted at 2026-07-09 13:02:31 on dist-test-slave-szgt"
I20260709 13:02:31.793258   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:31.796427  7806 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:31.797108   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:31.797369   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/master-0-root
uuid: "7d9d53d74e944dc38d0ff7befa59eaab"
format_stamp: "Formatted at 2026-07-09 13:02:31 on dist-test-slave-szgt"
I20260709 13:02:31.797641   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:31.810221   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:31.811403   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:31.848343   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34449
I20260709 13:02:31.848443  7857 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34449 every 8 connection(s)
I20260709 13:02:31.852880  7858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:31.863900  7858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab: Bootstrap starting.
I20260709 13:02:31.868616  7858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.872625  7858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab: No bootstrap required, opened a new log
I20260709 13:02:31.874789  7858 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d9d53d74e944dc38d0ff7befa59eaab" member_type: VOTER }
I20260709 13:02:31.875226  7858 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.875459  7858 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d9d53d74e944dc38d0ff7befa59eaab, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.876094  7858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d9d53d74e944dc38d0ff7befa59eaab" member_type: VOTER }
I20260709 13:02:31.876545  7858 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:31.876782  7858 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:31.877055  7858 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.881417  7858 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d9d53d74e944dc38d0ff7befa59eaab" member_type: VOTER }
I20260709 13:02:31.881912  7858 leader_election.cc:304] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d9d53d74e944dc38d0ff7befa59eaab; no voters: 
I20260709 13:02:31.883009  7858 leader_election.cc:290] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:31.883322  7861 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:31.884646  7861 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 1 LEADER]: Becoming Leader. State: Replica: 7d9d53d74e944dc38d0ff7befa59eaab, State: Running, Role: LEADER
I20260709 13:02:31.885366  7861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d9d53d74e944dc38d0ff7befa59eaab" member_type: VOTER }
I20260709 13:02:31.885896  7858 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:31.895558  7863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d9d53d74e944dc38d0ff7befa59eaab. Latest consensus state: current_term: 1 leader_uuid: "7d9d53d74e944dc38d0ff7befa59eaab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d9d53d74e944dc38d0ff7befa59eaab" member_type: VOTER } }
I20260709 13:02:31.895711  7862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d9d53d74e944dc38d0ff7befa59eaab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d9d53d74e944dc38d0ff7befa59eaab" member_type: VOTER } }
I20260709 13:02:31.896350  7863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:31.896459  7862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:31.898068  7871 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:31.902999  7871 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:31.904106   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:31.911252  7871 catalog_manager.cc:1383] Generated new cluster ID: abf9b431585a4f829e596cc60ff2c260
I20260709 13:02:31.911517  7871 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:31.922864  7871 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:31.923995  7871 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:31.941382  7871 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab: Generated new TSK 0
I20260709 13:02:31.941973  7871 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:31.970750   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:31.977341  7879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:31.978400  7880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:31.980877  7882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:31.981947   431 server_base.cc:1061] running on GCE node
I20260709 13:02:31.984014   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:31.984195   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:31.984324   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602151984307 us; error 0 us; skew 500 ppm
I20260709 13:02:31.984850   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:31.987068   431 webserver.cc:533] Webserver started at http://127.0.107.193:41495/ using document root <none> and password file <none>
I20260709 13:02:31.987648   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:31.987818   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:31.988021   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:31.989113   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-0-root/instance:
uuid: "77c8a837918d478fb10b627dfdbf90e4"
format_stamp: "Formatted at 2026-07-09 13:02:31 on dist-test-slave-szgt"
I20260709 13:02:31.993376   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:02:31.996390  7887 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:31.997169   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:31.997468   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "77c8a837918d478fb10b627dfdbf90e4"
format_stamp: "Formatted at 2026-07-09 13:02:31 on dist-test-slave-szgt"
I20260709 13:02:31.997762   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:32.015089   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:32.016245   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:32.017633   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:32.019842   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:32.020066   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.020295   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:32.020474   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.060842   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40547
I20260709 13:02:32.060949  7949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40547 every 8 connection(s)
I20260709 13:02:32.065515   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:32.072945  7954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:32.074033  7955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:32.077574   431 server_base.cc:1061] running on GCE node
W20260709 13:02:32.077917  7957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:32.080410   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:32.080634   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:32.080832  7950 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34449
I20260709 13:02:32.080832   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602152080814 us; error 0 us; skew 500 ppm
I20260709 13:02:32.081298  7950 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:32.081748   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:32.082106  7950 heartbeater.cc:507] Master 127.0.107.254:34449 requested a full tablet report, sending...
I20260709 13:02:32.084405   431 webserver.cc:533] Webserver started at http://127.0.107.194:40835/ using document root <none> and password file <none>
I20260709 13:02:32.084635  7823 ts_manager.cc:194] Registered new tserver with Master: 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:32.084934   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:32.085196   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:32.085457   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:32.086619  7823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54062
I20260709 13:02:32.086748   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-1-root/instance:
uuid: "17a4c4b3539b43108ef3481121d982bd"
format_stamp: "Formatted at 2026-07-09 13:02:32 on dist-test-slave-szgt"
I20260709 13:02:32.091423   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:02:32.094664  7962 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.095373   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:32.095645   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-1-root
uuid: "17a4c4b3539b43108ef3481121d982bd"
format_stamp: "Formatted at 2026-07-09 13:02:32 on dist-test-slave-szgt"
I20260709 13:02:32.095929   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:32.110373   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:32.111596   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:32.113010   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:32.115348   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:32.115563   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.115818   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:32.116034   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.156157   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36125
I20260709 13:02:32.156268  8024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36125 every 8 connection(s)
I20260709 13:02:32.161201   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:32.169786  8028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:32.171044  8029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:32.174203  8025 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34449
I20260709 13:02:32.174217   431 server_base.cc:1061] running on GCE node
I20260709 13:02:32.174839  8025 heartbeater.cc:461] Registering TS with master...
W20260709 13:02:32.174821  8031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:32.175894  8025 heartbeater.cc:507] Master 127.0.107.254:34449 requested a full tablet report, sending...
I20260709 13:02:32.176040   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:32.176388   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:32.176571   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602152176538 us; error 0 us; skew 500 ppm
I20260709 13:02:32.177325   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:32.177954  7823 ts_manager.cc:194] Registered new tserver with Master: 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:32.179543  7823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54070
I20260709 13:02:32.179872   431 webserver.cc:533] Webserver started at http://127.0.107.195:46515/ using document root <none> and password file <none>
I20260709 13:02:32.180467   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:32.180749   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:32.181074   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:32.182462   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-2-root/instance:
uuid: "cc7af07a29d1443b8a3c4a3770d52344"
format_stamp: "Formatted at 2026-07-09 13:02:32 on dist-test-slave-szgt"
I20260709 13:02:32.186537   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:02:32.189940  8036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.190759   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:32.191064   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-2-root
uuid: "cc7af07a29d1443b8a3c4a3770d52344"
format_stamp: "Formatted at 2026-07-09 13:02:32 on dist-test-slave-szgt"
I20260709 13:02:32.191363   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:32.202190   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:32.203524   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:32.204854   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:32.206982   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:32.207208   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.207449   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:32.207616   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.246763   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43745
I20260709 13:02:32.246826  8098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43745 every 8 connection(s)
I20260709 13:02:32.251796   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:32.259490  8102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:32.261063  8103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:32.264062  8105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:32.264326   431 server_base.cc:1061] running on GCE node
I20260709 13:02:32.265228  8099 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34449
I20260709 13:02:32.265554   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:02:32.265590  8099 heartbeater.cc:461] Registering TS with master...
W20260709 13:02:32.265906   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:32.266191   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602152266172 us; error 0 us; skew 500 ppm
I20260709 13:02:32.266659  8099 heartbeater.cc:507] Master 127.0.107.254:34449 requested a full tablet report, sending...
I20260709 13:02:32.266863   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:32.269060  7823 ts_manager.cc:194] Registered new tserver with Master: cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:32.269619   431 webserver.cc:533] Webserver started at http://127.0.107.196:34427/ using document root <none> and password file <none>
I20260709 13:02:32.270283   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:32.270527   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:32.270843   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:32.270954  7823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54072
I20260709 13:02:32.272518   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-3-root/instance:
uuid: "87b2df8987cd4ac0b02b0632752c3a24"
format_stamp: "Formatted at 2026-07-09 13:02:32 on dist-test-slave-szgt"
I20260709 13:02:32.277040   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:32.280303  8110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.281023   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:32.281292   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-3-root
uuid: "87b2df8987cd4ac0b02b0632752c3a24"
format_stamp: "Formatted at 2026-07-09 13:02:32 on dist-test-slave-szgt"
I20260709 13:02:32.281601   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:32.293385   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:32.294595   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:32.296223   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:32.298928   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:32.299218   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.299561   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:32.299746   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:32.339946   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:39391
I20260709 13:02:32.340030  8172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:39391 every 8 connection(s)
I20260709 13:02:32.354385  8173 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34449
I20260709 13:02:32.354782  8173 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:32.355551  8173 heartbeater.cc:507] Master 127.0.107.254:34449 requested a full tablet report, sending...
I20260709 13:02:32.357468  7823 ts_manager.cc:194] Registered new tserver with Master: 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:32.357954   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014429868s
I20260709 13:02:32.358882  7823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54082
I20260709 13:02:32.383919  7823 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54090:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:02:32.615396  7990 tablet_service.cc:1511] Processing CreateTablet for tablet 91a8f59ad4a54890b1b6e01058db213e (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:32.617296  7990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a8f59ad4a54890b1b6e01058db213e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.617091  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 35aead4728d347f19af0f42f8cdef593 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:32.618336  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 91a8f59ad4a54890b1b6e01058db213e (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:32.618795  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35aead4728d347f19af0f42f8cdef593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.619823  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a8f59ad4a54890b1b6e01058db213e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.626498  7913 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc05153abdb4954a1da06558e4961d8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:32.626143  7988 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce49c9d02c14d8b97ea4388e1928362 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:32.626060  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 35aead4728d347f19af0f42f8cdef593 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:32.627871  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc05153abdb4954a1da06558e4961d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.627871  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce49c9d02c14d8b97ea4388e1928362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.628804  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35aead4728d347f19af0f42f8cdef593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.656325  8190 tablet_bootstrap.cc:492] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:32.670491  8063 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc05153abdb4954a1da06558e4961d8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:32.670445  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 35aead4728d347f19af0f42f8cdef593 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:32.673969  8190 tablet_bootstrap.cc:654] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.681493  7913 tablet_service.cc:1511] Processing CreateTablet for tablet d49a6e4bb1e842ee88622db4dca5eca9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:32.674942  8062 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce49c9d02c14d8b97ea4388e1928362 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:32.675403  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc05153abdb4954a1da06558e4961d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.674038  8138 tablet_service.cc:1511] Processing CreateTablet for tablet 91a8f59ad4a54890b1b6e01058db213e (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:32.675916  8137 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc05153abdb4954a1da06558e4961d8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:32.681373  8061 tablet_service.cc:1511] Processing CreateTablet for tablet d49a6e4bb1e842ee88622db4dca5eca9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:32.675976  8189 tablet_bootstrap.cc:492] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:32.707243  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 08b5a7ece3ac41af97886d7a3aff6f0f (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:32.710626  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b5a7ece3ac41af97886d7a3aff6f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.698261  7988 tablet_service.cc:1511] Processing CreateTablet for tablet 69487ed068ba41aeabc5dddafc528950 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:32.678462  8136 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce49c9d02c14d8b97ea4388e1928362 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:32.712970  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35aead4728d347f19af0f42f8cdef593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.686117  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 08b5a7ece3ac41af97886d7a3aff6f0f (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:32.716784  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b5a7ece3ac41af97886d7a3aff6f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.717384  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce49c9d02c14d8b97ea4388e1928362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.717778  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce49c9d02c14d8b97ea4388e1928362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.687668  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 69487ed068ba41aeabc5dddafc528950 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:32.679984  7989 tablet_service.cc:1511] Processing CreateTablet for tablet d49a6e4bb1e842ee88622db4dca5eca9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:32.712247  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69487ed068ba41aeabc5dddafc528950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.685036  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 69487ed068ba41aeabc5dddafc528950 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:32.723615  8061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49a6e4bb1e842ee88622db4dca5eca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.726549  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49a6e4bb1e842ee88622db4dca5eca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.731328  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69487ed068ba41aeabc5dddafc528950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.732640  7990 tablet_service.cc:1511] Processing CreateTablet for tablet e1f4e5f4ba454fe887ce0f19d5b475f8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:32.733528  8059 tablet_service.cc:1511] Processing CreateTablet for tablet e1f4e5f4ba454fe887ce0f19d5b475f8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:32.735039  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f4e5f4ba454fe887ce0f19d5b475f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.734475  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 08b5a7ece3ac41af97886d7a3aff6f0f (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:32.738013  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b5a7ece3ac41af97886d7a3aff6f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.727066  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49a6e4bb1e842ee88622db4dca5eca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.739259  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc05153abdb4954a1da06558e4961d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.739940  7990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f4e5f4ba454fe887ce0f19d5b475f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.740875  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a8f59ad4a54890b1b6e01058db213e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.749023  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69487ed068ba41aeabc5dddafc528950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.768205  8133 tablet_service.cc:1511] Processing CreateTablet for tablet e1f4e5f4ba454fe887ce0f19d5b475f8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:32.769644  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f4e5f4ba454fe887ce0f19d5b475f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.803860  8192 tablet_bootstrap.cc:492] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:32.805915  8189 tablet_bootstrap.cc:654] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.816792  8190 tablet_bootstrap.cc:492] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:32.817369  8190 ts_tablet_manager.cc:1403] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.161s	user 0.042s	sys 0.094s
I20260709 13:02:32.819551  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb31e8f2e434d26bb70e47682995df3 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:32.820919  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb31e8f2e434d26bb70e47682995df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.823591  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb31e8f2e434d26bb70e47682995df3 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:32.823961  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb31e8f2e434d26bb70e47682995df3 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:32.825017  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb31e8f2e434d26bb70e47682995df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.825201  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb31e8f2e434d26bb70e47682995df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.840764  8192 tablet_bootstrap.cc:654] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.844648  8189 tablet_bootstrap.cc:492] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:32.820730  8190 raft_consensus.cc:359] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:32.845484  8190 raft_consensus.cc:385] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:32.845860  8190 raft_consensus.cc:740] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:32.846866  8190 consensus_queue.cc:260] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:32.847682  8194 tablet_bootstrap.cc:492] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:32.845184  8189 ts_tablet_manager.cc:1403] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.182s	user 0.017s	sys 0.006s
I20260709 13:02:32.854377  8134 tablet_service.cc:1511] Processing CreateTablet for tablet aefeddccd22947cb8bb9c24c3688456f (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:32.855744  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefeddccd22947cb8bb9c24c3688456f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.857617  8189 raft_consensus.cc:359] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:32.858397  8189 raft_consensus.cc:385] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:32.863234  7912 tablet_service.cc:1511] Processing CreateTablet for tablet aefeddccd22947cb8bb9c24c3688456f (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:32.864573  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefeddccd22947cb8bb9c24c3688456f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.864878  8194 tablet_bootstrap.cc:654] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.869637  8025 heartbeater.cc:499] Master 127.0.107.254:34449 was elected leader, sending a full tablet report...
I20260709 13:02:32.871058  8190 ts_tablet_manager.cc:1434] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.002s
I20260709 13:02:32.871620  8189 raft_consensus.cc:740] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:32.872260  8190 tablet_bootstrap.cc:492] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:32.872462  8189 consensus_queue.cc:260] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:32.880416  8190 tablet_bootstrap.cc:654] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.881309  7950 heartbeater.cc:499] Master 127.0.107.254:34449 was elected leader, sending a full tablet report...
I20260709 13:02:32.881630  8189 ts_tablet_manager.cc:1434] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:02:32.882773  8189 tablet_bootstrap.cc:492] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:32.891722  8189 tablet_bootstrap.cc:654] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.894192  7987 tablet_service.cc:1511] Processing CreateTablet for tablet aefeddccd22947cb8bb9c24c3688456f (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:32.895648  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefeddccd22947cb8bb9c24c3688456f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:32.899421  7870 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:32.899675  8192 tablet_bootstrap.cc:492] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:32.900642  8192 ts_tablet_manager.cc:1403] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.097s	user 0.005s	sys 0.008s
I20260709 13:02:32.904299  8189 tablet_bootstrap.cc:492] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:32.904320  8192 raft_consensus.cc:359] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:32.905457  8192 raft_consensus.cc:385] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:32.905952  8192 raft_consensus.cc:740] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:32.906060  8059 tablet_service.cc:1511] Processing CreateTablet for tablet ffeecb381a054a5e834ec07d2a92c30b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:32.905032  8189 ts_tablet_manager.cc:1403] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:02:32.907526  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffeecb381a054a5e834ec07d2a92c30b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:32.910709  8026 tablet.cc:2406] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:32.917433  8192 consensus_queue.cc:260] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:32.919636  8189 raft_consensus.cc:359] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:32.922726  8189 raft_consensus.cc:385] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:32.923835  8189 raft_consensus.cc:740] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:32.926653  8189 consensus_queue.cc:260] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:32.933326  8192 ts_tablet_manager.cc:1434] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:02:32.931396  8202 raft_consensus.cc:493] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.934152  8189 ts_tablet_manager.cc:1434] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:02:32.934480  8099 heartbeater.cc:499] Master 127.0.107.254:34449 was elected leader, sending a full tablet report...
I20260709 13:02:32.935012  8190 tablet_bootstrap.cc:492] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:32.935263  8189 tablet_bootstrap.cc:492] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:32.935530  8190 ts_tablet_manager.cc:1403] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.064s	user 0.037s	sys 0.015s
I20260709 13:02:32.934202  8202 raft_consensus.cc:515] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:32.938707  8190 raft_consensus.cc:359] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:32.939489  8190 raft_consensus.cc:385] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:32.939783  8190 raft_consensus.cc:740] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:32.940550  8190 consensus_queue.cc:260] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:32.949150  8190 ts_tablet_manager.cc:1434] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:02:32.937749  8192 tablet_bootstrap.cc:492] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:32.950138  8190 tablet_bootstrap.cc:492] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:32.951074  8189 tablet_bootstrap.cc:654] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.956596  8190 tablet_bootstrap.cc:654] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.959861  8202 leader_election.cc:290] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:32.969898  8189 tablet_bootstrap.cc:492] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:32.970544  8189 ts_tablet_manager.cc:1403] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:02:32.974567  8192 tablet_bootstrap.cc:654] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.975512  8189 raft_consensus.cc:359] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:32.979745  8189 raft_consensus.cc:385] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:32.980141  8189 raft_consensus.cc:740] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:32.980376  7915 tablet_service.cc:1511] Processing CreateTablet for tablet ffeecb381a054a5e834ec07d2a92c30b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:32.980964  8190 tablet_bootstrap.cc:492] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:32.981106  7989 tablet_service.cc:1511] Processing CreateTablet for tablet e761965cbcb44c408a097b79b0899da0 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:32.981757  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffeecb381a054a5e834ec07d2a92c30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.981343  8189 consensus_queue.cc:260] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:32.982434  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e761965cbcb44c408a097b79b0899da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:32.983966  8189 ts_tablet_manager.cc:1434] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:32.985031  8189 tablet_bootstrap.cc:492] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:32.991786  8189 tablet_bootstrap.cc:654] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:32.981493  8190 ts_tablet_manager.cc:1403] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.000s
I20260709 13:02:33.002327  8190 raft_consensus.cc:359] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:33.003376  8190 raft_consensus.cc:385] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.003762  8190 raft_consensus.cc:740] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.004727  8138 tablet_service.cc:1511] Processing CreateTablet for tablet ffeecb381a054a5e834ec07d2a92c30b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:33.004910  8190 consensus_queue.cc:260] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:33.011528  8190 ts_tablet_manager.cc:1434] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:02:33.014016  8190 tablet_bootstrap.cc:492] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:33.006659  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffeecb381a054a5e834ec07d2a92c30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.022768  8190 tablet_bootstrap.cc:654] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.030267  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35aead4728d347f19af0f42f8cdef593" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:33.031345  7925 raft_consensus.cc:2468] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:33.033918  8037 leader_election.cc:304] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:33.036080  8202 raft_consensus.cc:2804] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:33.036924  8202 raft_consensus.cc:493] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.037351  8202 raft_consensus.cc:3060] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.048288  8194 tablet_bootstrap.cc:492] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:33.048849  8194 ts_tablet_manager.cc:1403] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.202s	user 0.044s	sys 0.033s
I20260709 13:02:33.049031  8060 tablet_service.cc:1511] Processing CreateTablet for tablet e761965cbcb44c408a097b79b0899da0 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:33.049964  8135 tablet_service.cc:1511] Processing CreateTablet for tablet e761965cbcb44c408a097b79b0899da0 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:33.050128  7914 tablet_service.cc:1511] Processing CreateTablet for tablet be12bd60158949b196454b71328950b3 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:33.051421  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be12bd60158949b196454b71328950b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.051761  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e761965cbcb44c408a097b79b0899da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.052027  8194 raft_consensus.cc:359] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.052798  8194 raft_consensus.cc:385] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.050355  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e761965cbcb44c408a097b79b0899da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.053069  8194 raft_consensus.cc:740] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.053835  8194 consensus_queue.cc:260] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.054423  7988 tablet_service.cc:1511] Processing CreateTablet for tablet be12bd60158949b196454b71328950b3 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:33.061704  8202 raft_consensus.cc:515] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:33.064303  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be12bd60158949b196454b71328950b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.070432  8202 leader_election.cc:290] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:33.071028  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35aead4728d347f19af0f42f8cdef593" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:33.071619  7925 raft_consensus.cc:3060] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.080271  8190 tablet_bootstrap.cc:492] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:33.080828  8190 ts_tablet_manager.cc:1403] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.011s
I20260709 13:02:33.085915  7925 raft_consensus.cc:2468] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:33.087212  8037 leader_election.cc:304] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:33.088089  8202 raft_consensus.cc:2804] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:33.094076  8192 tablet_bootstrap.cc:492] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:33.094640  8192 ts_tablet_manager.cc:1403] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.157s	user 0.021s	sys 0.000s
I20260709 13:02:33.096261  8059 tablet_service.cc:1511] Processing CreateTablet for tablet be12bd60158949b196454b71328950b3 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:33.097385  8197 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.097628  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be12bd60158949b196454b71328950b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.097934  8197 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.098073  8202 raft_consensus.cc:697] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:33.101413  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35aead4728d347f19af0f42f8cdef593" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:33.102293  7999 raft_consensus.cc:3060] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.103181  8197 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:33.114993  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35aead4728d347f19af0f42f8cdef593" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:33.117960  8202 consensus_queue.cc:237] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:33.124725  8190 raft_consensus.cc:359] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.125484  8190 raft_consensus.cc:385] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.125784  8190 raft_consensus.cc:740] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.126562  8190 consensus_queue.cc:260] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.127084  8173 heartbeater.cc:499] Master 127.0.107.254:34449 was elected leader, sending a full tablet report...
I20260709 13:02:33.128865  8190 ts_tablet_manager.cc:1434] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.004s
I20260709 13:02:33.135721  8138 tablet_service.cc:1511] Processing CreateTablet for tablet b11950f22bed418aa2dbf7639e0bfb9b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:33.137010  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11950f22bed418aa2dbf7639e0bfb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.140866  8194 ts_tablet_manager.cc:1434] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.092s	user 0.020s	sys 0.024s
I20260709 13:02:33.141949  8194 tablet_bootstrap.cc:492] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:33.148254  7999 raft_consensus.cc:2468] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:33.150305  8189 tablet_bootstrap.cc:492] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:33.150830  8189 ts_tablet_manager.cc:1403] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.009s
I20260709 13:02:33.119100  8192 raft_consensus.cc:359] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.155287  8192 raft_consensus.cc:385] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.155640  8192 raft_consensus.cc:740] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.156445  8192 consensus_queue.cc:260] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.158631  8192 ts_tablet_manager.cc:1434] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.002s
I20260709 13:02:33.158957  8189 raft_consensus.cc:359] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:33.161083  8209 raft_consensus.cc:493] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.169606  8209 raft_consensus.cc:515] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.175366  8209 leader_election.cc:290] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:33.185667  8190 tablet_bootstrap.cc:492] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:33.169162  8189 raft_consensus.cc:385] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.186121  8192 tablet_bootstrap.cc:492] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:33.192621  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:33.194247  7888 leader_election.cc:343] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.194391  7915 tablet_service.cc:1511] Processing CreateTablet for tablet b11950f22bed418aa2dbf7639e0bfb9b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:33.196354  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11950f22bed418aa2dbf7639e0bfb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.203963  8195 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.204460  8195 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.206971  8195 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:33.192240  8189 raft_consensus.cc:740] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.217507  8194 tablet_bootstrap.cc:654] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.218863  8189 consensus_queue.cc:260] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:33.217541  7820 catalog_manager.cc:5697] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.220412  8195 raft_consensus.cc:493] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.220943  8195 raft_consensus.cc:515] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.223145  8195 leader_election.cc:290] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:33.225394  8189 ts_tablet_manager.cc:1434] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:02:33.230826  7988 tablet_service.cc:1511] Processing CreateTablet for tablet b11950f22bed418aa2dbf7639e0bfb9b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:33.232631  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11950f22bed418aa2dbf7639e0bfb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.239131  8189 tablet_bootstrap.cc:492] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:33.239046  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff8964cbfc34a829de298f8a261f5ac (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:33.240408  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff8964cbfc34a829de298f8a261f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.243883  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 4ca6d20b17dd439abc7de41f57b0e344 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:33.244999  8190 tablet_bootstrap.cc:654] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.244716  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff8964cbfc34a829de298f8a261f5ac (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:33.245175  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ca6d20b17dd439abc7de41f57b0e344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.245950  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff8964cbfc34a829de298f8a261f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.250669  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff8964cbfc34a829de298f8a261f5ac (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:33.251953  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff8964cbfc34a829de298f8a261f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.257398  8202 raft_consensus.cc:493] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.257923  8202 raft_consensus.cc:515] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.260002  8202 leader_election.cc:290] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:33.260838  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:33.261600  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:33.262288  7999 raft_consensus.cc:2468] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
W20260709 13:02:33.262925  8111 leader_election.cc:343] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.235277  8192 tablet_bootstrap.cc:654] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.263728  8040 leader_election.cc:304] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:33.263749  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:33.266119  8202 raft_consensus.cc:2804] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:33.266546  8202 raft_consensus.cc:493] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.266937  8202 raft_consensus.cc:3060] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:33.267321  8037 leader_election.cc:343] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.273733  8189 tablet_bootstrap.cc:654] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.274317  8062 tablet_service.cc:1511] Processing CreateTablet for tablet 4ca6d20b17dd439abc7de41f57b0e344 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:33.284757  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ca6d20b17dd439abc7de41f57b0e344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.303714  8138 tablet_service.cc:1511] Processing CreateTablet for tablet 4ca6d20b17dd439abc7de41f57b0e344 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:33.305114  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ca6d20b17dd439abc7de41f57b0e344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.310155  8197 raft_consensus.cc:493] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.310738  8197 raft_consensus.cc:515] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.320034  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:33.321235  8197 leader_election.cc:290] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
W20260709 13:02:33.322242  8111 leader_election.cc:343] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.322899  8111 leader_election.cc:304] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:33.324810  8209 raft_consensus.cc:2749] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:33.325888  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc05153abdb4954a1da06558e4961d8" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:33.327967  7888 leader_election.cc:343] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.331218  8194 tablet_bootstrap.cc:492] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:33.331792  8194 ts_tablet_manager.cc:1403] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.190s	user 0.012s	sys 0.010s
I20260709 13:02:33.332579  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 623d31b1b0e94c7580c2403f41e8a553 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:33.334271  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623d31b1b0e94c7580c2403f41e8a553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.335076  8194 raft_consensus.cc:359] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.335884  8194 raft_consensus.cc:385] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.336184  8194 raft_consensus.cc:740] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.337044  8194 consensus_queue.cc:260] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.339351  8194 ts_tablet_manager.cc:1434] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:33.339766  8202 raft_consensus.cc:515] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.368911  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:33.371017  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 623d31b1b0e94c7580c2403f41e8a553 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:33.375537  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623d31b1b0e94c7580c2403f41e8a553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.376111  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:33.376677  8194 tablet_bootstrap.cc:492] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:33.376482  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:33.377352  8000 raft_consensus.cc:3060] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:33.377602  8037 leader_election.cc:343] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.374454  7999 raft_consensus.cc:2468] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 0.
I20260709 13:02:33.374095  8134 tablet_service.cc:1511] Processing CreateTablet for tablet b5e13884242a4736ae8ed6f4dc84fa69 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:33.380061  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e13884242a4736ae8ed6f4dc84fa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.384783  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:33.385411  8059 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0220849a2f497ebf0514d72a9dfddb (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:33.386875  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0220849a2f497ebf0514d72a9dfddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.388525  8000 raft_consensus.cc:2468] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:33.388674  8192 tablet_bootstrap.cc:492] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:33.389395  8192 ts_tablet_manager.cc:1403] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.226s	user 0.032s	sys 0.026s
W20260709 13:02:33.386528  7963 leader_election.cc:343] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.389447  7988 tablet_service.cc:1511] Processing CreateTablet for tablet b5e13884242a4736ae8ed6f4dc84fa69 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:33.375404  8202 leader_election.cc:290] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:33.390830  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e13884242a4736ae8ed6f4dc84fa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.391248  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:33.391923  7925 raft_consensus.cc:2468] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:33.391845  7891 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:33.392932  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:33.393716  8074 raft_consensus.cc:2393] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:33.394593  7963 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:33.395105  8197 raft_consensus.cc:2804] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:33.395573  8197 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.395581  8195 raft_consensus.cc:2804] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:33.396052  8197 raft_consensus.cc:3060] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.396118  8195 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.396633  8195 raft_consensus.cc:3060] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.391834  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:33.404906  7914 tablet_service.cc:1511] Processing CreateTablet for tablet b5e13884242a4736ae8ed6f4dc84fa69 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:33.405153  8190 tablet_bootstrap.cc:492] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:33.410892  8040 leader_election.cc:304] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:33.413374  8192 raft_consensus.cc:359] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.414219  8192 raft_consensus.cc:385] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.414414  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0220849a2f497ebf0514d72a9dfddb (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:33.434737  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0220849a2f497ebf0514d72a9dfddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.420239  8202 raft_consensus.cc:2804] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:33.435348  8202 raft_consensus.cc:697] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:33.436944  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 47e337f219804508a9d4c890819e542c (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:33.438198  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e337f219804508a9d4c890819e542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.428390  8197 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.420913  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc05153abdb4954a1da06558e4961d8" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:33.437247  8202 consensus_queue.cc:237] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.423519  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 623d31b1b0e94c7580c2403f41e8a553 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
W20260709 13:02:33.440140  7888 leader_election.cc:343] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.415303  8190 ts_tablet_manager.cc:1403] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.269s	user 0.025s	sys 0.008s
I20260709 13:02:33.442746  7888 leader_election.cc:304] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:33.445840  8190 raft_consensus.cc:359] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.411345  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e13884242a4736ae8ed6f4dc84fa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.446612  8190 raft_consensus.cc:385] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.447086  8190 raft_consensus.cc:740] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.447804  8190 consensus_queue.cc:260] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:33.427386  7963 leader_election.cc:343] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.449249  7963 leader_election.cc:304] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:33.418001  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0220849a2f497ebf0514d72a9dfddb (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:33.450481  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623d31b1b0e94c7580c2403f41e8a553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.450740  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0220849a2f497ebf0514d72a9dfddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.432003  8194 tablet_bootstrap.cc:654] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.440824  8189 tablet_bootstrap.cc:492] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:33.453955  8062 tablet_service.cc:1511] Processing CreateTablet for tablet 47e337f219804508a9d4c890819e542c (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:33.459270  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e337f219804508a9d4c890819e542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.414592  8195 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.462983  8189 ts_tablet_manager.cc:1403] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.010s
I20260709 13:02:33.451086  8197 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:33.466096  8189 raft_consensus.cc:359] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.474223  8228 raft_consensus.cc:2749] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:33.475726  8227 raft_consensus.cc:493] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:33.477205  7963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 49832.4us
I20260709 13:02:33.477555  8230 raft_consensus.cc:2749] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:33.414623  8192 raft_consensus.cc:740] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.473443  8189 raft_consensus.cc:385] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.479663  8189 raft_consensus.cc:740] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.479957  8192 consensus_queue.cc:260] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.482241  8192 ts_tablet_manager.cc:1434] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.000s
I20260709 13:02:33.484493  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:33.484270  8189 consensus_queue.cc:260] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.487354  8189 ts_tablet_manager.cc:1434] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:02:33.488402  8189 tablet_bootstrap.cc:492] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:33.501168  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 99565f0cecd744f18755d8039eabf963 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:33.499194  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 47e337f219804508a9d4c890819e542c (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:33.502512  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99565f0cecd744f18755d8039eabf963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.502971  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 99565f0cecd744f18755d8039eabf963 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:33.504209  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99565f0cecd744f18755d8039eabf963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.502853  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e337f219804508a9d4c890819e542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.510331  8138 tablet_service.cc:1511] Processing CreateTablet for tablet 3ece29e9f66146e0bca321315b184bcc (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:33.511693  8195 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:33.514335  8189 tablet_bootstrap.cc:654] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.516270  8201 consensus_queue.cc:1048] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:33.517447  8192 tablet_bootstrap.cc:492] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:33.511868  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ece29e9f66146e0bca321315b184bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.522491  8192 tablet_bootstrap.cc:654] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.476219  8227 raft_consensus.cc:515] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.529881  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:33.530714  7999 raft_consensus.cc:2393] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 77c8a837918d478fb10b627dfdbf90e4 in current term 1: Already voted for candidate 17a4c4b3539b43108ef3481121d982bd in this term.
I20260709 13:02:33.532121  8227 leader_election.cc:290] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
W20260709 13:02:33.532521  7888 leader_election.cc:343] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.533248  8190 ts_tablet_manager.cc:1434] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.090s	user 0.012s	sys 0.009s
I20260709 13:02:33.534457  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 99565f0cecd744f18755d8039eabf963 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:33.535774  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99565f0cecd744f18755d8039eabf963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.541767  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 3ece29e9f66146e0bca321315b184bcc (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:33.543102  8059 tablet_service.cc:1511] Processing CreateTablet for tablet d912e9dce93246b191ef13bbfe19b004 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:33.544198  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ece29e9f66146e0bca321315b184bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.547102  8135 tablet_service.cc:1511] Processing CreateTablet for tablet d912e9dce93246b191ef13bbfe19b004 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:33.548465  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d912e9dce93246b191ef13bbfe19b004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.544399  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d912e9dce93246b191ef13bbfe19b004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.534660  8190 tablet_bootstrap.cc:492] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:33.562990  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:33.564183  7924 raft_consensus.cc:2393] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate 77c8a837918d478fb10b627dfdbf90e4 in this term.
I20260709 13:02:33.566998  8194 tablet_bootstrap.cc:492] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:33.567710  8194 ts_tablet_manager.cc:1403] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.200s	user 0.013s	sys 0.014s
I20260709 13:02:33.573698  7914 tablet_service.cc:1511] Processing CreateTablet for tablet d912e9dce93246b191ef13bbfe19b004 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:33.575191  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d912e9dce93246b191ef13bbfe19b004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.575577  7891 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:33.575809  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:33.576457  8228 raft_consensus.cc:2749] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:33.577879  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce49c9d02c14d8b97ea4388e1928362" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:33.579000  7963 leader_election.cc:343] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.579540  7963 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:33.579828  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce49c9d02c14d8b97ea4388e1928362" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:33.580566  8230 raft_consensus.cc:2749] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:02:33.580991  7963 leader_election.cc:343] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.580513  8148 raft_consensus.cc:2468] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:33.584673  8194 raft_consensus.cc:359] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.585585  8194 raft_consensus.cc:385] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.585901  8194 raft_consensus.cc:740] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.587783  7963 leader_election.cc:304] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:33.589600  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 3ece29e9f66146e0bca321315b184bcc (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:33.586760  8194 consensus_queue.cc:260] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.591431  8230 raft_consensus.cc:2804] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:33.592005  8230 raft_consensus.cc:493] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.592561  8230 raft_consensus.cc:3060] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.593585  8228 raft_consensus.cc:493] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.594267  8228 raft_consensus.cc:515] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:33.597333  8228 leader_election.cc:290] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:33.598970  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69487ed068ba41aeabc5dddafc528950" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:33.600930  7888 leader_election.cc:343] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.607139  8230 raft_consensus.cc:515] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.622548  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ece29e9f66146e0bca321315b184bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.623402  8189 tablet_bootstrap.cc:492] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:33.626464  8189 ts_tablet_manager.cc:1403] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.012s
I20260709 13:02:33.627417  8230 leader_election.cc:290] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:33.624302  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69487ed068ba41aeabc5dddafc528950" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:33.629513  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce49c9d02c14d8b97ea4388e1928362" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:33.629654  8189 raft_consensus.cc:359] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.630388  8189 raft_consensus.cc:385] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.630726  8189 raft_consensus.cc:740] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.632306  7823 catalog_manager.cc:5697] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:33.634519  7891 leader_election.cc:343] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.635702  7891 leader_election.cc:304] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:33.631780  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce49c9d02c14d8b97ea4388e1928362" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:33.636440  8228 raft_consensus.cc:2749] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:33.636818  8148 raft_consensus.cc:3060] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.639671  7988 tablet_service.cc:1511] Processing CreateTablet for tablet a1559ecc34a84f3bbfc97b60579b1ecd (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:33.640956  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1559ecc34a84f3bbfc97b60579b1ecd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:33.646975  7963 leader_election.cc:343] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.651473  8189 consensus_queue.cc:260] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.657101  8189 ts_tablet_manager.cc:1434] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:02:33.660334  8189 tablet_bootstrap.cc:492] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:33.658876  8148 raft_consensus.cc:2468] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:33.653203  8194 ts_tablet_manager.cc:1434] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.000s
I20260709 13:02:33.666963  8194 tablet_bootstrap.cc:492] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:33.670300  8209 raft_consensus.cc:493] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.670876  8209 raft_consensus.cc:515] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.671404  8135 tablet_service.cc:1511] Processing CreateTablet for tablet a1559ecc34a84f3bbfc97b60579b1ecd (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:33.672909  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1559ecc34a84f3bbfc97b60579b1ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.673641  8209 leader_election.cc:290] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:33.664348  8064 tablet_service.cc:1511] Processing CreateTablet for tablet a1559ecc34a84f3bbfc97b60579b1ecd (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:33.676946  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc05153abdb4954a1da06558e4961d8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:33.677223  8190 tablet_bootstrap.cc:654] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.677476  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc05153abdb4954a1da06558e4961d8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:33.678148  7924 raft_consensus.cc:2468] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
W20260709 13:02:33.679100  8111 leader_election.cc:343] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.680097  8111 leader_election.cc:304] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:33.682561  7963 leader_election.cc:304] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:33.682907  8209 raft_consensus.cc:2804] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:33.684473  8209 raft_consensus.cc:493] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.684831  8209 raft_consensus.cc:3060] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.685076  8192 tablet_bootstrap.cc:492] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:33.685595  8192 ts_tablet_manager.cc:1403] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.168s	user 0.020s	sys 0.016s
I20260709 13:02:33.687610  8230 raft_consensus.cc:2804] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:33.688180  8230 raft_consensus.cc:697] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:33.688691  8192 raft_consensus.cc:359] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.689011  8230 consensus_queue.cc:237] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.689464  8192 raft_consensus.cc:385] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.689276  8202 raft_consensus.cc:493] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.689891  8192 raft_consensus.cc:740] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.690156  8202 raft_consensus.cc:515] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.691182  8192 consensus_queue.cc:260] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.696367  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1559ecc34a84f3bbfc97b60579b1ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.697633  7987 tablet_service.cc:1511] Processing CreateTablet for tablet c30f9c4ed64f49d4a6b1e484c334a1a9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:33.698438  8190 tablet_bootstrap.cc:492] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:33.698983  8190 ts_tablet_manager.cc:1403] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.007s
I20260709 13:02:33.699786  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30f9c4ed64f49d4a6b1e484c334a1a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.705101  8190 raft_consensus.cc:359] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:33.705883  8190 raft_consensus.cc:385] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.706188  8190 raft_consensus.cc:740] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.711731  7915 tablet_service.cc:1511] Processing CreateTablet for tablet c30f9c4ed64f49d4a6b1e484c334a1a9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:33.711985  8060 tablet_service.cc:1511] Processing CreateTablet for tablet c30f9c4ed64f49d4a6b1e484c334a1a9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:33.712380  8190 consensus_queue.cc:260] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:33.713145  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30f9c4ed64f49d4a6b1e484c334a1a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.713593  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c30f9c4ed64f49d4a6b1e484c334a1a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.720537  8192 ts_tablet_manager.cc:1434] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.002s
I20260709 13:02:33.718402  8190 ts_tablet_manager.cc:1434] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:02:33.727258  8189 tablet_bootstrap.cc:654] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.732743  8138 tablet_service.cc:1511] Processing CreateTablet for tablet c1f6e282d9af4b97b6361970cce263c2 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:33.733467  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:33.734218  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f6e282d9af4b97b6361970cce263c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.734117  7999 raft_consensus.cc:2468] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:33.738808  8190 tablet_bootstrap.cc:492] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:33.743885  7823 catalog_manager.cc:5697] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.749501  7914 tablet_service.cc:1511] Processing CreateTablet for tablet c1f6e282d9af4b97b6361970cce263c2 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:33.737519  8202 leader_election.cc:290] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:33.751524  8202 consensus_queue.cc:1048] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:33.757552  8192 tablet_bootstrap.cc:492] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:33.771144  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f6e282d9af4b97b6361970cce263c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.784580  8209 raft_consensus.cc:515] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.789503  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc05153abdb4954a1da06558e4961d8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:33.790163  8074 raft_consensus.cc:3060] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.798983  7988 tablet_service.cc:1511] Processing CreateTablet for tablet c1f6e282d9af4b97b6361970cce263c2 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:33.801436  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f6e282d9af4b97b6361970cce263c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:33.794021  8040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36125, user_credentials={real_user=slave}} blocked reactor thread for 64176.9us
I20260709 13:02:33.800102  8194 tablet_bootstrap.cc:654] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.800130  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:33.808552  8209 leader_election.cc:290] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:33.809644  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc05153abdb4954a1da06558e4961d8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:33.810304  7925 raft_consensus.cc:3060] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.813982  8074 raft_consensus.cc:2468] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:33.809675  8040 leader_election.cc:304] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:33.820497  8237 raft_consensus.cc:2804] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:33.820883  8237 raft_consensus.cc:493] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:33.821153  8037 leader_election.cc:343] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.821332  8237 raft_consensus.cc:3060] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.824079  8111 leader_election.cc:304] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:33.824846  8209 raft_consensus.cc:2804] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:33.826939  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 81919804d363474eb3975b2d6a675ac0 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:33.828210  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81919804d363474eb3975b2d6a675ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.828733  7925 raft_consensus.cc:2468] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:33.837507  8209 raft_consensus.cc:697] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:33.840479  8228 raft_consensus.cc:493] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.841162  8228 raft_consensus.cc:515] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.844913  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 326598313429494cb184f94c8b0ee3b9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:33.846217  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326598313429494cb184f94c8b0ee3b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.850293  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 81919804d363474eb3975b2d6a675ac0 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:33.851640  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81919804d363474eb3975b2d6a675ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.852451  8228 leader_election.cc:290] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:33.855690  7913 tablet_service.cc:1511] Processing CreateTablet for tablet efdc7706f4fd4d82beebc68dd83efef4 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:33.856971  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdc7706f4fd4d82beebc68dd83efef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.858712  8237 raft_consensus.cc:515] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.860572  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:33.860762  8237 leader_election.cc:290] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:33.861351  8237 consensus_queue.cc:1048] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:33.861428  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 326598313429494cb184f94c8b0ee3b9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:33.874014  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326598313429494cb184f94c8b0ee3b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:33.862391  7891 leader_election.cc:343] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.862979  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:33.875759  7999 raft_consensus.cc:3060] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:33.875882  8228 raft_consensus.cc:493] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.876361  8228 raft_consensus.cc:515] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:33.864046  8209 consensus_queue.cc:237] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.865139  8059 tablet_service.cc:1511] Processing CreateTablet for tablet 326598313429494cb184f94c8b0ee3b9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:33.866866  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
W20260709 13:02:33.880816  8037 leader_election.cc:343] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.881810  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326598313429494cb184f94c8b0ee3b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.868850  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 81919804d363474eb3975b2d6a675ac0 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:33.881675  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:33.883136  8000 raft_consensus.cc:2393] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c8a837918d478fb10b627dfdbf90e4 in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:33.885007  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81919804d363474eb3975b2d6a675ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.887665  7987 tablet_service.cc:1511] Processing CreateTablet for tablet efdc7706f4fd4d82beebc68dd83efef4 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:33.888870  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdc7706f4fd4d82beebc68dd83efef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.895387  8228 leader_election.cc:290] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:33.896425  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:33.896553  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:33.898532  7888 leader_election.cc:343] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:33.899051  7888 leader_election.cc:304] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:33.900189  7888 leader_election.cc:304] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:33.900990  8197 raft_consensus.cc:2749] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:33.901626  8197 raft_consensus.cc:3060] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:33.902262  7870 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:33.867702  8192 tablet_bootstrap.cc:654] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.922963  8062 tablet_service.cc:1511] Processing CreateTablet for tablet efdc7706f4fd4d82beebc68dd83efef4 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:33.924310  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdc7706f4fd4d82beebc68dd83efef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.938042  8189 tablet_bootstrap.cc:492] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:33.938875  8189 ts_tablet_manager.cc:1403] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.279s	user 0.019s	sys 0.015s
I20260709 13:02:33.939414  8197 raft_consensus.cc:2749] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:33.942951  8189 raft_consensus.cc:359] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:33.943957  8237 consensus_queue.cc:1048] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:33.948733  8190 tablet_bootstrap.cc:654] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:33.950291  8194 tablet_bootstrap.cc:492] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:33.950857  8194 ts_tablet_manager.cc:1403] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.284s	user 0.044s	sys 0.037s
I20260709 13:02:33.954826  7999 raft_consensus.cc:2468] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:33.954708  8194 raft_consensus.cc:359] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.955767  8194 raft_consensus.cc:385] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.956197  8040 leader_election.cc:304] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:33.957234  8237 raft_consensus.cc:2804] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:33.957695  8237 raft_consensus.cc:697] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:33.956177  8194 raft_consensus.cc:740] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.943936  8189 raft_consensus.cc:385] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:33.958491  8237 consensus_queue.cc:237] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:33.967947  8138 tablet_service.cc:1511] Processing CreateTablet for tablet 4a78d3bd51f64fda9a5f156b754231a4 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:33.978546  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 4a78d3bd51f64fda9a5f156b754231a4 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:33.973358  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a78d3bd51f64fda9a5f156b754231a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.981604  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a78d3bd51f64fda9a5f156b754231a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.983583  7823 catalog_manager.cc:5697] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.984186  8060 tablet_service.cc:1511] Processing CreateTablet for tablet e8f247634f9942119a6d67c513aa16ab (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:33.985934  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f247634f9942119a6d67c513aa16ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.965159  8189 raft_consensus.cc:740] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:33.999028  7913 tablet_service.cc:1511] Processing CreateTablet for tablet 4a78d3bd51f64fda9a5f156b754231a4 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:34.000454  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a78d3bd51f64fda9a5f156b754231a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.991847  8194 consensus_queue.cc:260] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.008496  8194 ts_tablet_manager.cc:1434] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:02:34.009766  8194 tablet_bootstrap.cc:492] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:34.013628  8133 tablet_service.cc:1511] Processing CreateTablet for tablet e8f247634f9942119a6d67c513aa16ab (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:34.015002  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f247634f9942119a6d67c513aa16ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.037997  8063 tablet_service.cc:1511] Processing CreateTablet for tablet f7ec32e1ae354730b6b9edf944d5e934 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:34.039531  8137 tablet_service.cc:1511] Processing CreateTablet for tablet f7ec32e1ae354730b6b9edf944d5e934 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:34.040575  7823 catalog_manager.cc:5697] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.022307  8209 raft_consensus.cc:493] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.042778  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ec32e1ae354730b6b9edf944d5e934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.042932  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ec32e1ae354730b6b9edf944d5e934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.043426  7913 tablet_service.cc:1511] Processing CreateTablet for tablet e8f247634f9942119a6d67c513aa16ab (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:34.044667  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f247634f9942119a6d67c513aa16ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.050874  8209 raft_consensus.cc:515] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.058444  8194 tablet_bootstrap.cc:654] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.073889  8209 leader_election.cc:290] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:34.074584  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:34.066045  8189 consensus_queue.cc:260] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.076296  8192 tablet_bootstrap.cc:492] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:34.076834  8192 ts_tablet_manager.cc:1403] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.340s	user 0.010s	sys 0.013s
I20260709 13:02:34.078336  8189 ts_tablet_manager.cc:1434] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.139s	user 0.009s	sys 0.000s
I20260709 13:02:34.079596  8189 tablet_bootstrap.cc:492] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:34.080092  8192 raft_consensus.cc:359] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.080838  8192 raft_consensus.cc:385] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.081128  8192 raft_consensus.cc:740] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.081835  8192 consensus_queue.cc:260] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.084656  8190 tablet_bootstrap.cc:492] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:34.091286  8190 ts_tablet_manager.cc:1403] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.361s	user 0.015s	sys 0.007s
I20260709 13:02:34.095407  8189 tablet_bootstrap.cc:654] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.099282  8192 ts_tablet_manager.cc:1434] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:02:34.107502  7988 tablet_service.cc:1511] Processing CreateTablet for tablet f7ec32e1ae354730b6b9edf944d5e934 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:02:34.108242  7963 consensus_peers.cc:597] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:34.110947  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 731b36cb6f91433d818856a5aa867b7d (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:34.114998  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731b36cb6f91433d818856a5aa867b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.120318  8230 raft_consensus.cc:493] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.120616  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ec32e1ae354730b6b9edf944d5e934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.120906  8230 raft_consensus.cc:515] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.121791  8192 tablet_bootstrap.cc:492] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:34.125880  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 731b36cb6f91433d818856a5aa867b7d (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:34.127439  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731b36cb6f91433d818856a5aa867b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.128748  8230 leader_election.cc:290] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:34.131814  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69487ed068ba41aeabc5dddafc528950" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:34.132045  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69487ed068ba41aeabc5dddafc528950" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:34.132709  7925 raft_consensus.cc:2468] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
W20260709 13:02:34.133278  7963 leader_election.cc:343] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:34.134053  7963 leader_election.cc:304] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:34.135188  8230 raft_consensus.cc:2804] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:34.135572  8230 raft_consensus.cc:493] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.135934  8230 raft_consensus.cc:3060] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.141513  8192 tablet_bootstrap.cc:654] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.153688  8063 tablet_service.cc:1511] Processing CreateTablet for tablet 731b36cb6f91433d818856a5aa867b7d (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:34.156956  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731b36cb6f91433d818856a5aa867b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.159971  7913 tablet_service.cc:1511] Processing CreateTablet for tablet 72f12b86efa14c62a7abac9a5e904f02 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:34.150833  8230 raft_consensus.cc:515] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.161286  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f12b86efa14c62a7abac9a5e904f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.161921  8189 tablet_bootstrap.cc:492] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:34.162406  8189 ts_tablet_manager.cc:1403] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.027s
I20260709 13:02:34.164108  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69487ed068ba41aeabc5dddafc528950" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:34.165117  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69487ed068ba41aeabc5dddafc528950" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
W20260709 13:02:34.165469  7963 leader_election.cc:343] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:34.165190  8189 raft_consensus.cc:359] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.165810  7925 raft_consensus.cc:3060] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.166031  8189 raft_consensus.cc:385] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.166420  8189 raft_consensus.cc:740] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.167145  8189 consensus_queue.cc:260] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.168617  8194 tablet_bootstrap.cc:492] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:34.169101  8194 ts_tablet_manager.cc:1403] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.160s	user 0.018s	sys 0.004s
I20260709 13:02:34.169356  8189 ts_tablet_manager.cc:1434] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:34.170300  8189 tablet_bootstrap.cc:492] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:34.172086  8194 raft_consensus.cc:359] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.172791  8194 raft_consensus.cc:385] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.173070  8194 raft_consensus.cc:740] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.173866  8194 consensus_queue.cc:260] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.175464  8137 tablet_service.cc:1511] Processing CreateTablet for tablet 72f12b86efa14c62a7abac9a5e904f02 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:34.179481  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f12b86efa14c62a7abac9a5e904f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.179524  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 72f12b86efa14c62a7abac9a5e904f02 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:34.179841  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5c76efc53c42d2858b26bbd9765c31 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:34.180770  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f12b86efa14c62a7abac9a5e904f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.181071  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5c76efc53c42d2858b26bbd9765c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.190966  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5c76efc53c42d2858b26bbd9765c31 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:34.192206  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5c76efc53c42d2858b26bbd9765c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.193065  8194 ts_tablet_manager.cc:1434] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:02:34.200839  8194 tablet_bootstrap.cc:492] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:34.201289  8197 raft_consensus.cc:493] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.201769  8197 raft_consensus.cc:515] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.203759  8197 leader_election.cc:290] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:34.204360  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:34.204653  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:34.205289  8148 raft_consensus.cc:2468] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 0.
I20260709 13:02:34.206925  7888 leader_election.cc:304] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
W20260709 13:02:34.207809  7888 leader_election.cc:343] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:34.208108  8194 tablet_bootstrap.cc:654] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.208244  8189 tablet_bootstrap.cc:654] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.208950  8197 raft_consensus.cc:2804] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:34.209460  8197 raft_consensus.cc:493] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.209846  8197 raft_consensus.cc:3060] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.217247  8190 raft_consensus.cc:359] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.217491  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5c76efc53c42d2858b26bbd9765c31 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:34.218199  8190 raft_consensus.cc:385] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.218914  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5c76efc53c42d2858b26bbd9765c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.218973  8190 raft_consensus.cc:740] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.222946  8190 consensus_queue.cc:260] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.199931  7925 raft_consensus.cc:2468] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:34.232949  8192 tablet_bootstrap.cc:492] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:34.233004  7963 leader_election.cc:304] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:34.233624  8192 ts_tablet_manager.cc:1403] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.007s
I20260709 13:02:34.237434  8192 raft_consensus.cc:359] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.238363  8192 raft_consensus.cc:385] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.228994  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:34.248106  8000 raft_consensus.cc:2393] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87b2df8987cd4ac0b02b0632752c3a24 in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:34.249374  8114 leader_election.cc:304] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:34.250496  8209 raft_consensus.cc:3060] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.251061  7988 tablet_service.cc:1511] Processing CreateTablet for tablet f05f3e48c8014333a190a26992b87f9d (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:34.252241  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 2079bb44476c41ef908915825b1fa87c (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:34.253897  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 2079bb44476c41ef908915825b1fa87c (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:34.255157  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2079bb44476c41ef908915825b1fa87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.255956  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 2e294669f34040248436fbc8c97e5087 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:34.257167  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e294669f34040248436fbc8c97e5087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.230494  8230 leader_election.cc:290] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:34.225970  8197 raft_consensus.cc:515] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.242398  8137 tablet_service.cc:1511] Processing CreateTablet for tablet f05f3e48c8014333a190a26992b87f9d (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:34.244344  8063 tablet_service.cc:1511] Processing CreateTablet for tablet f05f3e48c8014333a190a26992b87f9d (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:34.258566  8209 raft_consensus.cc:2749] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:34.259598  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05f3e48c8014333a190a26992b87f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.259831  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05f3e48c8014333a190a26992b87f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.260778  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 2079bb44476c41ef908915825b1fa87c (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:34.262034  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2079bb44476c41ef908915825b1fa87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.245388  8189 tablet_bootstrap.cc:492] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:34.267135  8189 ts_tablet_manager.cc:1403] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.000s
I20260709 13:02:34.272507  8201 raft_consensus.cc:493] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.273108  8201 raft_consensus.cc:515] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.273587  8230 consensus_queue.cc:1048] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:34.276403  8201 leader_election.cc:290] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:34.279093  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:34.279969  7925 raft_consensus.cc:2468] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:34.281497  8037 leader_election.cc:304] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:34.281945  8197 leader_election.cc:290] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:34.282536  8201 raft_consensus.cc:2804] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:34.282989  8201 raft_consensus.cc:493] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.283175  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:34.283442  8230 raft_consensus.cc:493] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.283829  8147 raft_consensus.cc:3060] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.284001  8230 raft_consensus.cc:515] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.286000  8230 leader_election.cc:290] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:34.247442  8194 tablet_bootstrap.cc:492] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:34.283345  8201 raft_consensus.cc:3060] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.287147  8194 ts_tablet_manager.cc:1403] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.003s
I20260709 13:02:34.288422  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:34.291088  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:34.291582  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:34.291962  7925 raft_consensus.cc:2468] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
W20260709 13:02:34.293206  7888 leader_election.cc:343] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:34.293972  7963 leader_election.cc:304] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:34.290591  8194 raft_consensus.cc:359] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.294698  8194 raft_consensus.cc:385] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.295042  8194 raft_consensus.cc:740] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.295850  8194 consensus_queue.cc:260] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.298606  8194 ts_tablet_manager.cc:1434] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:34.259836  8192 raft_consensus.cc:740] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.300042  8194 tablet_bootstrap.cc:492] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:34.300580  8147 raft_consensus.cc:2468] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:34.300709  8230 raft_consensus.cc:2804] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:34.302492  8230 raft_consensus.cc:493] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.302898  8230 raft_consensus.cc:3060] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.303095  7888 leader_election.cc:304] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:34.303680  8192 consensus_queue.cc:260] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.304610  8197 raft_consensus.cc:2804] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:34.305181  8197 raft_consensus.cc:697] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:34.306003  8197 consensus_queue.cc:237] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.306275  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 2e294669f34040248436fbc8c97e5087 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:34.307603  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e294669f34040248436fbc8c97e5087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.310990  8189 raft_consensus.cc:359] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.311748  8189 raft_consensus.cc:385] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.312012  8189 raft_consensus.cc:740] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.246975  8263 raft_consensus.cc:2804] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:34.312875  8263 raft_consensus.cc:697] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:34.313679  8263 consensus_queue.cc:237] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.320048  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 2e294669f34040248436fbc8c97e5087 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:34.324084  7823 catalog_manager.cc:5697] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.337133  8192 ts_tablet_manager.cc:1434] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.002s
I20260709 13:02:34.338176  8192 tablet_bootstrap.cc:492] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:34.339507  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05f3e48c8014333a190a26992b87f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.341665  8194 tablet_bootstrap.cc:654] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.347270  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2079bb44476c41ef908915825b1fa87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.346490  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:34.348094  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e294669f34040248436fbc8c97e5087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.352291  8190 ts_tablet_manager.cc:1434] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.240s	user 0.006s	sys 0.005s
I20260709 13:02:34.353724  8190 tablet_bootstrap.cc:492] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:34.356654  8194 tablet_bootstrap.cc:492] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:34.357293  8194 ts_tablet_manager.cc:1403] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.003s
I20260709 13:02:34.359951  8201 raft_consensus.cc:515] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.361554  8074 raft_consensus.cc:2393] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:34.363421  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:34.363729  8189 consensus_queue.cc:260] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.364044  7925 raft_consensus.cc:3060] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.364030  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:34.365887  8189 ts_tablet_manager.cc:1434] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.001s
I20260709 13:02:34.369709  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 1b60099f55e74a53b4e0533192c560dd (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:34.371008  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b60099f55e74a53b4e0533192c560dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.372320  8137 tablet_service.cc:1511] Processing CreateTablet for tablet 1b60099f55e74a53b4e0533192c560dd (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:34.373656  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b60099f55e74a53b4e0533192c560dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.378607  8194 raft_consensus.cc:359] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.379515  8194 raft_consensus.cc:385] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.379894  8194 raft_consensus.cc:740] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.379731  8202 consensus_queue.cc:1048] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:34.381785  8194 consensus_queue.cc:260] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.387240  7925 raft_consensus.cc:2468] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:34.388649  8037 leader_election.cc:304] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:34.389544  8202 raft_consensus.cc:2804] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:34.390060  8202 raft_consensus.cc:697] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:34.390854  8202 consensus_queue.cc:237] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.397292  8190 tablet_bootstrap.cc:654] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.399103  8189 tablet_bootstrap.cc:492] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:34.402858  8201 leader_election.cc:290] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:34.407023  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 1b60099f55e74a53b4e0533192c560dd (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:34.408193  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b60099f55e74a53b4e0533192c560dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.408247  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 3e74617d411849f2a2d0ffb987f974a8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:34.409387  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e74617d411849f2a2d0ffb987f974a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.415521  8197 raft_consensus.cc:493] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.416031  8197 raft_consensus.cc:515] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.418185  8197 leader_election.cc:290] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:34.420002  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefeddccd22947cb8bb9c24c3688456f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:34.420279  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefeddccd22947cb8bb9c24c3688456f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:34.420689  8147 raft_consensus.cc:2468] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 0.
I20260709 13:02:34.346911  8230 raft_consensus.cc:515] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
W20260709 13:02:34.421762  7891 leader_election.cc:343] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:34.422981  7888 leader_election.cc:304] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:34.424823  7999 raft_consensus.cc:2393] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc7af07a29d1443b8a3c4a3770d52344 in current term 1: Already voted for candidate 17a4c4b3539b43108ef3481121d982bd in this term.
I20260709 13:02:34.425323  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:34.427030  8230 leader_election.cc:290] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:34.432214  8190 tablet_bootstrap.cc:492] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:34.433494  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb31e8f2e434d26bb70e47682995df3" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:34.439286  8190 ts_tablet_manager.cc:1403] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.007s
I20260709 13:02:34.439929  7925 raft_consensus.cc:2393] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:34.441120  8237 consensus_queue.cc:1048] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:34.441310  7963 leader_election.cc:304] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:34.442039  8190 raft_consensus.cc:359] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.422051  8194 ts_tablet_manager.cc:1434] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.064s	user 0.014s	sys 0.014s
I20260709 13:02:34.442920  8190 raft_consensus.cc:385] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.443472  8190 raft_consensus.cc:740] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.437614  7823 catalog_manager.cc:5697] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.445423  8190 consensus_queue.cc:260] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.446635  8263 raft_consensus.cc:2749] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:34.437909  8138 tablet_service.cc:1511] Processing CreateTablet for tablet 3e74617d411849f2a2d0ffb987f974a8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:34.447454  8190 ts_tablet_manager.cc:1434] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:34.448045  8192 tablet_bootstrap.cc:654] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.447832  8209 consensus_queue.cc:1048] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:34.448362  8190 tablet_bootstrap.cc:492] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:34.438658  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 3e74617d411849f2a2d0ffb987f974a8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:34.449405  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e74617d411849f2a2d0ffb987f974a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.432276  8197 raft_consensus.cc:2804] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:34.451184  8197 raft_consensus.cc:493] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.451632  8197 raft_consensus.cc:3060] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.447880  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e74617d411849f2a2d0ffb987f974a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.458530  7914 tablet_service.cc:1511] Processing CreateTablet for tablet b1e60fd6b5324519ad6b01b87733d566 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:34.459316  8270 raft_consensus.cc:493] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.459870  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e60fd6b5324519ad6b01b87733d566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.459794  8270 raft_consensus.cc:515] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.463166  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69487ed068ba41aeabc5dddafc528950" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:34.443929  8194 tablet_bootstrap.cc:492] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:34.471830  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69487ed068ba41aeabc5dddafc528950" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:34.472646  7924 raft_consensus.cc:2393] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87b2df8987cd4ac0b02b0632752c3a24 in current term 1: Already voted for candidate 17a4c4b3539b43108ef3481121d982bd in this term.
I20260709 13:02:34.475046  8111 leader_election.cc:304] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:34.476753  8209 raft_consensus.cc:3060] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.477602  8190 tablet_bootstrap.cc:654] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.481544  8270 leader_election.cc:290] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:34.482393  8270 consensus_queue.cc:1048] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:34.485638  8189 tablet_bootstrap.cc:654] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.487808  8197 raft_consensus.cc:515] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.492337  7988 tablet_service.cc:1511] Processing CreateTablet for tablet b1e60fd6b5324519ad6b01b87733d566 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:34.493544  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e60fd6b5324519ad6b01b87733d566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.498588  8270 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.500438  8270 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.496353  7823 catalog_manager.cc:5697] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.503087  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:34.503914  7924 raft_consensus.cc:2393] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87b2df8987cd4ac0b02b0632752c3a24 in current term 1: Already voted for candidate 77c8a837918d478fb10b627dfdbf90e4 in this term.
I20260709 13:02:34.512481  8073 raft_consensus.cc:3060] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.513129  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefeddccd22947cb8bb9c24c3688456f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:34.513990  8000 raft_consensus.cc:3060] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.515834  8063 tablet_service.cc:1511] Processing CreateTablet for tablet b1e60fd6b5324519ad6b01b87733d566 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:34.517284  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e60fd6b5324519ad6b01b87733d566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.523887  8000 raft_consensus.cc:2468] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:34.525489  7891 leader_election.cc:304] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:34.526736  8228 raft_consensus.cc:2804] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:34.532420  8209 raft_consensus.cc:2749] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:34.535043  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:34.535844  7998 raft_consensus.cc:2393] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87b2df8987cd4ac0b02b0632752c3a24 in current term 1: Already voted for candidate 17a4c4b3539b43108ef3481121d982bd in this term.
I20260709 13:02:34.537326  8114 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:34.538951  7912 tablet_service.cc:1511] Processing CreateTablet for tablet f0855572867543ee8bed7e2b29bb3005 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:34.540246  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0855572867543ee8bed7e2b29bb3005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.544155  8192 tablet_bootstrap.cc:492] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:34.544394  8228 raft_consensus.cc:697] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:34.544883  8192 ts_tablet_manager.cc:1403] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.207s	user 0.007s	sys 0.006s
I20260709 13:02:34.545331  8228 consensus_queue.cc:237] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:34.545384  8133 tablet_service.cc:1511] Processing CreateTablet for tablet f0855572867543ee8bed7e2b29bb3005 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:34.547966  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0855572867543ee8bed7e2b29bb3005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.548385  8192 raft_consensus.cc:359] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.557740  8189 tablet_bootstrap.cc:492] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:34.569705  8189 ts_tablet_manager.cc:1403] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.203s	user 0.013s	sys 0.000s
I20260709 13:02:34.570505  8192 raft_consensus.cc:385] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.571404  8194 tablet_bootstrap.cc:654] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.572283  8209 raft_consensus.cc:3060] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.571017  8192 raft_consensus.cc:740] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.565534  8270 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:34.584231  8209 raft_consensus.cc:2749] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:34.585405  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 88cafbe600ba4345a1a6fd83c004006b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:34.569581  8197 leader_election.cc:290] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:34.589293  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88cafbe600ba4345a1a6fd83c004006b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.589995  8190 tablet_bootstrap.cc:492] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:34.590498  8190 ts_tablet_manager.cc:1403] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.142s	user 0.027s	sys 0.012s
I20260709 13:02:34.593317  8190 raft_consensus.cc:359] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.594116  8190 raft_consensus.cc:385] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.594381  8190 raft_consensus.cc:740] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.595109  8190 consensus_queue.cc:260] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.597327  8190 ts_tablet_manager.cc:1434] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:34.596967  8189 raft_consensus.cc:359] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.598513  8189 raft_consensus.cc:385] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.598804  8189 raft_consensus.cc:740] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.602111  8190 tablet_bootstrap.cc:492] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:34.602031  8189 consensus_queue.cc:260] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.610972  8192 consensus_queue.cc:260] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.613436  8192 ts_tablet_manager.cc:1434] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.000s
W20260709 13:02:34.603739  8111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 51110.5us
I20260709 13:02:34.617393  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 88cafbe600ba4345a1a6fd83c004006b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:34.619143  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefeddccd22947cb8bb9c24c3688456f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:34.620280  7988 tablet_service.cc:1511] Processing CreateTablet for tablet f0855572867543ee8bed7e2b29bb3005 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:34.623692  8148 raft_consensus.cc:3060] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.626317  8192 tablet_bootstrap.cc:492] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:34.628958  7823 catalog_manager.cc:5697] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.632553  8148 raft_consensus.cc:2468] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:34.634430  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0855572867543ee8bed7e2b29bb3005. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:34.634696  8114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36125, user_credentials={real_user=slave}} blocked reactor thread for 85854.2us
I20260709 13:02:34.635564  8189 ts_tablet_manager.cc:1434] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 13:02:34.636549  8189 tablet_bootstrap.cc:492] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:34.643039  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88cafbe600ba4345a1a6fd83c004006b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.652351  7988 tablet_service.cc:1511] Processing CreateTablet for tablet 7a51a0a61adf4ce19d7ce6f958f2451b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:34.652608  8201 raft_consensus.cc:493] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.653228  8201 raft_consensus.cc:515] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.654599  8063 tablet_service.cc:1511] Processing CreateTablet for tablet 7a51a0a61adf4ce19d7ce6f958f2451b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:34.655241  8201 leader_election.cc:290] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:34.655944  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a51a0a61adf4ce19d7ce6f958f2451b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.656978  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a51a0a61adf4ce19d7ce6f958f2451b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.657121  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 983879845d1844958e5fd90a18c596ee (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:34.657979  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983879845d1844958e5fd90a18c596ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.660643  8192 tablet_bootstrap.cc:654] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.660553  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:34.660593  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:34.663653  8138 tablet_service.cc:1511] Processing CreateTablet for tablet 7a51a0a61adf4ce19d7ce6f958f2451b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:34.671620  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a51a0a61adf4ce19d7ce6f958f2451b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.672297  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 20c215591dba4b6f96aab23f4aa927a3 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:34.673517  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c215591dba4b6f96aab23f4aa927a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.668776  7989 tablet_service.cc:1511] Processing CreateTablet for tablet a9da43a750ef48788d4da9f817f17b3c (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:34.676436  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9da43a750ef48788d4da9f817f17b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.680985  8194 tablet_bootstrap.cc:492] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:34.681478  8194 ts_tablet_manager.cc:1403] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.004s
I20260709 13:02:34.667599  7913 tablet_service.cc:1511] Processing CreateTablet for tablet a9da43a750ef48788d4da9f817f17b3c (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:34.684746  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9da43a750ef48788d4da9f817f17b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.665108  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 983879845d1844958e5fd90a18c596ee (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:34.689222  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983879845d1844958e5fd90a18c596ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.670390  8148 raft_consensus.cc:2393] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc7af07a29d1443b8a3c4a3770d52344 in current term 1: Already voted for candidate 77c8a837918d478fb10b627dfdbf90e4 in this term.
I20260709 13:02:34.690037  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 3b266a15c0d446148dc910d00fe07d0f (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:34.691411  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b266a15c0d446148dc910d00fe07d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.692098  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 983879845d1844958e5fd90a18c596ee (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:34.692565  8037 leader_election.cc:304] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:34.693197  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983879845d1844958e5fd90a18c596ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.694257  8059 tablet_service.cc:1511] Processing CreateTablet for tablet 20c215591dba4b6f96aab23f4aa927a3 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:34.695667  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c215591dba4b6f96aab23f4aa927a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.696516  8137 tablet_service.cc:1511] Processing CreateTablet for tablet a9da43a750ef48788d4da9f817f17b3c (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:34.697747  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9da43a750ef48788d4da9f817f17b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.697525  8062 tablet_service.cc:1511] Processing CreateTablet for tablet aab13524d2b346b598a1dba6c6756373 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:34.700215  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 20c215591dba4b6f96aab23f4aa927a3 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:34.700537  8134 tablet_service.cc:1511] Processing CreateTablet for tablet aab13524d2b346b598a1dba6c6756373 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:34.701453  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c215591dba4b6f96aab23f4aa927a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.702013  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab13524d2b346b598a1dba6c6756373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.703627  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab13524d2b346b598a1dba6c6756373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.703783  7990 tablet_service.cc:1511] Processing CreateTablet for tablet aab13524d2b346b598a1dba6c6756373 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:34.704958  7990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab13524d2b346b598a1dba6c6756373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.708230  8190 tablet_bootstrap.cc:654] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.668048  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 88cafbe600ba4345a1a6fd83c004006b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:34.722456  8201 raft_consensus.cc:3060] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:34.742339  8037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 49846.1us
I20260709 13:02:34.771605  8230 consensus_queue.cc:1048] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:34.777374  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 3b266a15c0d446148dc910d00fe07d0f (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:34.778528  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b266a15c0d446148dc910d00fe07d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.781350  8201 raft_consensus.cc:2749] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:34.786895  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 3b266a15c0d446148dc910d00fe07d0f (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:34.788018  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b266a15c0d446148dc910d00fe07d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.789963  8192 tablet_bootstrap.cc:492] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:34.786312  8189 tablet_bootstrap.cc:654] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.790148  8228 raft_consensus.cc:493] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.799993  8228 raft_consensus.cc:515] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.801613  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88cafbe600ba4345a1a6fd83c004006b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.802096  8228 leader_election.cc:290] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:34.803773  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be12bd60158949b196454b71328950b3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:34.805720  8136 tablet_service.cc:1511] Processing CreateTablet for tablet 7f6cabe1c12e4d4293ddb5333b2562d8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:02:34.807446  7891 leader_election.cc:343] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:34.785632  8190 tablet_bootstrap.cc:492] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:34.808800  8190 ts_tablet_manager.cc:1403] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.016s
I20260709 13:02:34.808667  8194 raft_consensus.cc:359] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.809408  8194 raft_consensus.cc:385] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.809705  8194 raft_consensus.cc:740] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.810799  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6cabe1c12e4d4293ddb5333b2562d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.795415  8192 ts_tablet_manager.cc:1403] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.169s	user 0.028s	sys 0.014s
I20260709 13:02:34.812431  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 7f6cabe1c12e4d4293ddb5333b2562d8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:34.814800  8202 consensus_queue.cc:1048] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:34.815363  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6cabe1c12e4d4293ddb5333b2562d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.817127  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be12bd60158949b196454b71328950b3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:34.821250  7988 tablet_service.cc:1511] Processing CreateTablet for tablet 7f6cabe1c12e4d4293ddb5333b2562d8 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:34.822386  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6cabe1c12e4d4293ddb5333b2562d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:34.818538  7888 leader_election.cc:343] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:34.823249  7888 leader_election.cc:304] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:34.824144  8228 raft_consensus.cc:2749] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:34.831883  8228 consensus_queue.cc:1048] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:34.833904  8190 raft_consensus.cc:359] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.834606  8190 raft_consensus.cc:385] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.834944  8190 raft_consensus.cc:740] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.835611  8190 consensus_queue.cc:260] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:34.837611  8190 ts_tablet_manager.cc:1434] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:02:34.838171  8132 tablet_service.cc:1511] Processing CreateTablet for tablet f75e786cc94c4cee9ae8ce44a2a42f47 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:34.839705  8060 tablet_service.cc:1511] Processing CreateTablet for tablet f75e786cc94c4cee9ae8ce44a2a42f47 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:34.840931  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75e786cc94c4cee9ae8ce44a2a42f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.838539  8190 tablet_bootstrap.cc:492] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:34.844184  8194 consensus_queue.cc:260] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.849423  8192 raft_consensus.cc:359] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.850360  8192 raft_consensus.cc:385] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.850710  8192 raft_consensus.cc:740] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.873703  7987 tablet_service.cc:1511] Processing CreateTablet for tablet b5968d0a9e5b4f10b650229017d01068 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:34.874963  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5968d0a9e5b4f10b650229017d01068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.887734  8194 ts_tablet_manager.cc:1434] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.206s	user 0.005s	sys 0.003s
I20260709 13:02:34.891016  8194 tablet_bootstrap.cc:492] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:34.890985  8192 consensus_queue.cc:260] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.889449  8197 raft_consensus.cc:493] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.892803  8132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75e786cc94c4cee9ae8ce44a2a42f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.903537  7914 tablet_service.cc:1511] Processing CreateTablet for tablet f75e786cc94c4cee9ae8ce44a2a42f47 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:02:34.904747  7870 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:34.905706  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 25ad60198ae44613945d4f009def4097 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:34.902264  8138 tablet_service.cc:1511] Processing CreateTablet for tablet b5968d0a9e5b4f10b650229017d01068 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:34.908613  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5968d0a9e5b4f10b650229017d01068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.910928  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 25ad60198ae44613945d4f009def4097 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:34.911145  8197 raft_consensus.cc:515] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.912065  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ad60198ae44613945d4f009def4097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.913164  8197 leader_election.cc:290] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:34.904731  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75e786cc94c4cee9ae8ce44a2a42f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.918409  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ad60198ae44613945d4f009def4097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.920931  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeecb381a054a5e834ec07d2a92c30b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:34.921180  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeecb381a054a5e834ec07d2a92c30b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:34.921612  8147 raft_consensus.cc:2468] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 0.
I20260709 13:02:34.921849  8073 raft_consensus.cc:2468] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 0.
I20260709 13:02:34.922510  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 25ad60198ae44613945d4f009def4097 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:34.923597  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ad60198ae44613945d4f009def4097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.925025  8063 tablet_service.cc:1511] Processing CreateTablet for tablet b5968d0a9e5b4f10b650229017d01068 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:34.926182  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5968d0a9e5b4f10b650229017d01068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.931429  8263 consensus_queue.cc:1048] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:34.940752  8263 raft_consensus.cc:493] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.940862  7988 tablet_service.cc:1511] Processing CreateTablet for tablet 7bc94f423a414af7b77b41c61009a3a7 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:34.941213  8263 raft_consensus.cc:515] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:34.941984  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bc94f423a414af7b77b41c61009a3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.944059  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 07417a526f87454faf6742412f2e65dd (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:34.945674  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07417a526f87454faf6742412f2e65dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.954648  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 07417a526f87454faf6742412f2e65dd (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:34.955914  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07417a526f87454faf6742412f2e65dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.959721  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 393c51858bb34dbda6f73fc33e498bca (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:34.960857  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393c51858bb34dbda6f73fc33e498bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.963258  8263 leader_election.cc:290] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:34.963828  7888 leader_election.cc:304] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:34.965901  8197 raft_consensus.cc:2804] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:34.966284  8197 raft_consensus.cc:493] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.966624  8197 raft_consensus.cc:3060] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.968590  8059 tablet_service.cc:1511] Processing CreateTablet for tablet 393c51858bb34dbda6f73fc33e498bca (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:34.969501  8228 consensus_queue.cc:1048] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:34.970346  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393c51858bb34dbda6f73fc33e498bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.972764  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 393c51858bb34dbda6f73fc33e498bca (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:34.973984  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393c51858bb34dbda6f73fc33e498bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.976513  8192 ts_tablet_manager.cc:1434] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.163s	user 0.006s	sys 0.001s
I20260709 13:02:34.977634  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e761965cbcb44c408a097b79b0899da0" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:34.982105  7963 leader_election.cc:343] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:34.982113  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e761965cbcb44c408a097b79b0899da0" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:34.986841  8243 consensus_queue.cc:1048] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:34.988590  8192 tablet_bootstrap.cc:492] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
W20260709 13:02:34.995328  7963 leader_election.cc:343] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:34.995807  7963 leader_election.cc:304] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:34.996418  8197 raft_consensus.cc:515] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:34.999763  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 07417a526f87454faf6742412f2e65dd (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:35.001200  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07417a526f87454faf6742412f2e65dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.032075  8189 tablet_bootstrap.cc:492] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.032629  8189 ts_tablet_manager.cc:1403] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.396s	user 0.015s	sys 0.034s
I20260709 13:02:35.060973  8297 raft_consensus.cc:2749] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.062577  8190 tablet_bootstrap.cc:654] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.062875  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 7bc94f423a414af7b77b41c61009a3a7 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:35.063947  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bc94f423a414af7b77b41c61009a3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.064805  7915 tablet_service.cc:1511] Processing CreateTablet for tablet c4dc3d5be218446ebeebf6018140a264 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:35.066066  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dc3d5be218446ebeebf6018140a264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.069227  8189 raft_consensus.cc:359] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.070148  8189 raft_consensus.cc:385] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.070480  8189 raft_consensus.cc:740] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
W20260709 13:02:35.047461  7963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39391, user_credentials={real_user=slave}} blocked reactor thread for 52155.5us
I20260709 13:02:35.073817  8189 consensus_queue.cc:260] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.077324  7989 tablet_service.cc:1511] Processing CreateTablet for tablet c4dc3d5be218446ebeebf6018140a264 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:35.078585  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dc3d5be218446ebeebf6018140a264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.081481  8197 leader_election.cc:290] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.083719  8138 tablet_service.cc:1511] Processing CreateTablet for tablet 7bc94f423a414af7b77b41c61009a3a7 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:35.087069  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bc94f423a414af7b77b41c61009a3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.093626  8194 tablet_bootstrap.cc:654] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.078354  8282 consensus_queue.cc:1048] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:35.110661  8064 tablet_service.cc:1511] Processing CreateTablet for tablet c4dc3d5be218446ebeebf6018140a264 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:35.114470  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dc3d5be218446ebeebf6018140a264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.136955  8192 tablet_bootstrap.cc:654] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.139380  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 767b01527e0d42ab9f574cee3fbbeaf9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:35.140570  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767b01527e0d42ab9f574cee3fbbeaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.112540  8137 tablet_service.cc:1511] Processing CreateTablet for tablet 767b01527e0d42ab9f574cee3fbbeaf9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:35.146886  8197 consensus_queue.cc:1048] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:35.147715  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767b01527e0d42ab9f574cee3fbbeaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.154026  8189 ts_tablet_manager.cc:1434] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.121s	user 0.021s	sys 0.003s
I20260709 13:02:35.156517  8189 tablet_bootstrap.cc:492] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.160683  8301 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.164271  8064 tablet_service.cc:1511] Processing CreateTablet for tablet d0d3c0e1e8574b868e633347d9be591b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:35.172367  8134 tablet_service.cc:1511] Processing CreateTablet for tablet d0d3c0e1e8574b868e633347d9be591b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:35.173316  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d3c0e1e8574b868e633347d9be591b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.173684  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d3c0e1e8574b868e633347d9be591b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.172461  8301 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.177325  8301 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.188194  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:35.188901  7999 raft_consensus.cc:2468] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:35.190267  7891 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
W20260709 13:02:35.167454  7888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39391, user_credentials={real_user=slave}} blocked reactor thread for 105677us
I20260709 13:02:35.200632  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeecb381a054a5e834ec07d2a92c30b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:35.201270  8073 raft_consensus.cc:3060] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.203672  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 767b01527e0d42ab9f574cee3fbbeaf9 (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:35.204995  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767b01527e0d42ab9f574cee3fbbeaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.208269  7915 tablet_service.cc:1511] Processing CreateTablet for tablet d0d3c0e1e8574b868e633347d9be591b (DEFAULT_TABLE table=test-workload [id=81d99470b01d44e3acfb77fcdc17c3b8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:35.208567  8194 tablet_bootstrap.cc:492] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:35.208354  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeecb381a054a5e834ec07d2a92c30b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:35.209123  8194 ts_tablet_manager.cc:1403] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.318s	user 0.010s	sys 0.004s
I20260709 13:02:35.209239  8148 raft_consensus.cc:3060] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.210978  8303 raft_consensus.cc:2804] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:35.211171  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.211556  8303 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.212093  8303 raft_consensus.cc:3060] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.212119  8146 raft_consensus.cc:2468] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:35.221014  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d3c0e1e8574b868e633347d9be591b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.264019  8189 tablet_bootstrap.cc:654] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.268913  8263 raft_consensus.cc:493] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.269467  8263 raft_consensus.cc:515] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.271483  8263 leader_election.cc:290] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:35.271931  8073 raft_consensus.cc:2468] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:35.272946  8194 raft_consensus.cc:359] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.273903  8194 raft_consensus.cc:385] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.274304  8194 raft_consensus.cc:740] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.275475  7888 leader_election.cc:304] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:35.275271  8194 consensus_queue.cc:260] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.276319  8282 raft_consensus.cc:2804] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.274070  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be12bd60158949b196454b71328950b3" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.254514  8148 raft_consensus.cc:2468] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:35.276836  8282 raft_consensus.cc:697] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:35.277148  7925 raft_consensus.cc:2468] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:35.277747  8282 consensus_queue.cc:237] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.278398  7963 leader_election.cc:304] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:35.278623  8194 ts_tablet_manager.cc:1434] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.069s	user 0.002s	sys 0.012s
I20260709 13:02:35.279325  8263 raft_consensus.cc:2804] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.279734  8194 tablet_bootstrap.cc:492] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:35.279707  8263 raft_consensus.cc:493] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.280355  8263 raft_consensus.cc:3060] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.278262  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be12bd60158949b196454b71328950b3" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:35.281967  7963 leader_election.cc:343] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.290521  8194 tablet_bootstrap.cc:654] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.292142  8190 tablet_bootstrap.cc:492] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:35.294780  8190 ts_tablet_manager.cc:1403] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.456s	user 0.023s	sys 0.005s
I20260709 13:02:35.295683  8189 tablet_bootstrap.cc:492] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.296172  8189 ts_tablet_manager.cc:1403] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.005s
I20260709 13:02:35.294040  8192 tablet_bootstrap.cc:492] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:35.297355  8192 ts_tablet_manager.cc:1403] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.309s	user 0.020s	sys 0.017s
I20260709 13:02:35.300451  8192 raft_consensus.cc:359] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.301191  8263 raft_consensus.cc:515] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.304040  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be12bd60158949b196454b71328950b3" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:35.304620  7925 raft_consensus.cc:3060] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.302294  8190 raft_consensus.cc:359] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.308282  8190 raft_consensus.cc:385] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.308601  8190 raft_consensus.cc:740] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.309319  8190 consensus_queue.cc:260] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.311376  8190 ts_tablet_manager.cc:1434] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:02:35.311793  7925 raft_consensus.cc:2468] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:35.312529  8190 tablet_bootstrap.cc:492] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:35.301205  8192 raft_consensus.cc:385] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.313053  8192 raft_consensus.cc:740] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.313130  7963 leader_election.cc:304] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:35.313812  8192 consensus_queue.cc:260] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.314211  8298 raft_consensus.cc:2804] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.314783  8298 raft_consensus.cc:697] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:35.315996  8192 ts_tablet_manager.cc:1434] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:02:35.315621  8298 consensus_queue.cc:237] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.308300  8303 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.318430  8303 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.299203  8189 raft_consensus.cc:359] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.319063  8189 raft_consensus.cc:385] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.319360  8189 raft_consensus.cc:740] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.319622  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:35.319746  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:35.320223  8147 raft_consensus.cc:3060] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.320356  7998 raft_consensus.cc:3060] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:35.321167  8263 leader_election.cc:290] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:35.322749  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be12bd60158949b196454b71328950b3" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:35.323249  8192 tablet_bootstrap.cc:492] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
W20260709 13:02:35.324159  7963 leader_election.cc:343] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.320036  8189 consensus_queue.cc:260] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.325860  8270 raft_consensus.cc:493] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.326376  8270 raft_consensus.cc:515] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.327843  7998 raft_consensus.cc:2468] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:35.328465  8270 leader_election.cc:290] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:35.330722  8189 ts_tablet_manager.cc:1434] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:02:35.330899  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:35.320338  8190 tablet_bootstrap.cc:654] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.331943  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.332955  8189 tablet_bootstrap.cc:492] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:35.332823  8114 leader_election.cc:343] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.332882  7925 raft_consensus.cc:2468] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:35.332929  7891 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:35.335107  8303 raft_consensus.cc:2804] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:35.335707  8303 raft_consensus.cc:697] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:35.336553  8303 consensus_queue.cc:237] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.335036  8111 leader_election.cc:304] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:35.339723  8270 raft_consensus.cc:2804] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.340099  8270 raft_consensus.cc:493] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.340417  8270 raft_consensus.cc:3060] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.342166  8189 tablet_bootstrap.cc:654] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.351378  8147 raft_consensus.cc:2468] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:35.353263  8270 raft_consensus.cc:515] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.356940  8243 raft_consensus.cc:493] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.357508  8194 tablet_bootstrap.cc:492] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:35.358043  8194 ts_tablet_manager.cc:1403] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.007s
I20260709 13:02:35.357712  8243 raft_consensus.cc:515] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.359405  7820 catalog_manager.cc:5697] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.359592  7823 catalog_manager.cc:5697] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.360934  8194 raft_consensus.cc:359] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.361611  8194 raft_consensus.cc:385] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.362035  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e761965cbcb44c408a097b79b0899da0" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.362792  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:35.363401  7925 raft_consensus.cc:3060] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.361868  8194 raft_consensus.cc:740] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.363411  8243 leader_election.cc:290] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.380999  8270 leader_election.cc:290] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:35.381048  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:35.370558  8194 consensus_queue.cc:260] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.382493  8147 raft_consensus.cc:2468] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
W20260709 13:02:35.382896  8114 leader_election.cc:343] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.383657  8194 ts_tablet_manager.cc:1434] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:02:35.367012  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e761965cbcb44c408a097b79b0899da0" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:35.384579  8000 raft_consensus.cc:2468] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:35.385066  8189 tablet_bootstrap.cc:492] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.376549  7925 raft_consensus.cc:2468] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:35.385448  8037 leader_election.cc:304] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:35.386125  8189 ts_tablet_manager.cc:1403] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.012s
I20260709 13:02:35.386502  8243 raft_consensus.cc:2804] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.386942  8243 raft_consensus.cc:493] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.387012  8111 leader_election.cc:304] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:35.387346  8243 raft_consensus.cc:3060] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.387831  8270 raft_consensus.cc:2804] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.388970  8189 raft_consensus.cc:359] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.389659  8189 raft_consensus.cc:385] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.389932  8189 raft_consensus.cc:740] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.390602  8189 consensus_queue.cc:260] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.381628  8192 tablet_bootstrap.cc:654] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.392493  8194 tablet_bootstrap.cc:492] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:35.397161  8243 raft_consensus.cc:515] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.400612  8189 ts_tablet_manager.cc:1434] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.003s
I20260709 13:02:35.400950  8270 raft_consensus.cc:697] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:35.401249  8303 raft_consensus.cc:493] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.401508  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e761965cbcb44c408a097b79b0899da0" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:35.401796  8303 raft_consensus.cc:515] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.402113  8000 raft_consensus.cc:3060] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.402071  8270 consensus_queue.cc:237] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.404623  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623d31b1b0e94c7580c2403f41e8a553" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:35.406102  7891 leader_election.cc:343] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.407189  8303 leader_election.cc:290] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:35.408453  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623d31b1b0e94c7580c2403f41e8a553" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:35.408736  8189 tablet_bootstrap.cc:492] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.409865  8000 raft_consensus.cc:2468] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
W20260709 13:02:35.410032  7888 leader_election.cc:343] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.410671  7888 leader_election.cc:304] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:35.411125  8040 leader_election.cc:304] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:35.412207  8202 raft_consensus.cc:2804] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.412822  8202 raft_consensus.cc:697] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:35.413676  8303 raft_consensus.cc:2749] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.413645  8202 consensus_queue.cc:237] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.419843  8189 tablet_bootstrap.cc:654] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.430506  8194 tablet_bootstrap.cc:654] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.430200  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e761965cbcb44c408a097b79b0899da0" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:35.431977  8243 leader_election.cc:290] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.432737  8147 raft_consensus.cc:3060] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.451395  8192 tablet_bootstrap.cc:492] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:35.451565  8190 tablet_bootstrap.cc:492] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:35.451926  8192 ts_tablet_manager.cc:1403] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.008s
I20260709 13:02:35.454798  8192 raft_consensus.cc:359] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.454456  7822 catalog_manager.cc:5697] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.455509  8192 raft_consensus.cc:385] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.455838  8192 raft_consensus.cc:740] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.456457  8194 tablet_bootstrap.cc:492] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:35.456517  8192 consensus_queue.cc:260] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.457134  8194 ts_tablet_manager.cc:1403] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.004s
I20260709 13:02:35.458845  8192 ts_tablet_manager.cc:1434] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:35.460271  8194 raft_consensus.cc:359] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.461015  8194 raft_consensus.cc:385] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.461024  8192 tablet_bootstrap.cc:492] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:35.460666  7820 catalog_manager.cc:5697] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 0 to 2, leader changed from <none> to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.461493  8194 raft_consensus.cc:740] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.462116  8190 ts_tablet_manager.cc:1403] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.005s
I20260709 13:02:35.462473  8194 consensus_queue.cc:260] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.463478  8303 raft_consensus.cc:493] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.463994  8303 raft_consensus.cc:515] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.464808  8194 ts_tablet_manager.cc:1434] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:35.465822  8194 tablet_bootstrap.cc:492] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:35.466084  8303 leader_election.cc:290] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.467697  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:35.467978  8192 tablet_bootstrap.cc:654] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.467891  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.468578  8148 raft_consensus.cc:2468] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 0.
W20260709 13:02:35.469061  7888 leader_election.cc:343] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.470201  8190 raft_consensus.cc:359] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.470661  8190 raft_consensus.cc:385] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.471001  8190 raft_consensus.cc:740] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.469825  7888 leader_election.cc:304] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:35.472471  8303 raft_consensus.cc:2804] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.472879  8303 raft_consensus.cc:493] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.473237  8303 raft_consensus.cc:3060] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.478029  8189 tablet_bootstrap.cc:492] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.478484  8189 ts_tablet_manager.cc:1403] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.070s	user 0.005s	sys 0.009s
I20260709 13:02:35.480675  8189 raft_consensus.cc:359] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.481215  8189 raft_consensus.cc:385] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.481432  8189 raft_consensus.cc:740] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.482025  8189 consensus_queue.cc:260] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.483553  8189 ts_tablet_manager.cc:1434] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:35.484366  8189 tablet_bootstrap.cc:492] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.489846  8189 tablet_bootstrap.cc:654] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.491303  8147 raft_consensus.cc:2468] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:35.494877  7821 catalog_manager.cc:5697] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.498054  8190 consensus_queue.cc:260] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.508459  8194 tablet_bootstrap.cc:654] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.509858  8190 ts_tablet_manager.cc:1434] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:02:35.513329  8190 tablet_bootstrap.cc:492] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:35.499935  8303 raft_consensus.cc:515] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.522022  8190 tablet_bootstrap.cc:654] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.528412  8189 tablet_bootstrap.cc:492] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.528932  8189 ts_tablet_manager.cc:1403] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.023s
I20260709 13:02:35.531803  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:35.532130  8189 raft_consensus.cc:359] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.532801  8189 raft_consensus.cc:385] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.533077  8189 raft_consensus.cc:740] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
W20260709 13:02:35.533238  7888 leader_election.cc:343] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.533740  8189 consensus_queue.cc:260] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.536921  8189 ts_tablet_manager.cc:1434] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:02:35.536749  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:35.537427  8147 raft_consensus.cc:3060] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.538607  8192 tablet_bootstrap.cc:492] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:35.539203  8192 ts_tablet_manager.cc:1403] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.016s
I20260709 13:02:35.541808  8192 raft_consensus.cc:359] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.542526  8192 raft_consensus.cc:385] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.542876  8192 raft_consensus.cc:740] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.543550  8192 consensus_queue.cc:260] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.545696  8192 ts_tablet_manager.cc:1434] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:35.547092  8192 tablet_bootstrap.cc:492] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:35.547011  8282 raft_consensus.cc:493] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.547812  8263 raft_consensus.cc:493] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.546797  8303 leader_election.cc:290] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.547839  8282 raft_consensus.cc:515] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.549722  8147 raft_consensus.cc:2468] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:35.551710  7888 leader_election.cc:304] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:35.552327  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:35.553627  8192 tablet_bootstrap.cc:654] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:35.553719  7891 leader_election.cc:343] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.553893  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.555267  8282 leader_election.cc:290] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
W20260709 13:02:35.555766  7888 leader_election.cc:343] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.556388  7888 leader_election.cc:304] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:35.557363  8300 raft_consensus.cc:2749] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.558394  8189 tablet_bootstrap.cc:492] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.548519  8263 raft_consensus.cc:515] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.563951  8194 tablet_bootstrap.cc:492] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:35.564527  8194 ts_tablet_manager.cc:1403] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.010s
I20260709 13:02:35.565220  8263 leader_election.cc:290] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:35.567601  8189 tablet_bootstrap.cc:654] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.568154  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.568266  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.569057  7925 raft_consensus.cc:2393] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate 87b2df8987cd4ac0b02b0632752c3a24 in this term.
I20260709 13:02:35.570593  7963 leader_election.cc:304] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:35.571228  8190 tablet_bootstrap.cc:492] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:35.571408  8263 raft_consensus.cc:3060] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.571861  8190 ts_tablet_manager.cc:1403] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.006s
I20260709 13:02:35.555841  8282 raft_consensus.cc:2804] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.577193  8189 tablet_bootstrap.cc:492] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.577690  8189 ts_tablet_manager.cc:1403] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.007s
I20260709 13:02:35.572793  8282 raft_consensus.cc:697] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:35.578577  8282 consensus_queue.cc:237] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.580680  8189 raft_consensus.cc:359] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.581362  8189 raft_consensus.cc:385] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.581444  8192 tablet_bootstrap.cc:492] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:35.581666  8189 raft_consensus.cc:740] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.582171  8192 ts_tablet_manager.cc:1403] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.004s
I20260709 13:02:35.582520  8189 consensus_queue.cc:260] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.583940  8263 raft_consensus.cc:2749] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.567349  8194 raft_consensus.cc:359] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.585038  8189 ts_tablet_manager.cc:1434] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:35.586493  8190 raft_consensus.cc:359] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.587417  8190 raft_consensus.cc:385] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.587713  8190 raft_consensus.cc:740] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.587966  8189 tablet_bootstrap.cc:492] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.588419  8190 consensus_queue.cc:260] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.586431  8192 raft_consensus.cc:359] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.589936  8192 raft_consensus.cc:385] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.590262  8192 raft_consensus.cc:740] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.590417  8190 ts_tablet_manager.cc:1434] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:02:35.591017  8192 consensus_queue.cc:260] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.591749  8190 tablet_bootstrap.cc:492] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:35.593894  8192 ts_tablet_manager.cc:1434] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:35.594336  8189 tablet_bootstrap.cc:654] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.595309  8194 raft_consensus.cc:385] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.595630  8194 raft_consensus.cc:740] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.595845  8192 tablet_bootstrap.cc:492] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:35.596400  8194 consensus_queue.cc:260] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.599552  8194 ts_tablet_manager.cc:1434] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 13:02:35.600469  8194 tablet_bootstrap.cc:492] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:35.603734  8192 tablet_bootstrap.cc:654] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.608286  8194 tablet_bootstrap.cc:654] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.609784  7823 catalog_manager.cc:5697] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.611644  8190 tablet_bootstrap.cc:654] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.614810  8192 tablet_bootstrap.cc:492] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:35.615310  8192 ts_tablet_manager.cc:1403] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:02:35.617871  8189 tablet_bootstrap.cc:492] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.618548  8189 ts_tablet_manager.cc:1403] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.003s
I20260709 13:02:35.618069  8192 raft_consensus.cc:359] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.619093  8192 raft_consensus.cc:385] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.619431  8192 raft_consensus.cc:740] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.620142  8192 consensus_queue.cc:260] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.622326  8192 ts_tablet_manager.cc:1434] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:35.622239  8189 raft_consensus.cc:359] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.623404  8189 raft_consensus.cc:385] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.623693  8192 tablet_bootstrap.cc:492] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:35.627998  8202 raft_consensus.cc:493] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.628396  8189 raft_consensus.cc:740] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.628501  8202 raft_consensus.cc:515] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.629246  8189 consensus_queue.cc:260] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.629932  8194 tablet_bootstrap.cc:492] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:35.630638  8194 ts_tablet_manager.cc:1403] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.007s
I20260709 13:02:35.630707  8202 leader_election.cc:290] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:35.631255  8189 ts_tablet_manager.cc:1434] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:02:35.632211  8189 tablet_bootstrap.cc:492] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.633359  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.633671  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.634482  8147 raft_consensus.cc:2393] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc7af07a29d1443b8a3c4a3770d52344 in current term 1: Already voted for candidate 77c8a837918d478fb10b627dfdbf90e4 in this term.
I20260709 13:02:35.635483  8037 leader_election.cc:304] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:35.636637  8202 raft_consensus.cc:3060] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.637647  8192 tablet_bootstrap.cc:654] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.637969  8190 tablet_bootstrap.cc:492] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:35.638470  8190 ts_tablet_manager.cc:1403] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:02:35.641278  8190 raft_consensus.cc:359] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.641916  8190 raft_consensus.cc:385] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.642184  8190 raft_consensus.cc:740] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.642994  8190 consensus_queue.cc:260] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.643652  8202 raft_consensus.cc:2749] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.633345  8194 raft_consensus.cc:359] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.644937  8194 raft_consensus.cc:385] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.645246  8190 ts_tablet_manager.cc:1434] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:35.645203  8194 raft_consensus.cc:740] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.646286  8194 consensus_queue.cc:260] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.649309  8189 tablet_bootstrap.cc:654] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.649375  8192 tablet_bootstrap.cc:492] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:35.650092  8192 ts_tablet_manager.cc:1403] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 13:02:35.652599  8194 ts_tablet_manager.cc:1434] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:02:35.653131  8192 raft_consensus.cc:359] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.653841  8192 raft_consensus.cc:385] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.654263  8192 raft_consensus.cc:740] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.654995  8190 tablet_bootstrap.cc:492] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:35.655144  8192 consensus_queue.cc:260] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.657471  8192 ts_tablet_manager.cc:1434] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:35.653872  8194 tablet_bootstrap.cc:492] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:35.659919  8192 tablet_bootstrap.cc:492] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:35.660240  8282 raft_consensus.cc:493] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.662627  8282 raft_consensus.cc:515] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.664742  8190 tablet_bootstrap.cc:654] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.664860  8282 leader_election.cc:290] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:35.666816  8263 raft_consensus.cc:493] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.667587  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ece29e9f66146e0bca321315b184bcc" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.668947  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ece29e9f66146e0bca321315b184bcc" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:35.669422  8202 raft_consensus.cc:493] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.669896  8202 raft_consensus.cc:515] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:35.670449  7888 leader_election.cc:343] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:35.671535  7891 leader_election.cc:343] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.670735  8194 tablet_bootstrap.cc:654] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.671952  7891 leader_election.cc:304] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:35.672367  8202 leader_election.cc:290] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.667372  8263 raft_consensus.cc:515] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.674400  8192 tablet_bootstrap.cc:654] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.675871  8263 leader_election.cc:290] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.678957  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca6d20b17dd439abc7de41f57b0e344" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:35.679785  8073 raft_consensus.cc:2468] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:35.681134  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca6d20b17dd439abc7de41f57b0e344" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.681908  8148 raft_consensus.cc:2468] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:35.683979  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca6d20b17dd439abc7de41f57b0e344" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:35.684754  8000 raft_consensus.cc:2468] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:35.686100  8040 leader_election.cc:304] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:35.687354  8202 raft_consensus.cc:2804] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.688967  8202 raft_consensus.cc:493] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.689386  8202 raft_consensus.cc:3060] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.693656  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca6d20b17dd439abc7de41f57b0e344" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.694518  8147 raft_consensus.cc:2468] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:35.696816  7963 leader_election.cc:304] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:35.699848  8282 raft_consensus.cc:2749] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.701216  8194 tablet_bootstrap.cc:492] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:35.701452  8189 tablet_bootstrap.cc:492] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.701706  8194 ts_tablet_manager.cc:1403] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.004s
I20260709 13:02:35.701938  8189 ts_tablet_manager.cc:1403] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.022s
I20260709 13:02:35.702973  8192 tablet_bootstrap.cc:492] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:35.703091  8303 raft_consensus.cc:493] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.703552  8192 ts_tablet_manager.cc:1403] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.011s
I20260709 13:02:35.703625  8303 raft_consensus.cc:515] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.704430  8194 raft_consensus.cc:359] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.704644  8189 raft_consensus.cc:359] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.705092  8194 raft_consensus.cc:385] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.705330  8189 raft_consensus.cc:385] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.705430  8194 raft_consensus.cc:740] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.705659  8303 leader_election.cc:290] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.705713  8189 raft_consensus.cc:740] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.706228  8194 consensus_queue.cc:260] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.706604  8192 raft_consensus.cc:359] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.707531  8192 raft_consensus.cc:385] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.707846  8192 raft_consensus.cc:740] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.706656  8189 consensus_queue.cc:260] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.708007  8194 ts_tablet_manager.cc:1434] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:35.708626  8192 consensus_queue.cc:260] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.710738  8192 ts_tablet_manager.cc:1434] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:35.711776  8192 tablet_bootstrap.cc:492] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:35.714064  8189 ts_tablet_manager.cc:1434] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:35.715019  8189 tablet_bootstrap.cc:492] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.717404  8192 tablet_bootstrap.cc:654] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.719049  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d912e9dce93246b191ef13bbfe19b004" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:35.720638  7888 leader_election.cc:343] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.721084  8194 tablet_bootstrap.cc:492] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:35.726867  8263 raft_consensus.cc:2804] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.727299  8263 raft_consensus.cc:493] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.727653  8263 raft_consensus.cc:3060] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.729081  8189 tablet_bootstrap.cc:654] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.730767  8298 raft_consensus.cc:493] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.731434  8298 raft_consensus.cc:515] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.733930  8298 leader_election.cc:290] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:35.736593  8194 tablet_bootstrap.cc:654] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.736744  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d912e9dce93246b191ef13bbfe19b004" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.736953  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99565f0cecd744f18755d8039eabf963" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.737653  7924 raft_consensus.cc:2468] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
W20260709 13:02:35.739260  7888 leader_election.cc:343] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.740517  7888 leader_election.cc:304] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:35.741762  8298 consensus_queue.cc:1048] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:35.742660  8303 raft_consensus.cc:2749] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.740680  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99565f0cecd744f18755d8039eabf963" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:35.743854  8073 raft_consensus.cc:2468] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:35.745286  8194 tablet_bootstrap.cc:492] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:35.745568  8192 tablet_bootstrap.cc:492] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:35.745890  8194 ts_tablet_manager.cc:1403] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 13:02:35.745982  8192 ts_tablet_manager.cc:1403] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.018s
I20260709 13:02:35.749123  8194 raft_consensus.cc:359] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.749325  8192 raft_consensus.cc:359] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.749904  8194 raft_consensus.cc:385] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.749979  8192 raft_consensus.cc:385] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.750311  8194 raft_consensus.cc:740] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.750607  8189 tablet_bootstrap.cc:492] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.750586  8192 raft_consensus.cc:740] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.751295  8194 consensus_queue.cc:260] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.751634  8192 consensus_queue.cc:260] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.751314  8189 ts_tablet_manager.cc:1403] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.007s
I20260709 13:02:35.753919  8192 ts_tablet_manager.cc:1434] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:35.756273  8192 tablet_bootstrap.cc:492] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:35.758160  8303 consensus_queue.cc:1048] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:35.758976  8189 raft_consensus.cc:359] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.759672  8189 raft_consensus.cc:385] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.760952  8263 raft_consensus.cc:515] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.745846  7963 leader_election.cc:304] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:35.766300  8192 tablet_bootstrap.cc:654] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.768070  8298 raft_consensus.cc:2804] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.768589  8298 raft_consensus.cc:493] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.769016  8298 raft_consensus.cc:3060] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.773291  8194 ts_tablet_manager.cc:1434] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:02:35.775682  8000 raft_consensus.cc:1275] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:35.777100  8194 tablet_bootstrap.cc:492] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:35.759922  8189 raft_consensus.cc:740] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.780627  8189 consensus_queue.cc:260] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.788884  8189 ts_tablet_manager.cc:1434] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:02:35.789153  8303 consensus_queue.cc:1048] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:35.790109  8300 consensus_queue.cc:1048] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:35.799572  8189 tablet_bootstrap.cc:492] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.807366  8241 consensus_queue.cc:1048] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:35.809302  8243 raft_consensus.cc:493] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.810066  8243 raft_consensus.cc:515] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.812158  8243 leader_election.cc:290] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:35.809149  8189 tablet_bootstrap.cc:654] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.814102  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be12bd60158949b196454b71328950b3" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:35.818204  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be12bd60158949b196454b71328950b3" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.822433  8037 leader_election.cc:304] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:35.823523  8243 raft_consensus.cc:2749] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.824285  8194 tablet_bootstrap.cc:654] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.824903  8147 raft_consensus.cc:1275] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:35.827070  8189 tablet_bootstrap.cc:492] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.831575  8270 raft_consensus.cc:493] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.846094  8189 ts_tablet_manager.cc:1403] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:02:35.846029  8270 raft_consensus.cc:515] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.846429  8303 consensus_queue.cc:1048] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:35.848203  8270 leader_election.cc:290] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:35.836297  8243 consensus_queue.cc:1048] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:35.849651  8189 raft_consensus.cc:359] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.850099  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:35.850349  8189 raft_consensus.cc:385] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.850636  8189 raft_consensus.cc:740] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.851714  8303 raft_consensus.cc:493] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.851771  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.852540  7925 raft_consensus.cc:2468] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:35.852303  8303 raft_consensus.cc:515] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.851929  8189 consensus_queue.cc:260] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.854401  8303 leader_election.cc:290] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:35.855108  8111 leader_election.cc:304] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:35.856226  8270 raft_consensus.cc:2804] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:35.856494  8114 leader_election.cc:343] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.856977  8270 raft_consensus.cc:493] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.857335  8270 raft_consensus.cc:3060] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.862424  8189 ts_tablet_manager.cc:1434] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:02:35.856233  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30f9c4ed64f49d4a6b1e484c334a1a9" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:35.866247  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30f9c4ed64f49d4a6b1e484c334a1a9" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:35.867504  7888 leader_election.cc:343] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:35.868446  7891 leader_election.cc:343] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.868610  8189 tablet_bootstrap.cc:492] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.871675  7891 leader_election.cc:304] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:35.864991  8243 raft_consensus.cc:493] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.872516  8243 raft_consensus.cc:515] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.872965  8303 raft_consensus.cc:2749] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.876101  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0220849a2f497ebf0514d72a9dfddb" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.877461  8148 raft_consensus.cc:2468] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:35.878713  8037 leader_election.cc:304] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:35.879793  8354 raft_consensus.cc:2804] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.881084  8354 raft_consensus.cc:493] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.881533  8354 raft_consensus.cc:3060] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.889931  8316 consensus_queue.cc:1048] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:35.878144  8270 raft_consensus.cc:515] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.894896  8270 leader_election.cc:290] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:35.895097  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:35.895694  7925 raft_consensus.cc:3060] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.895769  8194 tablet_bootstrap.cc:492] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:35.896624  8194 ts_tablet_manager.cc:1403] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.000s
I20260709 13:02:35.898169  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:35.899541  8303 raft_consensus.cc:493] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.900249  8303 raft_consensus.cc:515] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
W20260709 13:02:35.900600  8114 leader_election.cc:343] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.903146  8230 raft_consensus.cc:493] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.903654  8230 raft_consensus.cc:515] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.905995  8230 leader_election.cc:290] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:35.903177  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0220849a2f497ebf0514d72a9dfddb" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:35.903617  8303 leader_election.cc:290] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.910445  8189 tablet_bootstrap.cc:654] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.911475  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623d31b1b0e94c7580c2403f41e8a553" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.908869  8194 raft_consensus.cc:359] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.912124  7923 raft_consensus.cc:2468] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:35.912545  8194 raft_consensus.cc:385] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.915426  8194 raft_consensus.cc:740] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.915692  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623d31b1b0e94c7580c2403f41e8a553" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:35.916425  8073 raft_consensus.cc:2468] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:35.915987  8202 raft_consensus.cc:515] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.917057  8194 consensus_queue.cc:260] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.918991  8073 raft_consensus.cc:3060] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.919332  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca6d20b17dd439abc7de41f57b0e344" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:35.920138  7997 raft_consensus.cc:2393] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc7af07a29d1443b8a3c4a3770d52344 in current term 1: Already voted for candidate 17a4c4b3539b43108ef3481121d982bd in this term.
I20260709 13:02:35.914675  8354 raft_consensus.cc:515] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.921088  8316 raft_consensus.cc:493] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.921599  8316 raft_consensus.cc:515] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.922989  8354 leader_election.cc:290] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:35.924551  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0220849a2f497ebf0514d72a9dfddb" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:35.925384  8316 leader_election.cc:290] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:35.925727  8074 raft_consensus.cc:2393] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c8a837918d478fb10b627dfdbf90e4 in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:35.925697  7923 raft_consensus.cc:3060] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.925980  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0220849a2f497ebf0514d72a9dfddb" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:35.930970  8146 raft_consensus.cc:3060] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.931404  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d912e9dce93246b191ef13bbfe19b004" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.932264  7922 raft_consensus.cc:2468] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:35.933959  8111 leader_election.cc:304] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:35.934832  8316 raft_consensus.cc:2804] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.935211  8316 raft_consensus.cc:493] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.935550  8316 raft_consensus.cc:3060] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.939217  8146 raft_consensus.cc:2468] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:35.943974  7963 leader_election.cc:304] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:35.945042  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0220849a2f497ebf0514d72a9dfddb" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.946430  8147 raft_consensus.cc:2393] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c8a837918d478fb10b627dfdbf90e4 in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:35.946873  8230 raft_consensus.cc:2804] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.947444  8230 raft_consensus.cc:493] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.947512  8358 raft_consensus.cc:493] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.947983  8230 raft_consensus.cc:3060] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.948254  8358 raft_consensus.cc:515] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:35.950950  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d912e9dce93246b191ef13bbfe19b004" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:35.946435  7870 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:02:35.952255  8111 leader_election.cc:343] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.952447  8358 leader_election.cc:290] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:35.953781  8037 leader_election.cc:304] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:35.954550  8358 raft_consensus.cc:2804] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.955360  8358 raft_consensus.cc:697] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:35.956162  8358 consensus_queue.cc:237] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:35.924925  8194 ts_tablet_manager.cc:1434] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:02:35.951823  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e337f219804508a9d4c890819e542c" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:35.955808  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e337f219804508a9d4c890819e542c" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:35.960563  8147 raft_consensus.cc:2468] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
W20260709 13:02:35.960695  8040 leader_election.cc:343] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.960879  8243 leader_election.cc:290] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:35.962581  8194 tablet_bootstrap.cc:492] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:35.944783  7923 raft_consensus.cc:2468] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:35.968132  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0220849a2f497ebf0514d72a9dfddb" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:35.968724  7923 raft_consensus.cc:2376] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1. Re-sending same reply.
I20260709 13:02:35.969080  8189 tablet_bootstrap.cc:492] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:35.969686  8189 ts_tablet_manager.cc:1403] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.000s
I20260709 13:02:35.971369  8194 tablet_bootstrap.cc:654] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.972504  8189 raft_consensus.cc:359] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.973301  8189 raft_consensus.cc:385] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.973608  8189 raft_consensus.cc:740] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.968513  8230 raft_consensus.cc:515] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.975623  8230 leader_election.cc:290] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:35.976220  8230 consensus_queue.cc:1048] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:35.979600  8298 raft_consensus.cc:515] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:35.974362  8189 consensus_queue.cc:260] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.983482  8189 ts_tablet_manager.cc:1434] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:35.983668  8194 tablet_bootstrap.cc:492] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:35.988176  8194 ts_tablet_manager.cc:1403] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:02:35.989487  8189 tablet_bootstrap.cc:492] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:35.991171  8194 raft_consensus.cc:359] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.991860  8194 raft_consensus.cc:385] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.992172  8194 raft_consensus.cc:740] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.994442  8194 consensus_queue.cc:260] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.996186  8194 ts_tablet_manager.cc:1434] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:35.998286  8367 raft_consensus.cc:493] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.998871  8367 raft_consensus.cc:515] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:35.997473  7822 catalog_manager.cc:5697] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.002797  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ece29e9f66146e0bca321315b184bcc" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:36.003324  8367 leader_election.cc:290] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:36.003566  8189 tablet_bootstrap.cc:654] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:36.004217  8114 leader_election.cc:343] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.005062  8194 tablet_bootstrap.cc:492] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:35.987380  8202 leader_election.cc:290] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
W20260709 13:02:36.018782  7963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 60840.6us
I20260709 13:02:36.024263  8282 raft_consensus.cc:493] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.035952  8189 tablet_bootstrap.cc:492] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:36.036545  8189 ts_tablet_manager.cc:1403] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 13:02:36.027746  8282 raft_consensus.cc:515] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.039263  8282 leader_election.cc:290] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:36.039506  8189 raft_consensus.cc:359] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.040380  8189 raft_consensus.cc:385] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.040832  8189 raft_consensus.cc:740] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.040405  8316 raft_consensus.cc:515] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.039862  8263 leader_election.cc:290] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:36.041707  8189 consensus_queue.cc:260] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.044034  8189 ts_tablet_manager.cc:1434] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:02:36.047080  8189 tablet_bootstrap.cc:492] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:36.052845  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623d31b1b0e94c7580c2403f41e8a553" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:36.053503  8073 raft_consensus.cc:3060] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.040524  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623d31b1b0e94c7580c2403f41e8a553" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
W20260709 13:02:36.047220  7888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 108400us
I20260709 13:02:36.057649  7924 raft_consensus.cc:3060] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.061676  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca6d20b17dd439abc7de41f57b0e344" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:36.033080  8037 leader_election.cc:304] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:36.057793  8298 leader_election.cc:290] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:36.069495  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99565f0cecd744f18755d8039eabf963" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:36.070091  8072 raft_consensus.cc:2393] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:36.075906  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99565f0cecd744f18755d8039eabf963" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:36.076570  7923 raft_consensus.cc:3060] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.077242  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:36.078128  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ece29e9f66146e0bca321315b184bcc" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:36.078554  8071 raft_consensus.cc:3060] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.078758  7921 raft_consensus.cc:2468] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:36.080752  8189 tablet_bootstrap.cc:654] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.069173  8202 raft_consensus.cc:2804] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:36.068225  7925 raft_consensus.cc:2468] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:36.075205  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca6d20b17dd439abc7de41f57b0e344" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:36.086318  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:36.093371  8147 raft_consensus.cc:3060] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.083316  8202 raft_consensus.cc:493] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.095084  8202 raft_consensus.cc:3060] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.097100  8300 raft_consensus.cc:493] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.097615  8300 raft_consensus.cc:515] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.104409  8147 raft_consensus.cc:2468] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:36.105095  7924 raft_consensus.cc:2468] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:36.108764  7888 leader_election.cc:304] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:36.108815  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d912e9dce93246b191ef13bbfe19b004" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:36.109733  8282 raft_consensus.cc:2749] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:36.082486  8316 leader_election.cc:290] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:36.109717  7924 raft_consensus.cc:3060] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.109916  8071 raft_consensus.cc:2468] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:36.115798  8073 raft_consensus.cc:2468] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:36.117125  8190 tablet_bootstrap.cc:492] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:36.117552  7963 leader_election.cc:304] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:36.118522  8364 raft_consensus.cc:2804] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:36.117596  8190 ts_tablet_manager.cc:1403] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.463s	user 0.041s	sys 0.062s
W20260709 13:02:36.074803  8037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39391, user_credentials={real_user=slave}} blocked reactor thread for 46974.5us
I20260709 13:02:36.120457  7923 raft_consensus.cc:2468] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:36.119061  8364 raft_consensus.cc:697] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:36.121531  8364 consensus_queue.cc:237] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.124583  8300 leader_election.cc:290] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:36.126474  8202 raft_consensus.cc:515] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.132596  8111 leader_election.cc:304] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:36.133459  8270 raft_consensus.cc:2804] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:36.133844  8270 raft_consensus.cc:493] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.134174  8270 raft_consensus.cc:3060] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.134668  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e337f219804508a9d4c890819e542c" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:36.135567  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ca6d20b17dd439abc7de41f57b0e344" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
W20260709 13:02:36.135885  8040 leader_election.cc:343] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.116192  7924 raft_consensus.cc:2468] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:36.136325  8147 raft_consensus.cc:2393] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc7af07a29d1443b8a3c4a3770d52344 in current term 1: Already voted for candidate 17a4c4b3539b43108ef3481121d982bd in this term.
I20260709 13:02:36.136708  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f6e282d9af4b97b6361970cce263c2" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:36.137373  8202 leader_election.cc:290] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:36.129911  8192 tablet_bootstrap.cc:492] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:36.138303  8192 ts_tablet_manager.cc:1403] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.384s	user 0.054s	sys 0.084s
I20260709 13:02:36.140625  8270 raft_consensus.cc:515] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.141065  8192 raft_consensus.cc:359] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.141757  8192 raft_consensus.cc:385] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.141852  8194 tablet_bootstrap.cc:654] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.142067  8192 raft_consensus.cc:740] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.131578  8316 consensus_queue.cc:1048] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.143052  8270 leader_election.cc:290] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:36.143672  8111 leader_election.cc:304] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:36.144860  8192 consensus_queue.cc:260] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.144500  8270 raft_consensus.cc:2804] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:36.145793  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ece29e9f66146e0bca321315b184bcc" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
W20260709 13:02:36.149331  8114 leader_election.cc:343] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:36.149447  7888 leader_election.cc:343] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.153704  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d912e9dce93246b191ef13bbfe19b004" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:36.154960  8192 ts_tablet_manager.cc:1434] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:02:36.154381  8073 raft_consensus.cc:3060] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.156082  8192 tablet_bootstrap.cc:492] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:36.159608  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ece29e9f66146e0bca321315b184bcc" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
W20260709 13:02:36.160060  7888 leader_election.cc:343] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.159943  8300 consensus_queue.cc:1048] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.160240  7923 raft_consensus.cc:3060] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.162302  8190 raft_consensus.cc:359] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.163358  8190 raft_consensus.cc:385] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.164458  8190 raft_consensus.cc:740] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.151175  8270 raft_consensus.cc:697] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:36.165732  8190 consensus_queue.cc:260] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.146410  7963 leader_election.cc:304] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:36.153717  8111 leader_election.cc:304] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:36.166401  8270 consensus_queue.cc:237] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.170536  8189 tablet_bootstrap.cc:492] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:36.183198  7923 raft_consensus.cc:2468] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:36.190132  8189 ts_tablet_manager.cc:1403] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.144s	user 0.008s	sys 0.025s
I20260709 13:02:36.178043  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e337f219804508a9d4c890819e542c" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:36.178560  8037 leader_election.cc:304] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:36.190948  8147 raft_consensus.cc:3060] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.173498  8230 raft_consensus.cc:2804] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:36.191774  8230 raft_consensus.cc:697] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:36.178375  8190 ts_tablet_manager.cc:1434] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:02:36.193039  8358 raft_consensus.cc:2749] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:36.194065  8190 tablet_bootstrap.cc:492] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:36.192634  8230 consensus_queue.cc:237] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.197475  8189 raft_consensus.cc:359] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.198328  8189 raft_consensus.cc:385] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.177101  8192 tablet_bootstrap.cc:654] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.198623  8189 raft_consensus.cc:740] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.168494  8367 raft_consensus.cc:2804] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:36.209951  8194 tablet_bootstrap.cc:492] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:36.210695  8194 ts_tablet_manager.cc:1403] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.213s	user 0.007s	sys 0.007s
I20260709 13:02:36.211390  8189 consensus_queue.cc:260] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.212769  8111 leader_election.cc:304] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:36.172899  8073 raft_consensus.cc:2468] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:36.217432  8316 raft_consensus.cc:2804] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:36.218098  8316 raft_consensus.cc:697] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:36.219252  8316 consensus_queue.cc:237] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
W20260709 13:02:36.173292  7963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 44718.1us
I20260709 13:02:36.215345  8367 raft_consensus.cc:697] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:36.241055  8189 ts_tablet_manager.cc:1434] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:02:36.243876  8189 tablet_bootstrap.cc:492] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:36.232470  8282 consensus_queue.cc:1048] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:02:36.259173  8367 consensus_queue.cc:237] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.264449  7963 leader_election.cc:304] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:36.269187  8282 raft_consensus.cc:493] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.269687  8282 raft_consensus.cc:515] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
W20260709 13:02:36.257491  8111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 52627.8us
W20260709 13:02:36.275184  7891 leader_election.cc:343] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.289297  7891 leader_election.cc:304] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:36.290954  8362 raft_consensus.cc:2749] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:36.292413  8190 tablet_bootstrap.cc:654] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.277361  8364 raft_consensus.cc:2804] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:36.294025  8364 raft_consensus.cc:697] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:36.294960  8364 consensus_queue.cc:237] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:36.295516  8376 log.cc:927] Time spent T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Append to log took a long time: real 0.059s	user 0.004s	sys 0.000s
I20260709 13:02:36.278074  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81919804d363474eb3975b2d6a675ac0" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:36.278264  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f6e282d9af4b97b6361970cce263c2" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:36.284086  8147 raft_consensus.cc:2468] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:36.276227  8282 leader_election.cc:290] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:36.302263  8037 leader_election.cc:304] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
W20260709 13:02:36.302716  7888 leader_election.cc:343] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.303429  8202 raft_consensus.cc:2804] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:36.303905  8202 raft_consensus.cc:697] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:36.304812  8202 consensus_queue.cc:237] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:36.307483  7891 leader_election.cc:343] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.308013  7891 leader_election.cc:304] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:36.285187  8189 tablet_bootstrap.cc:654] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.279372  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81919804d363474eb3975b2d6a675ac0" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:36.310961  8300 raft_consensus.cc:2749] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:36.313097  7888 leader_election.cc:343] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.313779  7888 leader_election.cc:304] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:36.321535  8282 raft_consensus.cc:2749] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:36.337431  8300 raft_consensus.cc:493] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.342149  8300 raft_consensus.cc:515] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.344321  8300 leader_election.cc:290] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:36.344765  8194 raft_consensus.cc:359] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.345500  8194 raft_consensus.cc:385] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.345745  8194 raft_consensus.cc:740] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.346093  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:36.347826  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:36.346459  8194 consensus_queue.cc:260] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.352391  8194 ts_tablet_manager.cc:1434] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.000s
W20260709 13:02:36.353392  7888 leader_election.cc:343] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.354112  8194 tablet_bootstrap.cc:492] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:36.287496  7819 catalog_manager.cc:5697] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.360589  7819 catalog_manager.cc:5697] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:36.362879  7891 leader_election.cc:343] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.363389  7891 leader_election.cc:304] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:36.362882  8192 tablet_bootstrap.cc:492] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:36.365422  8192 ts_tablet_manager.cc:1403] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.210s	user 0.015s	sys 0.027s
I20260709 13:02:36.369066  8190 tablet_bootstrap.cc:492] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:36.369550  8190 ts_tablet_manager.cc:1403] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.176s	user 0.016s	sys 0.008s
I20260709 13:02:36.373287  8362 raft_consensus.cc:2749] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:36.376463  8190 raft_consensus.cc:359] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.377211  8190 raft_consensus.cc:385] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.377492  8190 raft_consensus.cc:740] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.380556  7822 catalog_manager.cc:5697] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.381198  8190 consensus_queue.cc:260] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.383634  8190 ts_tablet_manager.cc:1434] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:02:36.384507  8190 tablet_bootstrap.cc:492] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:36.386091  7823 catalog_manager.cc:5697] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.387858  8189 tablet_bootstrap.cc:492] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:36.388417  8189 ts_tablet_manager.cc:1403] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.146s	user 0.006s	sys 0.022s
I20260709 13:02:36.390659  8190 tablet_bootstrap.cc:654] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.390797  8189 raft_consensus.cc:359] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.391523  8189 raft_consensus.cc:385] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.391800  8189 raft_consensus.cc:740] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.392586  8189 consensus_queue.cc:260] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.395170  8192 raft_consensus.cc:359] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.395985  8192 raft_consensus.cc:385] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.396261  8192 raft_consensus.cc:740] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.397048  8192 consensus_queue.cc:260] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.399492  8189 ts_tablet_manager.cc:1434] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:02:36.400339  8189 tablet_bootstrap.cc:492] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:36.403646  8194 tablet_bootstrap.cc:654] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.406957  8192 ts_tablet_manager.cc:1434] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:02:36.412992  8189 tablet_bootstrap.cc:654] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.417280  7823 catalog_manager.cc:5697] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.421070  8192 tablet_bootstrap.cc:492] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:36.426949  7821 catalog_manager.cc:5697] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.430744  8190 tablet_bootstrap.cc:492] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:36.431272  8190 ts_tablet_manager.cc:1403] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 13:02:36.433952  8190 raft_consensus.cc:359] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.434645  8190 raft_consensus.cc:385] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.430401  7821 catalog_manager.cc:5697] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.434973  8190 raft_consensus.cc:740] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.434506  8192 tablet_bootstrap.cc:654] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.439615  8190 consensus_queue.cc:260] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.446027  8190 ts_tablet_manager.cc:1434] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:02:36.447036  8190 tablet_bootstrap.cc:492] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:36.448261  8189 tablet_bootstrap.cc:492] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:36.448746  8189 ts_tablet_manager.cc:1403] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.005s
I20260709 13:02:36.452689  8190 tablet_bootstrap.cc:654] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.456492  8194 tablet_bootstrap.cc:492] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:36.456972  8194 ts_tablet_manager.cc:1403] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.007s
I20260709 13:02:36.457445  8364 raft_consensus.cc:493] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.457949  8364 raft_consensus.cc:515] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.460124  8364 leader_election.cc:290] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:36.461580  8189 raft_consensus.cc:359] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.462698  8189 raft_consensus.cc:385] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.462363  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:36.462982  8189 raft_consensus.cc:740] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.463927  8189 consensus_queue.cc:260] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.463011  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:36.465181  7925 raft_consensus.cc:2393] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate 87b2df8987cd4ac0b02b0632752c3a24 in this term.
I20260709 13:02:36.466379  7963 leader_election.cc:304] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:36.467478  8364 raft_consensus.cc:3060] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.474428  8364 raft_consensus.cc:2749] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:36.476392  8194 raft_consensus.cc:359] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.477777  8194 raft_consensus.cc:385] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.478121  8194 raft_consensus.cc:740] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.477337  8189 ts_tablet_manager.cc:1434] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:02:36.479832  8189 tablet_bootstrap.cc:492] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:36.483232  8194 consensus_queue.cc:260] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.490931  8192 tablet_bootstrap.cc:492] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:36.491464  8192 ts_tablet_manager.cc:1403] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.084s	user 0.027s	sys 0.011s
I20260709 13:02:36.488085  8194 ts_tablet_manager.cc:1434] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.005s
I20260709 13:02:36.494731  8192 raft_consensus.cc:359] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.496953  8192 raft_consensus.cc:385] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.497391  8192 raft_consensus.cc:740] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.497511  8189 tablet_bootstrap.cc:654] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.498306  8192 consensus_queue.cc:260] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.500703  8192 ts_tablet_manager.cc:1434] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:02:36.497602  8194 tablet_bootstrap.cc:492] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:36.506655  8192 tablet_bootstrap.cc:492] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:36.507503  8190 tablet_bootstrap.cc:492] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:36.508042  8190 ts_tablet_manager.cc:1403] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.012s
I20260709 13:02:36.510812  8190 raft_consensus.cc:359] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.511476  8190 raft_consensus.cc:385] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.511759  8190 raft_consensus.cc:740] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.512748  8194 tablet_bootstrap.cc:654] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.512466  8190 consensus_queue.cc:260] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.512933  8192 tablet_bootstrap.cc:654] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.514925  8190 ts_tablet_manager.cc:1434] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:36.527132  8190 tablet_bootstrap.cc:492] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:36.534057  8230 consensus_queue.cc:1048] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.550441  8367 raft_consensus.cc:493] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.551023  8367 raft_consensus.cc:515] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.553264  8367 leader_election.cc:290] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:36.555680  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1559ecc34a84f3bbfc97b60579b1ecd" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:36.556108  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1559ecc34a84f3bbfc97b60579b1ecd" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:36.556815  8073 raft_consensus.cc:2468] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:36.556913  7999 raft_consensus.cc:2468] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:36.558965  8111 leader_election.cc:304] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:36.559967  8189 tablet_bootstrap.cc:492] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:36.559995  8367 raft_consensus.cc:2804] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:36.560647  8189 ts_tablet_manager.cc:1403] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.004s
I20260709 13:02:36.560659  8367 raft_consensus.cc:493] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.562336  8367 raft_consensus.cc:3060] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.566831  8190 tablet_bootstrap.cc:654] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.572963  8189 raft_consensus.cc:359] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.573772  8189 raft_consensus.cc:385] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.574062  8189 raft_consensus.cc:740] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.575325  8358 consensus_queue.cc:1048] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.576571  8194 tablet_bootstrap.cc:492] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:36.577646  8194 ts_tablet_manager.cc:1403] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.005s
I20260709 13:02:36.577432  8189 consensus_queue.cc:260] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.580930  8194 raft_consensus.cc:359] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.581569  8202 consensus_queue.cc:1048] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.582123  8194 raft_consensus.cc:385] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.573433  8367 raft_consensus.cc:515] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.583469  8189 ts_tablet_manager.cc:1434] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:02:36.584462  8189 tablet_bootstrap.cc:492] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:36.585085  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1559ecc34a84f3bbfc97b60579b1ecd" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:36.585676  7999 raft_consensus.cc:3060] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.587592  8190 tablet_bootstrap.cc:492] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:36.588071  8190 ts_tablet_manager.cc:1403] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 13:02:36.593729  7999 raft_consensus.cc:2468] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:36.595712  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1559ecc34a84f3bbfc97b60579b1ecd" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:36.597090  8073 raft_consensus.cc:3060] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.600490  8190 raft_consensus.cc:359] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.601215  8190 raft_consensus.cc:385] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.601500  8190 raft_consensus.cc:740] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.602174  8190 consensus_queue.cc:260] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.606130  8073 raft_consensus.cc:2468] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:36.596422  8367 leader_election.cc:290] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:36.582551  8194 raft_consensus.cc:740] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.609913  8194 consensus_queue.cc:260] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.607844  8114 leader_election.cc:304] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:36.612260  8367 raft_consensus.cc:2804] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:36.612802  8367 raft_consensus.cc:697] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:36.613950  8362 raft_consensus.cc:493] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.614457  8362 raft_consensus.cc:515] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.606863  8316 consensus_queue.cc:1048] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.613695  8367 consensus_queue.cc:237] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.616781  8362 leader_election.cc:290] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:36.615839  8194 ts_tablet_manager.cc:1434] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:02:36.619491  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b36cb6f91433d818856a5aa867b7d" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:36.620854  7891 leader_election.cc:343] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.622337  8190 ts_tablet_manager.cc:1434] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:02:36.623550  8190 tablet_bootstrap.cc:492] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:36.628118  8189 tablet_bootstrap.cc:654] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.634157  8378 consensus_queue.cc:1048] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.622455  8194 tablet_bootstrap.cc:492] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:36.646111  8194 tablet_bootstrap.cc:654] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.645846  8230 consensus_queue.cc:1048] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.646554  8364 consensus_queue.cc:1048] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.638506  8190 tablet_bootstrap.cc:654] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.662528  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b36cb6f91433d818856a5aa867b7d" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:36.712349  8362 raft_consensus.cc:493] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.713057  8362 raft_consensus.cc:515] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.721505  7999 raft_consensus.cc:3060] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.721860  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:36.722816  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:36.724004  7891 leader_election.cc:343] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:36.724718  7888 leader_election.cc:343] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.724879  8362 leader_election.cc:290] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:36.725361  7888 leader_election.cc:304] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:36.736748  8000 raft_consensus.cc:3060] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.738830  8282 raft_consensus.cc:2749] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:36.739935  8316 consensus_queue.cc:1048] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.751641  8202 consensus_queue.cc:1048] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.776295  8189 tablet_bootstrap.cc:492] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:36.776924  8189 ts_tablet_manager.cc:1403] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.193s	user 0.053s	sys 0.053s
I20260709 13:02:36.776984  8192 tablet_bootstrap.cc:492] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:36.777806  8192 ts_tablet_manager.cc:1403] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.271s	user 0.087s	sys 0.149s
W20260709 13:02:36.780588  7888 leader_election.cc:343] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.781224  8300 raft_consensus.cc:493] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.795933  8300 raft_consensus.cc:515] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.796180  8316 consensus_queue.cc:1048] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.798080  8300 leader_election.cc:290] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:36.801882  8189 raft_consensus.cc:359] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.802713  8189 raft_consensus.cc:385] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.805680  8194 tablet_bootstrap.cc:492] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:36.806110  8190 tablet_bootstrap.cc:492] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:36.806278  8194 ts_tablet_manager.cc:1403] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.000s
I20260709 13:02:36.791172  7888 leader_election.cc:304] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:36.806598  8190 ts_tablet_manager.cc:1403] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.183s	user 0.016s	sys 0.044s
I20260709 13:02:36.803181  8189 raft_consensus.cc:740] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.808182  8189 consensus_queue.cc:260] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.805838  8192 raft_consensus.cc:359] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.810529  8192 raft_consensus.cc:385] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.810879  8192 raft_consensus.cc:740] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.811452  8192 consensus_queue.cc:260] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.816636  8189 ts_tablet_manager.cc:1434] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:02:36.818351  8189 tablet_bootstrap.cc:492] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:36.820235  8192 ts_tablet_manager.cc:1434] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:02:36.821089  8192 tablet_bootstrap.cc:492] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:36.814601  8362 raft_consensus.cc:2749] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:36.827359  8192 tablet_bootstrap.cc:654] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.829329  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f247634f9942119a6d67c513aa16ab" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:36.839833  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f247634f9942119a6d67c513aa16ab" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:36.842033  8190 raft_consensus.cc:359] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.854861  8190 raft_consensus.cc:385] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.855274  8190 raft_consensus.cc:740] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.856155  8190 consensus_queue.cc:260] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.870628  8189 tablet_bootstrap.cc:654] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.872829  8358 raft_consensus.cc:493] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.835666  8364 consensus_queue.cc:1048] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
W20260709 13:02:36.875201  7888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 47278.8us
I20260709 13:02:36.878151  8358 raft_consensus.cc:515] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.905526  8192 tablet_bootstrap.cc:492] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:36.906102  8192 ts_tablet_manager.cc:1403] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.085s	user 0.023s	sys 0.042s
I20260709 13:02:36.905989  8414 raft_consensus.cc:493] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.909479  8414 raft_consensus.cc:515] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:36.911588  8414 leader_election.cc:290] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:36.907207  8378 consensus_queue.cc:1048] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.914426  8192 raft_consensus.cc:359] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.915146  8192 raft_consensus.cc:385] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.907124  8270 raft_consensus.cc:493] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.915405  8192 raft_consensus.cc:740] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.915697  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:36.916131  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30f9c4ed64f49d4a6b1e484c334a1a9" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:36.916469  7924 raft_consensus.cc:2468] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:36.916870  7921 raft_consensus.cc:2468] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:36.918215  8037 leader_election.cc:304] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:36.919896  8410 raft_consensus.cc:2804] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:36.920256  8410 raft_consensus.cc:493] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.920557  8410 raft_consensus.cc:3060] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.921913  8192 consensus_queue.cc:260] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.923477  8364 consensus_queue.cc:1048] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:36.926229  7888 leader_election.cc:343] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.927414  8192 ts_tablet_manager.cc:1434] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:02:36.909420  8194 raft_consensus.cc:359] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.928143  8194 raft_consensus.cc:385] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.928790  8194 raft_consensus.cc:740] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.930384  8192 tablet_bootstrap.cc:492] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:36.938927  7963 leader_election.cc:304] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:36.918473  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30f9c4ed64f49d4a6b1e484c334a1a9" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:36.945622  8071 raft_consensus.cc:2468] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:36.926553  7823 catalog_manager.cc:5697] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.954337  8194 consensus_queue.cc:260] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:36.953665  8414 raft_consensus.cc:2804] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:36.915630  8270 raft_consensus.cc:515] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:36.964512  8194 ts_tablet_manager.cc:1434] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.158s	user 0.007s	sys 0.000s
I20260709 13:02:36.957106  8316 raft_consensus.cc:493] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.968417  8194 tablet_bootstrap.cc:492] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:36.970528  8358 leader_election.cc:290] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:36.965237  8202 consensus_queue.cc:1048] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:02:36.956681  7888 leader_election.cc:343] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:36.972203  7888 leader_election.cc:304] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:36.972927  8300 raft_consensus.cc:2749] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:36.966612  8414 raft_consensus.cc:493] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.976114  8414 raft_consensus.cc:3060] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:36.979055  8416 log.cc:927] Time spent T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:02:36.960939  8354 raft_consensus.cc:493] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.984905  8316 raft_consensus.cc:515] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:36.997826  8270 leader_election.cc:290] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:36.999408  8316 leader_election.cc:290] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:36.987548  8354 raft_consensus.cc:515] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:37.003455  8354 leader_election.cc:290] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:37.007040  8192 tablet_bootstrap.cc:654] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.008117  8410 raft_consensus.cc:515] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.026144  8190 ts_tablet_manager.cc:1434] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.219s	user 0.013s	sys 0.016s
I20260709 13:02:37.027504  8190 tablet_bootstrap.cc:492] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:37.033962  8194 tablet_bootstrap.cc:654] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.042474  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:37.044404  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326598313429494cb184f94c8b0ee3b9" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:37.044993  7996 raft_consensus.cc:2468] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:37.048292  8410 leader_election.cc:290] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:37.048918  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:37.049762  7925 raft_consensus.cc:3060] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.062804  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
W20260709 13:02:37.062842  8040 leader_election.cc:343] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.065441  8040 leader_election.cc:304] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:37.065809  8189 tablet_bootstrap.cc:492] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:37.066483  8189 ts_tablet_manager.cc:1403] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.249s	user 0.015s	sys 0.012s
I20260709 13:02:37.071065  8202 raft_consensus.cc:2804] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:37.068773  8111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 131275us
W20260709 13:02:37.072158  8040 leader_election.cc:343] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.077047  8202 raft_consensus.cc:493] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.080888  8202 raft_consensus.cc:3060] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:37.072969  8114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36125, user_credentials={real_user=slave}} blocked reactor thread for 113345us
I20260709 13:02:37.089021  8414 raft_consensus.cc:515] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.091297  7925 raft_consensus.cc:2468] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:37.087527  8189 raft_consensus.cc:359] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.092268  8189 raft_consensus.cc:385] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.092577  8189 raft_consensus.cc:740] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.092643  8037 leader_election.cc:304] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:37.093628  8189 consensus_queue.cc:260] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.094103  8354 raft_consensus.cc:2804] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.094733  8354 raft_consensus.cc:697] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:37.095815  8189 ts_tablet_manager.cc:1434] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:02:37.095956  8354 consensus_queue.cc:237] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.100812  8414 leader_election.cc:290] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:37.103125  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f6e282d9af4b97b6361970cce263c2" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:37.105142  8202 raft_consensus.cc:515] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:37.106763  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81919804d363474eb3975b2d6a675ac0" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:37.107589  8189 tablet_bootstrap.cc:492] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:37.107816  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30f9c4ed64f49d4a6b1e484c334a1a9" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:37.108321  8071 raft_consensus.cc:3060] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.112249  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c30f9c4ed64f49d4a6b1e484c334a1a9" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
W20260709 13:02:37.112426  8114 leader_election.cc:343] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.112856  7923 raft_consensus.cc:3060] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.114979  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326598313429494cb184f94c8b0ee3b9" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:37.115697  8146 raft_consensus.cc:2468] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:37.116144  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f6e282d9af4b97b6361970cce263c2" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:37.116732  7924 raft_consensus.cc:2468] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:37.119191  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81919804d363474eb3975b2d6a675ac0" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:37.119791  7924 raft_consensus.cc:2468] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:37.121711  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326598313429494cb184f94c8b0ee3b9" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:37.122334  7997 raft_consensus.cc:3060] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.124295  8192 tablet_bootstrap.cc:492] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:37.124794  8192 ts_tablet_manager.cc:1403] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.195s	user 0.015s	sys 0.006s
I20260709 13:02:37.127113  8189 tablet_bootstrap.cc:654] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.127416  8202 leader_election.cc:290] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:37.128746  8282 raft_consensus.cc:493] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.130158  8282 raft_consensus.cc:515] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.130625  8378 consensus_queue.cc:1048] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:37.132333  8282 leader_election.cc:290] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:37.129192  8194 tablet_bootstrap.cc:492] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:37.133575  8194 ts_tablet_manager.cc:1403] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.007s
I20260709 13:02:37.133847  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2079bb44476c41ef908915825b1fa87c" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:37.136209  7891 leader_election.cc:343] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.136363  8194 raft_consensus.cc:359] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.137136  8194 raft_consensus.cc:385] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.137439  8194 raft_consensus.cc:740] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.133437  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2079bb44476c41ef908915825b1fa87c" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:37.139043  7888 leader_election.cc:343] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.139524  7888 leader_election.cc:304] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:37.140208  8282 raft_consensus.cc:2749] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.140786  8194 consensus_queue.cc:260] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.132261  8071 raft_consensus.cc:2468] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:37.136161  8111 leader_election.cc:304] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:37.149771  7923 raft_consensus.cc:2468] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:37.159217  8423 raft_consensus.cc:2804] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.159677  8423 raft_consensus.cc:493] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.160012  8423 raft_consensus.cc:3060] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.163888  8194 ts_tablet_manager.cc:1434] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:02:37.164043  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326598313429494cb184f94c8b0ee3b9" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:37.164912  8194 tablet_bootstrap.cc:492] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:37.164954  8146 raft_consensus.cc:3060] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.167251  7963 leader_election.cc:304] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:37.169092  8415 raft_consensus.cc:2804] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.169543  8415 raft_consensus.cc:697] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:37.170310  8415 consensus_queue.cc:237] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.187909  8282 raft_consensus.cc:493] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.188442  8282 raft_consensus.cc:515] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.190101  8194 tablet_bootstrap.cc:654] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.195976  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5c76efc53c42d2858b26bbd9765c31" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:37.190054  7997 raft_consensus.cc:2468] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:37.197705  8190 tablet_bootstrap.cc:654] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.201349  8192 raft_consensus.cc:359] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.192639  7822 catalog_manager.cc:5697] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.183040  8146 raft_consensus.cc:2468] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:37.201987  8192 raft_consensus.cc:385] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.202502  8192 raft_consensus.cc:740] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.204339  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5c76efc53c42d2858b26bbd9765c31" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:37.206055  7888 leader_election.cc:343] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.206887  8037 leader_election.cc:304] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:37.209360  8354 raft_consensus.cc:2804] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.190505  8282 leader_election.cc:290] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:37.210016  8354 raft_consensus.cc:697] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
W20260709 13:02:37.218608  7870 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:02:37.220417  7888 leader_election.cc:343] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.220913  7888 leader_election.cc:304] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:37.221654  8282 raft_consensus.cc:2749] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.225466  8367 consensus_queue.cc:1048] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:37.228871  8354 consensus_queue.cc:237] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:37.186298  8111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 54103.7us
I20260709 13:02:37.215072  8192 consensus_queue.cc:260] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.253626  8192 ts_tablet_manager.cc:1434] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.129s	user 0.002s	sys 0.005s
I20260709 13:02:37.253701  8189 tablet_bootstrap.cc:492] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:37.254367  8189 ts_tablet_manager.cc:1403] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.147s	user 0.022s	sys 0.023s
I20260709 13:02:37.190308  8423 raft_consensus.cc:515] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.257084  8189 raft_consensus.cc:359] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.257758  8189 raft_consensus.cc:385] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.258038  8189 raft_consensus.cc:740] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.258836  8189 consensus_queue.cc:260] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.260938  8189 ts_tablet_manager.cc:1434] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:37.261229  8111 leader_election.cc:304] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:37.261783  8189 tablet_bootstrap.cc:492] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:37.262218  8367 raft_consensus.cc:2804] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.262635  8367 raft_consensus.cc:493] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.262969  8367 raft_consensus.cc:3060] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.267391  8192 tablet_bootstrap.cc:492] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:37.282466  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f6e282d9af4b97b6361970cce263c2" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:37.277091  8423 leader_election.cc:290] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
W20260709 13:02:37.285652  8114 leader_election.cc:343] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.287992  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f6e282d9af4b97b6361970cce263c2" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:37.288632  7924 raft_consensus.cc:3060] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:37.292436  8111 leader_election.cc:343] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.295523  8418 consensus_queue.cc:1048] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:37.335049  8194 tablet_bootstrap.cc:492] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:37.319624  8415 consensus_queue.cc:1048] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:02:37.335949  8194 ts_tablet_manager.cc:1403] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.171s	user 0.014s	sys 0.011s
I20260709 13:02:37.336319  8189 tablet_bootstrap.cc:654] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.351825  8192 tablet_bootstrap.cc:654] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.357460  8367 raft_consensus.cc:515] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.359628  8367 leader_election.cc:290] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:37.364889  7924 raft_consensus.cc:2468] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:37.367487  8190 tablet_bootstrap.cc:492] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:37.368091  8190 ts_tablet_manager.cc:1403] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.341s	user 0.014s	sys 0.012s
I20260709 13:02:37.372291  8190 raft_consensus.cc:359] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.373199  8190 raft_consensus.cc:385] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.373550  8190 raft_consensus.cc:740] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.375020  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81919804d363474eb3975b2d6a675ac0" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:37.374221  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81919804d363474eb3975b2d6a675ac0" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:37.375546  8190 consensus_queue.cc:260] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.376133  7925 raft_consensus.cc:3060] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.377600  8190 ts_tablet_manager.cc:1434] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:02:37.378633  8190 tablet_bootstrap.cc:492] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:37.384799  7925 raft_consensus.cc:2468] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:37.373006  8111 leader_election.cc:304] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:37.388512  8316 raft_consensus.cc:2804] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.389186  8316 raft_consensus.cc:697] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
W20260709 13:02:37.389240  8111 leader_election.cc:343] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.390486  8190 tablet_bootstrap.cc:654] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.391328  8194 raft_consensus.cc:359] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.392262  8194 raft_consensus.cc:385] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.392565  8194 raft_consensus.cc:740] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.390221  8316 consensus_queue.cc:237] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.393885  8111 leader_election.cc:304] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:37.396570  8378 raft_consensus.cc:2804] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.397210  8378 raft_consensus.cc:697] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:37.394932  8194 consensus_queue.cc:260] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.401192  8378 consensus_queue.cc:237] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.402505  8189 tablet_bootstrap.cc:492] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:37.403014  8189 ts_tablet_manager.cc:1403] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.000s
I20260709 13:02:37.406723  7822 catalog_manager.cc:5697] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.410351  8194 ts_tablet_manager.cc:1434] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:02:37.411787  8194 tablet_bootstrap.cc:492] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:37.418690  8189 raft_consensus.cc:359] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.420537  8189 raft_consensus.cc:385] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.420831  8189 raft_consensus.cc:740] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.423578  8189 consensus_queue.cc:260] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.436400  8190 tablet_bootstrap.cc:492] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:37.436933  8190 ts_tablet_manager.cc:1403] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 13:02:37.440529  8190 raft_consensus.cc:359] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.441190  8190 raft_consensus.cc:385] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.441453  8190 raft_consensus.cc:740] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.442101  8190 consensus_queue.cc:260] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.442514  8192 tablet_bootstrap.cc:492] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:37.443120  8192 ts_tablet_manager.cc:1403] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.189s	user 0.019s	sys 0.009s
I20260709 13:02:37.444120  8190 ts_tablet_manager.cc:1434] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:37.445011  8190 tablet_bootstrap.cc:492] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:37.447913  8192 raft_consensus.cc:359] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:37.448591  8192 raft_consensus.cc:385] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.448854  8192 raft_consensus.cc:740] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.449481  8192 consensus_queue.cc:260] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:37.450519  8190 tablet_bootstrap.cc:654] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.455598  8189 ts_tablet_manager.cc:1434] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:02:37.463461  8192 ts_tablet_manager.cc:1434] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:02:37.464215  8189 tablet_bootstrap.cc:492] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:37.467522  8192 tablet_bootstrap.cc:492] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:37.466825  8194 tablet_bootstrap.cc:654] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.473758  8192 tablet_bootstrap.cc:654] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.475178  7823 catalog_manager.cc:5697] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.480060  7823 catalog_manager.cc:5697] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.487017  8316 raft_consensus.cc:493] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.487419  8415 raft_consensus.cc:493] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.487607  8316 raft_consensus.cc:515] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.488106  8415 raft_consensus.cc:515] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.519555  8415 leader_election.cc:290] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:37.520421  8194 tablet_bootstrap.cc:492] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:37.521003  8194 ts_tablet_manager.cc:1403] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.006s
I20260709 13:02:37.530970  8202 consensus_queue.cc:1048] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:37.526499  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f6e282d9af4b97b6361970cce263c2" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:37.527164  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f6e282d9af4b97b6361970cce263c2" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:37.532877  7923 raft_consensus.cc:2393] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate 87b2df8987cd4ac0b02b0632752c3a24 in this term.
I20260709 13:02:37.527925  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:37.529232  8316 leader_election.cc:290] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:37.529562  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:37.517457  8190 tablet_bootstrap.cc:492] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:37.536536  7925 raft_consensus.cc:2468] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:37.536681  8190 ts_tablet_manager.cc:1403] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.010s
I20260709 13:02:37.534644  7819 catalog_manager.cc:5697] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.537725  8111 leader_election.cc:304] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:37.538549  8316 raft_consensus.cc:2804] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.539233  8316 raft_consensus.cc:493] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.539572  8316 raft_consensus.cc:3060] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.539644  8190 raft_consensus.cc:359] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.535856  7963 leader_election.cc:304] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
W20260709 13:02:37.538762  8114 leader_election.cc:343] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.541599  8421 raft_consensus.cc:3060] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.550302  8189 tablet_bootstrap.cc:654] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.546253  8316 raft_consensus.cc:515] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.553445  7996 raft_consensus.cc:3060] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.555380  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:37.556026  7925 raft_consensus.cc:3060] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.540432  8190 raft_consensus.cc:385] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.562875  8190 raft_consensus.cc:740] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.565032  8194 raft_consensus.cc:359] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:37.566090  8194 raft_consensus.cc:385] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.566497  8194 raft_consensus.cc:740] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.567138  8192 tablet_bootstrap.cc:492] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:37.567621  8192 ts_tablet_manager.cc:1403] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.100s	user 0.019s	sys 0.017s
I20260709 13:02:37.563584  8190 consensus_queue.cc:260] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.567971  8194 consensus_queue.cc:260] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:37.570153  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:37.570574  8202 raft_consensus.cc:493] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.571010  8194 ts_tablet_manager.cc:1434] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.004s
I20260709 13:02:37.571128  7997 raft_consensus.cc:3060] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.563581  8421 raft_consensus.cc:2749] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.572443  8194 tablet_bootstrap.cc:492] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:37.572513  7925 raft_consensus.cc:2468] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:37.571460  8202 raft_consensus.cc:515] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:37.574046  8316 leader_election.cc:290] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:37.575724  8434 consensus_queue.cc:1048] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:37.576431  8189 tablet_bootstrap.cc:492] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:37.576897  8189 ts_tablet_manager.cc:1403] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.011s
I20260709 13:02:37.579377  8202 leader_election.cc:290] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:37.581878  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ec32e1ae354730b6b9edf944d5e934" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:37.582244  8111 leader_election.cc:304] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:37.577216  8192 raft_consensus.cc:359] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.581904  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ec32e1ae354730b6b9edf944d5e934" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:37.583907  8192 raft_consensus.cc:385] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.584228  8192 raft_consensus.cc:740] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.584123  8148 raft_consensus.cc:2468] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:37.592226  8037 leader_election.cc:304] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:37.593376  8202 raft_consensus.cc:2804] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.593833  8202 raft_consensus.cc:493] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.594228  8202 raft_consensus.cc:3060] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.595453  7997 raft_consensus.cc:2468] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:37.596262  8418 raft_consensus.cc:2804] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.596807  8418 raft_consensus.cc:697] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:37.597607  8418 consensus_queue.cc:237] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.598047  8192 consensus_queue.cc:260] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.601564  8192 ts_tablet_manager.cc:1434] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.003s
I20260709 13:02:37.601699  8202 raft_consensus.cc:515] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:37.602528  8192 tablet_bootstrap.cc:492] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
W20260709 13:02:37.603503  8040 leader_election.cc:343] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.603408  8189 raft_consensus.cc:359] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.604188  8189 raft_consensus.cc:385] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.604451  8189 raft_consensus.cc:740] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.605063  8189 consensus_queue.cc:260] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.610353  8189 ts_tablet_manager.cc:1434] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 13:02:37.610674  8316 raft_consensus.cc:493] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.611277  8189 tablet_bootstrap.cc:492] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:37.611167  8316 raft_consensus.cc:515] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.612624  8192 tablet_bootstrap.cc:654] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.614049  8194 tablet_bootstrap.cc:654] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.615024  8316 leader_election.cc:290] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:37.615686  8190 ts_tablet_manager.cc:1434] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
I20260709 13:02:37.620955  8190 tablet_bootstrap.cc:492] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:37.623238  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f247634f9942119a6d67c513aa16ab" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:37.623883  8071 raft_consensus.cc:2468] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:37.617162  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f247634f9942119a6d67c513aa16ab" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:37.627488  8111 leader_election.cc:304] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:37.627744  8202 leader_election.cc:290] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:37.628108  7925 raft_consensus.cc:2468] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:37.628304  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ec32e1ae354730b6b9edf944d5e934" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:37.628597  8316 raft_consensus.cc:2804] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.628914  8316 raft_consensus.cc:493] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.629233  8316 raft_consensus.cc:3060] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.635629  7822 catalog_manager.cc:5697] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.636456  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ec32e1ae354730b6b9edf944d5e934" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:37.637043  8147 raft_consensus.cc:3060] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.640836  8189 tablet_bootstrap.cc:654] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:37.643332  8040 leader_election.cc:343] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.656368  8316 raft_consensus.cc:515] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.659180  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f247634f9942119a6d67c513aa16ab" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:37.659789  8072 raft_consensus.cc:3060] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.663401  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f247634f9942119a6d67c513aa16ab" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:37.664297  7923 raft_consensus.cc:3060] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.665735  8421 consensus_queue.cc:1048] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:37.672019  7923 raft_consensus.cc:2468] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:37.673241  8111 leader_election.cc:304] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:37.672336  8194 tablet_bootstrap.cc:492] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:37.674072  8194 ts_tablet_manager.cc:1403] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.005s
I20260709 13:02:37.674147  8378 raft_consensus.cc:2804] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.674710  8378 raft_consensus.cc:697] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:37.675558  8378 consensus_queue.cc:237] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.676759  8194 raft_consensus.cc:359] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.677441  8194 raft_consensus.cc:385] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.677699  8194 raft_consensus.cc:740] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.681890  8072 raft_consensus.cc:2468] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:37.682686  8316 leader_election.cc:290] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:37.644129  8190 tablet_bootstrap.cc:654] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.686928  8192 tablet_bootstrap.cc:492] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:37.644225  8147 raft_consensus.cc:2468] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:37.687441  8192 ts_tablet_manager.cc:1403] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.006s
I20260709 13:02:37.688227  8037 leader_election.cc:304] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:37.690006  8434 raft_consensus.cc:2804] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.690129  8192 raft_consensus.cc:359] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.690557  8434 raft_consensus.cc:697] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:37.690896  8192 raft_consensus.cc:385] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.691231  8192 raft_consensus.cc:740] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.691623  8434 consensus_queue.cc:237] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:37.691824  8192 consensus_queue.cc:260] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.693589  8194 consensus_queue.cc:260] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.695127  8194 ts_tablet_manager.cc:1434] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.005s
I20260709 13:02:37.695976  8194 tablet_bootstrap.cc:492] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:37.696055  8189 tablet_bootstrap.cc:492] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:37.696767  8189 ts_tablet_manager.cc:1403] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.001s
I20260709 13:02:37.699025  8192 ts_tablet_manager.cc:1434] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:37.700300  8192 tablet_bootstrap.cc:492] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:37.702076  8189 raft_consensus.cc:359] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.712337  8282 raft_consensus.cc:493] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.712860  8282 raft_consensus.cc:515] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.715313  8282 leader_election.cc:290] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:37.715441  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:37.716552  7888 leader_election.cc:343] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.716972  8194 tablet_bootstrap.cc:654] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.717981  8189 raft_consensus.cc:385] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.718394  8189 raft_consensus.cc:740] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.719147  8189 consensus_queue.cc:260] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.719485  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:37.720768  8192 tablet_bootstrap.cc:654] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:37.721125  7891 leader_election.cc:343] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.721655  7891 leader_election.cc:304] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:37.722425  8412 raft_consensus.cc:2749] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.723556  8282 raft_consensus.cc:493] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.724130  8282 raft_consensus.cc:515] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.726179  8410 raft_consensus.cc:493] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.726858  8410 raft_consensus.cc:515] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.731109  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b36cb6f91433d818856a5aa867b7d" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:37.733088  8040 leader_election.cc:343] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.733839  8410 leader_election.cc:290] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:37.737669  8414 consensus_queue.cc:1048] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:37.742914  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b36cb6f91433d818856a5aa867b7d" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:37.743614  7923 raft_consensus.cc:2468] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:37.744954  8037 leader_election.cc:304] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:37.746358  8434 raft_consensus.cc:2804] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.746765  8434 raft_consensus.cc:493] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.747093  8434 raft_consensus.cc:3060] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.751482  8189 ts_tablet_manager.cc:1434] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
I20260709 13:02:37.739892  8410 consensus_queue.cc:1048] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:02:37.752497  8189 tablet_bootstrap.cc:492] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:37.756304  8300 raft_consensus.cc:493] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.756069  7823 catalog_manager.cc:5697] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.756839  8300 raft_consensus.cc:515] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:37.759274  8300 leader_election.cc:290] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:37.759455  8282 leader_election.cc:290] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:37.760970  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:37.761045  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:37.761997  8192 tablet_bootstrap.cc:492] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:37.761008  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:37.762465  8192 ts_tablet_manager.cc:1403] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.007s
W20260709 13:02:37.762604  7891 leader_election.cc:343] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:37.763904  7888 leader_election.cc:343] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.764290  7888 leader_election.cc:304] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:37.764989  8192 raft_consensus.cc:359] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.765682  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:37.766077  7891 leader_election.cc:343] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:37.767257  7888 leader_election.cc:343] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.766207  8434 raft_consensus.cc:515] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.767783  7888 leader_election.cc:304] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:37.765676  8192 raft_consensus.cc:385] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.769448  8300 raft_consensus.cc:2749] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.769531  8282 raft_consensus.cc:2749] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.770967  8192 raft_consensus.cc:740] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.775400  8192 consensus_queue.cc:260] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.776769  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b36cb6f91433d818856a5aa867b7d" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:37.777570  7923 raft_consensus.cc:3060] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.785581  8194 tablet_bootstrap.cc:492] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:37.789330  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b36cb6f91433d818856a5aa867b7d" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:37.793126  8378 consensus_queue.cc:1048] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:37.794198  8040 leader_election.cc:343] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.795393  8194 ts_tablet_manager.cc:1403] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.015s
I20260709 13:02:37.796512  8190 tablet_bootstrap.cc:492] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:37.796986  8190 ts_tablet_manager.cc:1403] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.176s	user 0.019s	sys 0.004s
I20260709 13:02:37.788970  7819 catalog_manager.cc:5697] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.789826  8189 tablet_bootstrap.cc:654] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.792181  8434 leader_election.cc:290] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:37.801110  8190 raft_consensus.cc:359] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.811102  8190 raft_consensus.cc:385] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.801854  8194 raft_consensus.cc:359] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.808065  8192 ts_tablet_manager.cc:1434] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 13:02:37.811719  8194 raft_consensus.cc:385] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.812041  8194 raft_consensus.cc:740] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.811396  8190 raft_consensus.cc:740] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.815034  8192 tablet_bootstrap.cc:492] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:37.816195  8190 consensus_queue.cc:260] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.817970  8194 consensus_queue.cc:260] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.825493  8194 ts_tablet_manager.cc:1434] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:02:37.826392  8194 tablet_bootstrap.cc:492] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:37.828032  8190 ts_tablet_manager.cc:1434] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:02:37.835486  8190 tablet_bootstrap.cc:492] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:37.841681  8434 raft_consensus.cc:493] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.852319  8434 raft_consensus.cc:515] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.857827  8434 leader_election.cc:290] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:37.862530  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5c76efc53c42d2858b26bbd9765c31" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:37.863261  8147 raft_consensus.cc:2468] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:37.864558  8037 leader_election.cc:304] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:37.864995  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5c76efc53c42d2858b26bbd9765c31" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:37.866017  8202 raft_consensus.cc:2804] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.866439  8202 raft_consensus.cc:493] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.866772  8202 raft_consensus.cc:3060] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.865660  7922 raft_consensus.cc:2468] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:37.872406  8316 consensus_queue.cc:1048] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:37.873451  8194 tablet_bootstrap.cc:654] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.877338  8418 consensus_queue.cc:1048] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:37.880815  7923 raft_consensus.cc:2468] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:37.881470  8414 raft_consensus.cc:493] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.882129  8414 raft_consensus.cc:515] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.867321  8300 raft_consensus.cc:493] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.885106  8300 raft_consensus.cc:515] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.885931  8414 leader_election.cc:290] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:37.887703  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b36cb6f91433d818856a5aa867b7d" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:37.888129  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b36cb6f91433d818856a5aa867b7d" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:37.888652  8071 raft_consensus.cc:2393] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:37.888957  7920 raft_consensus.cc:2393] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:37.890128  8354 consensus_queue.cc:1048] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:37.890363  7963 leader_election.cc:304] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:37.892736  8192 tablet_bootstrap.cc:654] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.892939  8417 raft_consensus.cc:3060] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.894706  8190 tablet_bootstrap.cc:654] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.900202  8202 raft_consensus.cc:515] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.910841  8189 tablet_bootstrap.cc:492] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:37.911588  8189 ts_tablet_manager.cc:1403] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.159s	user 0.018s	sys 0.026s
I20260709 13:02:37.898968  8354 raft_consensus.cc:493] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.921922  8354 raft_consensus.cc:515] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:37.923971  8354 leader_election.cc:290] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:37.939684  8202 leader_election.cc:290] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:37.882140  8037 leader_election.cc:304] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
W20260709 13:02:37.944057  8037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 62035.5us
I20260709 13:02:37.946666  8434 raft_consensus.cc:2804] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.947351  8434 raft_consensus.cc:697] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:37.948390  8434 consensus_queue.cc:237] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:37.968986  8300 leader_election.cc:290] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
W20260709 13:02:37.979601  7888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 53952.2us
I20260709 13:02:37.980792  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81919804d363474eb3975b2d6a675ac0" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:37.982178  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b60099f55e74a53b4e0533192c560dd" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:37.984794  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b60099f55e74a53b4e0533192c560dd" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:37.995868  7888 leader_election.cc:343] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:38.006780  7888 leader_election.cc:343] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.007390  7888 leader_election.cc:304] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:38.002995  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5c76efc53c42d2858b26bbd9765c31" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:38.010375  7919 raft_consensus.cc:3060] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.010598  8412 raft_consensus.cc:2749] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.012320  8194 tablet_bootstrap.cc:492] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:38.012842  8194 ts_tablet_manager.cc:1403] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.187s	user 0.011s	sys 0.021s
I20260709 13:02:38.014109  8071 raft_consensus.cc:3060] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.018128  8194 raft_consensus.cc:359] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.020064  8194 raft_consensus.cc:385] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.026335  8189 raft_consensus.cc:359] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.033650  8189 raft_consensus.cc:385] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.033942  8189 raft_consensus.cc:740] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.020483  8194 raft_consensus.cc:740] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.034596  8189 consensus_queue.cc:260] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.045928  8192 tablet_bootstrap.cc:492] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:38.046648  8192 ts_tablet_manager.cc:1403] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.234s	user 0.024s	sys 0.027s
I20260709 13:02:38.027110  8417 raft_consensus.cc:2749] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.052632  8190 tablet_bootstrap.cc:492] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:38.048378  8194 consensus_queue.cc:260] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.061744  8190 ts_tablet_manager.cc:1403] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.226s	user 0.017s	sys 0.014s
I20260709 13:02:38.064392  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5c76efc53c42d2858b26bbd9765c31" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:38.051779  8189 ts_tablet_manager.cc:1434] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.140s	user 0.008s	sys 0.000s
I20260709 13:02:38.066188  8192 raft_consensus.cc:359] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.066713  8189 tablet_bootstrap.cc:492] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:38.066890  8192 raft_consensus.cc:385] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.067260  8192 raft_consensus.cc:740] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.068058  8192 consensus_queue.cc:260] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.072757  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81919804d363474eb3975b2d6a675ac0" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:38.073645  8194 ts_tablet_manager.cc:1434] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.003s
I20260709 13:02:38.074564  8194 tablet_bootstrap.cc:492] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:38.067498  8146 raft_consensus.cc:3060] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.077654  8190 raft_consensus.cc:359] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.076692  8192 ts_tablet_manager.cc:1434] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:02:38.078320  8190 raft_consensus.cc:385] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.078698  8190 raft_consensus.cc:740] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.065686  7919 raft_consensus.cc:2468] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:38.082561  8037 leader_election.cc:304] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:38.083418  8354 raft_consensus.cc:2804] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.083642  8037 leader_election.cc:304] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:38.083926  8354 raft_consensus.cc:697] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:38.085225  8354 consensus_queue.cc:237] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.079383  8190 consensus_queue.cc:260] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.106572  8190 ts_tablet_manager.cc:1434] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:02:38.107571  8190 tablet_bootstrap.cc:492] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:38.113523  8190 tablet_bootstrap.cc:654] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.117815  8192 tablet_bootstrap.cc:492] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:38.135869  8316 consensus_queue.cc:1048] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:38.080780  7822 catalog_manager.cc:5697] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.138391  8189 tablet_bootstrap.cc:654] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.142261  8358 raft_consensus.cc:2749] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.147403  8423 consensus_queue.cc:1048] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.156468  8475 raft_consensus.cc:493] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.156988  8475 raft_consensus.cc:515] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.162428  8423 raft_consensus.cc:493] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.162999  8423 raft_consensus.cc:515] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.164702  8146 raft_consensus.cc:2468] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:38.165099  8423 leader_election.cc:290] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:38.165688  8423 consensus_queue.cc:1048] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.167706  8367 consensus_queue.cc:1048] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.168372  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:38.169243  8000 raft_consensus.cc:2468] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:38.191263  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:38.192025  8146 raft_consensus.cc:2468] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:38.192359  8475 leader_election.cc:290] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:38.194010  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:38.204282  8194 tablet_bootstrap.cc:654] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.196333  7920 raft_consensus.cc:2468] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:38.195379  8114 leader_election.cc:304] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:38.222591  8316 raft_consensus.cc:2804] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.223045  8316 raft_consensus.cc:493] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.223448  8316 raft_consensus.cc:3060] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.226650  8358 raft_consensus.cc:493] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.227169  8358 raft_consensus.cc:515] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.227967  8190 tablet_bootstrap.cc:492] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:38.228448  8190 ts_tablet_manager.cc:1403] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.121s	user 0.020s	sys 0.039s
I20260709 13:02:38.229233  8358 leader_election.cc:290] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:38.231117  8190 raft_consensus.cc:359] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.231777  8190 raft_consensus.cc:385] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.232041  8190 raft_consensus.cc:740] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.232461  8316 raft_consensus.cc:515] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.232638  8190 consensus_queue.cc:260] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.234494  8190 ts_tablet_manager.cc:1434] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:38.235422  8190 tablet_bootstrap.cc:492] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:38.235307  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:38.235478  8316 leader_election.cc:290] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:38.236126  7923 raft_consensus.cc:3060] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.237033  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2079bb44476c41ef908915825b1fa87c" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:38.241868  8190 tablet_bootstrap.cc:654] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.243450  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:38.244060  8000 raft_consensus.cc:3060] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:38.245424  8040 leader_election.cc:343] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.250941  8000 raft_consensus.cc:2468] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:38.252012  8114 leader_election.cc:304] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:38.252907  8418 raft_consensus.cc:2804] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.253362  8418 raft_consensus.cc:697] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:38.253554  7923 raft_consensus.cc:2468] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:38.254218  8418 consensus_queue.cc:237] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.256100  8358 consensus_queue.cc:1048] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.263586  7996 raft_consensus.cc:3060] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.235687  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2079bb44476c41ef908915825b1fa87c" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:38.264242  8378 consensus_queue.cc:1048] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:02:38.271854  7963 leader_election.cc:304] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:38.264981  7920 raft_consensus.cc:2468] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:38.273660  8037 leader_election.cc:304] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:38.274441  8202 raft_consensus.cc:2804] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.274777  8202 raft_consensus.cc:493] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.275098  8202 raft_consensus.cc:3060] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.275141  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:38.280284  8192 tablet_bootstrap.cc:654] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.293900  8202 raft_consensus.cc:515] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.296137  8202 leader_election.cc:290] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:38.276226  7923 raft_consensus.cc:2393] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate 87b2df8987cd4ac0b02b0632752c3a24 in this term.
I20260709 13:02:38.305049  8189 tablet_bootstrap.cc:492] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:38.305572  8189 ts_tablet_manager.cc:1403] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.239s	user 0.030s	sys 0.024s
I20260709 13:02:38.284705  8475 raft_consensus.cc:2764] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:02:38.308333  8189 raft_consensus.cc:359] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.315062  8189 raft_consensus.cc:385] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.315486  8189 raft_consensus.cc:740] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.316366  8189 consensus_queue.cc:260] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.318030  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2079bb44476c41ef908915825b1fa87c" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:38.326157  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2079bb44476c41ef908915825b1fa87c" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:38.326750  7920 raft_consensus.cc:3060] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:38.334643  8040 leader_election.cc:343] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.343302  8189 ts_tablet_manager.cc:1434] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:02:38.344632  8189 tablet_bootstrap.cc:492] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:38.340049  8316 raft_consensus.cc:493] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.355014  8202 consensus_queue.cc:1048] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.351357  8316 raft_consensus.cc:515] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.364038  7920 raft_consensus.cc:2468] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:38.369027  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05f3e48c8014333a190a26992b87f9d" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:38.370518  8114 leader_election.cc:343] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.371275  8037 leader_election.cc:304] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:38.370536  7819 catalog_manager.cc:5697] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.373159  8358 raft_consensus.cc:2804] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.373659  8358 raft_consensus.cc:697] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:38.374483  8358 consensus_queue.cc:237] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.375674  8316 leader_election.cc:290] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:38.379470  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05f3e48c8014333a190a26992b87f9d" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:38.383854  8111 leader_election.cc:343] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.384320  8111 leader_election.cc:304] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:38.385511  8423 raft_consensus.cc:2749] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.411499  8192 tablet_bootstrap.cc:492] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:38.412000  8192 ts_tablet_manager.cc:1403] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.295s	user 0.014s	sys 0.008s
I20260709 13:02:38.421566  8190 tablet_bootstrap.cc:492] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:38.422107  8190 ts_tablet_manager.cc:1403] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.187s	user 0.008s	sys 0.014s
I20260709 13:02:38.424708  8190 raft_consensus.cc:359] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.425391  8190 raft_consensus.cc:385] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.425654  8190 raft_consensus.cc:740] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.414498  8192 raft_consensus.cc:359] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.428452  8192 raft_consensus.cc:385] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.428956  8192 raft_consensus.cc:740] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.429524  8192 consensus_queue.cc:260] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.428388  7822 catalog_manager.cc:5697] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.426271  8190 consensus_queue.cc:260] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.450791  8472 raft_consensus.cc:493] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.451292  8472 raft_consensus.cc:515] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.452266  8189 tablet_bootstrap.cc:654] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.453367  8472 leader_election.cc:290] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:38.459028  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:38.462493  7888 leader_election.cc:343] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.463613  8194 tablet_bootstrap.cc:492] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:38.464083  8194 ts_tablet_manager.cc:1403] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.390s	user 0.017s	sys 0.005s
I20260709 13:02:38.468210  8190 ts_tablet_manager.cc:1434] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:02:38.469780  8190 tablet_bootstrap.cc:492] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:38.469713  8202 consensus_queue.cc:1048] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.470273  8192 ts_tablet_manager.cc:1434] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:02:38.467157  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:38.476850  8358 raft_consensus.cc:493] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.478283  7888 leader_election.cc:343] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.477352  8358 raft_consensus.cc:515] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.478892  7888 leader_election.cc:304] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:38.478834  8194 raft_consensus.cc:359] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.479884  8194 raft_consensus.cc:385] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.480036  8472 raft_consensus.cc:2749] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.488883  8410 consensus_queue.cc:1048] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.490875  8189 tablet_bootstrap.cc:492] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:38.491422  8189 ts_tablet_manager.cc:1403] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.001s
I20260709 13:02:38.482563  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b60099f55e74a53b4e0533192c560dd" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:38.492178  7920 raft_consensus.cc:2468] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:38.483289  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b60099f55e74a53b4e0533192c560dd" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:38.483871  8354 consensus_queue.cc:1048] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.493383  8037 leader_election.cc:304] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:38.487438  8192 tablet_bootstrap.cc:492] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:38.494501  8410 raft_consensus.cc:2804] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.489205  8194 raft_consensus.cc:740] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.494880  8410 raft_consensus.cc:493] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.495272  8410 raft_consensus.cc:3060] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.495539  8194 consensus_queue.cc:260] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.496568  8146 raft_consensus.cc:2468] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:38.500546  8192 tablet_bootstrap.cc:654] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.503974  8189 raft_consensus.cc:359] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.514927  8189 raft_consensus.cc:385] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.515301  8189 raft_consensus.cc:740] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.516096  8189 consensus_queue.cc:260] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.518957  8189 ts_tablet_manager.cc:1434] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:02:38.528483  8189 tablet_bootstrap.cc:492] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:38.505834  8192 tablet_bootstrap.cc:492] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:38.506616  8194 ts_tablet_manager.cc:1434] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.004s
I20260709 13:02:38.534889  8192 ts_tablet_manager.cc:1403] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 13:02:38.535638  8194 tablet_bootstrap.cc:492] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:38.507926  8410 raft_consensus.cc:515] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.480635  8358 leader_election.cc:290] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:38.542042  8194 tablet_bootstrap.cc:654] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.513240  8190 tablet_bootstrap.cc:654] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.544970  8410 leader_election.cc:290] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:38.553701  8189 tablet_bootstrap.cc:654] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.557961  8192 raft_consensus.cc:359] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.558755  8192 raft_consensus.cc:385] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.559046  8192 raft_consensus.cc:740] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.567970  8190 tablet_bootstrap.cc:492] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:38.568588  8190 ts_tablet_manager.cc:1403] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.010s
I20260709 13:02:38.572875  8194 tablet_bootstrap.cc:492] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:38.576068  8194 ts_tablet_manager.cc:1403] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 13:02:38.574057  8190 raft_consensus.cc:359] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.578929  8190 raft_consensus.cc:385] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.579291  8190 raft_consensus.cc:740] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.580039  8190 consensus_queue.cc:260] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.581696  8194 raft_consensus.cc:359] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.584860  8194 raft_consensus.cc:385] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.585245  8194 raft_consensus.cc:740] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.586163  8194 consensus_queue.cc:260] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.586376  8192 consensus_queue.cc:260] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.584510  8190 ts_tablet_manager.cc:1434] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:02:38.587998  8190 tablet_bootstrap.cc:492] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:38.589999  8192 ts_tablet_manager.cc:1434] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
W20260709 13:02:38.590288  8037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 59964.5us
I20260709 13:02:38.590948  8192 tablet_bootstrap.cc:492] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:38.591881  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b60099f55e74a53b4e0533192c560dd" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:38.592525  8148 raft_consensus.cc:3060] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.592554  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b60099f55e74a53b4e0533192c560dd" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:38.593446  7920 raft_consensus.cc:3060] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.595643  8194 ts_tablet_manager.cc:1434] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:02:38.596562  8194 tablet_bootstrap.cc:492] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:38.598254  8189 tablet_bootstrap.cc:492] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:38.598743  8189 ts_tablet_manager.cc:1403] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.008s
I20260709 13:02:38.600237  8148 raft_consensus.cc:2468] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:38.601804  8189 raft_consensus.cc:359] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.604220  8189 raft_consensus.cc:385] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.604581  8192 tablet_bootstrap.cc:654] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.604629  8189 raft_consensus.cc:740] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.605537  8189 consensus_queue.cc:260] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.609594  8190 tablet_bootstrap.cc:654] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:38.611004  7870 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:38.604156  7920 raft_consensus.cc:2468] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:38.612804  7819 catalog_manager.cc:5697] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.614092  8189 ts_tablet_manager.cc:1434] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:02:38.614979  8194 tablet_bootstrap.cc:654] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.615144  8189 tablet_bootstrap.cc:492] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:38.621644  8192 tablet_bootstrap.cc:492] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:38.622090  8192 ts_tablet_manager.cc:1403] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.005s
I20260709 13:02:38.624651  8192 raft_consensus.cc:359] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.625310  8192 raft_consensus.cc:385] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.625566  8192 raft_consensus.cc:740] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.626243  8192 consensus_queue.cc:260] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.626799  8190 tablet_bootstrap.cc:492] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:38.627615  8190 ts_tablet_manager.cc:1403] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:02:38.628427  8192 ts_tablet_manager.cc:1434] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:02:38.629360  8192 tablet_bootstrap.cc:492] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:38.632781  8190 raft_consensus.cc:359] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.633425  8190 raft_consensus.cc:385] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.633678  8190 raft_consensus.cc:740] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.637892  8189 tablet_bootstrap.cc:654] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.638415  8190 consensus_queue.cc:260] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.640846  8190 ts_tablet_manager.cc:1434] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:02:38.640977  8194 tablet_bootstrap.cc:492] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:38.641521  8194 ts_tablet_manager.cc:1403] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.001s
I20260709 13:02:38.641728  8190 tablet_bootstrap.cc:492] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:38.644153  8194 raft_consensus.cc:359] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.656123  8194 raft_consensus.cc:385] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.657294  8194 raft_consensus.cc:740] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.658179  8194 consensus_queue.cc:260] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.659870  8192 tablet_bootstrap.cc:654] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.660454  8194 ts_tablet_manager.cc:1434] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:02:38.661844  8194 tablet_bootstrap.cc:492] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:38.673096  8194 tablet_bootstrap.cc:654] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.648586  8190 tablet_bootstrap.cc:654] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.683373  8192 tablet_bootstrap.cc:492] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:38.683876  8192 ts_tablet_manager.cc:1403] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.013s
I20260709 13:02:38.684429  8367 consensus_queue.cc:1048] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.680791  8189 tablet_bootstrap.cc:492] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:38.686708  8189 ts_tablet_manager.cc:1403] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.007s
I20260709 13:02:38.686537  8192 raft_consensus.cc:359] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.687340  8192 raft_consensus.cc:385] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.687647  8192 raft_consensus.cc:740] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.688436  8192 consensus_queue.cc:260] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.692122  8190 tablet_bootstrap.cc:492] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:38.692554  8190 ts_tablet_manager.cc:1403] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.000s
I20260709 13:02:38.693239  8300 raft_consensus.cc:493] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.693420  8189 raft_consensus.cc:359] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.693748  8300 raft_consensus.cc:515] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.694211  8189 raft_consensus.cc:385] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.694545  8189 raft_consensus.cc:740] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.695346  8190 raft_consensus.cc:359] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.696074  8190 raft_consensus.cc:385] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.696318  8190 raft_consensus.cc:740] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.696353  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b266a15c0d446148dc910d00fe07d0f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:38.697336  8421 raft_consensus.cc:493] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.697784  7891 leader_election.cc:343] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.698251  8192 ts_tablet_manager.cc:1434] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:38.697945  8421 raft_consensus.cc:515] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.695298  8189 consensus_queue.cc:260] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.699056  8300 leader_election.cc:290] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:38.700412  8190 consensus_queue.cc:260] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.700730  8421 leader_election.cc:290] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:38.702486  8190 ts_tablet_manager.cc:1434] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:02:38.703354  8190 tablet_bootstrap.cc:492] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:38.703137  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b266a15c0d446148dc910d00fe07d0f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:38.706401  7888 leader_election.cc:343] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.706904  7888 leader_election.cc:304] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:38.707508  8189 ts_tablet_manager.cc:1434] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:02:38.708353  8189 tablet_bootstrap.cc:492] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:38.708837  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2079bb44476c41ef908915825b1fa87c" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:38.709015  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2079bb44476c41ef908915825b1fa87c" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:38.709614  8472 raft_consensus.cc:2749] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.710281  8472 raft_consensus.cc:493] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.710714  8472 raft_consensus.cc:515] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.712862  8472 leader_election.cc:290] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:38.713380  7923 raft_consensus.cc:2393] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:38.709748  8192 tablet_bootstrap.cc:492] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:38.713881  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:38.716063  7963 leader_election.cc:304] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:38.716446  8190 tablet_bootstrap.cc:654] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.718763  8417 raft_consensus.cc:3060] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.716876  8189 tablet_bootstrap.cc:654] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:38.717337  7891 leader_election.cc:343] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.726032  8037 leader_election.cc:304] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:38.728281  8410 consensus_queue.cc:1048] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.726879  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:38.734028  7888 leader_election.cc:343] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.736246  7888 leader_election.cc:304] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:38.731638  8202 raft_consensus.cc:2804] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.733963  8192 tablet_bootstrap.cc:654] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.738572  8202 raft_consensus.cc:697] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:38.739547  8202 consensus_queue.cc:237] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.727214  8300 raft_consensus.cc:493] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.743374  8300 raft_consensus.cc:515] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.746526  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6cabe1c12e4d4293ddb5333b2562d8" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:38.747794  7891 leader_election.cc:343] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.748310  8300 leader_election.cc:290] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:38.750118  8417 raft_consensus.cc:2749] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.740772  8472 raft_consensus.cc:2749] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.753832  8496 raft_consensus.cc:493] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.754328  8496 raft_consensus.cc:515] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.761801  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:38.762694  8146 raft_consensus.cc:2468] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:38.759096  8496 leader_election.cc:290] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:38.771620  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6cabe1c12e4d4293ddb5333b2562d8" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:38.778407  8037 leader_election.cc:304] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:38.780689  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:38.780995  8498 raft_consensus.cc:2804] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.781420  8000 raft_consensus.cc:2468] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:38.781509  8498 raft_consensus.cc:493] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.782076  8498 raft_consensus.cc:3060] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:38.782789  7888 leader_election.cc:343] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.783402  7888 leader_election.cc:304] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:38.791150  8367 consensus_queue.cc:1048] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:38.800866  8194 tablet_bootstrap.cc:492] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:38.801614  8194 ts_tablet_manager.cc:1403] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.140s	user 0.039s	sys 0.017s
I20260709 13:02:38.803131  8472 raft_consensus.cc:2749] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.818810  8194 raft_consensus.cc:359] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.819612  8194 raft_consensus.cc:385] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.819865  8194 raft_consensus.cc:740] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.820474  8194 consensus_queue.cc:260] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.823997  8194 ts_tablet_manager.cc:1434] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:02:38.825244  8498 raft_consensus.cc:515] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.828850  8189 tablet_bootstrap.cc:492] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:38.829334  8189 ts_tablet_manager.cc:1403] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.001s
I20260709 13:02:38.832149  8189 raft_consensus.cc:359] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.832764  8189 raft_consensus.cc:385] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.833003  8189 raft_consensus.cc:740] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.833555  8189 consensus_queue.cc:260] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.835045  8189 ts_tablet_manager.cc:1434] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:38.835916  8189 tablet_bootstrap.cc:492] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:38.825989  8194 tablet_bootstrap.cc:492] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:38.848171  8190 tablet_bootstrap.cc:492] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:38.848268  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:38.848861  8190 ts_tablet_manager.cc:1403] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.146s	user 0.039s	sys 0.027s
I20260709 13:02:38.848996  7997 raft_consensus.cc:3060] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.851657  8190 raft_consensus.cc:359] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.852320  8190 raft_consensus.cc:385] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.852597  8190 raft_consensus.cc:740] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.853231  8190 consensus_queue.cc:260] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:38.858230  8194 tablet_bootstrap.cc:654] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.860267  8190 ts_tablet_manager.cc:1434] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:02:38.861261  8190 tablet_bootstrap.cc:492] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:38.864043  8498 leader_election.cc:290] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:38.861846  7997 raft_consensus.cc:2468] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:38.868742  8040 leader_election.cc:304] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:38.875640  7822 catalog_manager.cc:5697] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.875703  8189 tablet_bootstrap.cc:654] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.877812  8498 raft_consensus.cc:2804] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.882159  8498 raft_consensus.cc:697] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:38.883092  8498 consensus_queue.cc:237] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.878968  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:38.888124  8148 raft_consensus.cc:3060] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.890246  8192 tablet_bootstrap.cc:492] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:38.890774  8192 ts_tablet_manager.cc:1403] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.192s	user 0.014s	sys 0.001s
I20260709 13:02:38.918761  8497 raft_consensus.cc:493] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.919797  8497 raft_consensus.cc:515] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.923333  8497 leader_election.cc:290] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:38.924687  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05f3e48c8014333a190a26992b87f9d" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:38.925467  8146 raft_consensus.cc:2468] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:38.923951  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05f3e48c8014333a190a26992b87f9d" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:38.927518  8037 leader_election.cc:304] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:38.928092  8000 raft_consensus.cc:2468] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:38.928355  8497 raft_consensus.cc:2804] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.928887  8497 raft_consensus.cc:493] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.931071  8148 raft_consensus.cc:2468] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:38.929768  8497 raft_consensus.cc:3060] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.934262  8190 tablet_bootstrap.cc:654] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.942402  8202 consensus_queue.cc:1048] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.943005  8192 raft_consensus.cc:359] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.943718  8192 raft_consensus.cc:385] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.944039  8192 raft_consensus.cc:740] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.945988  8194 tablet_bootstrap.cc:492] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:38.946521  8194 ts_tablet_manager.cc:1403] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.000s
I20260709 13:02:38.947870  8189 tablet_bootstrap.cc:492] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:38.948354  8189 ts_tablet_manager.cc:1403] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.113s	user 0.019s	sys 0.014s
I20260709 13:02:38.949033  8194 raft_consensus.cc:359] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.950932  8194 raft_consensus.cc:385] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.951180  8194 raft_consensus.cc:740] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.951887  8194 consensus_queue.cc:260] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:38.950207  8192 consensus_queue.cc:260] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.955747  8367 raft_consensus.cc:493] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.956077  8189 raft_consensus.cc:359] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.956835  8189 raft_consensus.cc:385] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.956794  8367 raft_consensus.cc:515] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:38.957293  8189 raft_consensus.cc:740] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.957636  8192 ts_tablet_manager.cc:1434] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 13:02:38.958797  8192 tablet_bootstrap.cc:492] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:38.958163  8189 consensus_queue.cc:260] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.972152  8192 tablet_bootstrap.cc:654] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.972735  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:38.973461  7923 raft_consensus.cc:2468] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:38.975046  8300 raft_consensus.cc:493] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.975605  8300 raft_consensus.cc:515] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:38.977938  8189 ts_tablet_manager.cc:1434] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:02:38.978137  8300 leader_election.cc:290] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:38.979624  8111 leader_election.cc:304] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:38.981127  8417 raft_consensus.cc:493] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.982808  8189 tablet_bootstrap.cc:492] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:38.992067  8378 raft_consensus.cc:2804] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.993116  8378 raft_consensus.cc:493] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.993479  8378 raft_consensus.cc:3060] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.983362  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cafbe600ba4345a1a6fd83c004006b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:38.984493  8202 consensus_queue.cc:1048] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:38.984822  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cafbe600ba4345a1a6fd83c004006b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:38.989255  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:38.986284  8367 leader_election.cc:290] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:38.991460  8194 ts_tablet_manager.cc:1434] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:02:38.997928  8194 tablet_bootstrap.cc:492] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
W20260709 13:02:39.003895  7888 leader_election.cc:343] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.996802  8072 raft_consensus.cc:2468] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 0.
I20260709 13:02:38.995594  8417 raft_consensus.cc:515] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.009240  8417 leader_election.cc:290] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:39.009728  8415 raft_consensus.cc:493] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.009812  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:38.976697  7818 catalog_manager.cc:5697] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.012898  7888 leader_election.cc:304] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:39.014366  7997 raft_consensus.cc:2468] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:39.019332  8517 raft_consensus.cc:2804] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.019750  8517 raft_consensus.cc:493] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.020058  8517 raft_consensus.cc:3060] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.016618  8202 raft_consensus.cc:493] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.023447  8202 raft_consensus.cc:515] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.010653  8415 raft_consensus.cc:515] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.024997  8497 raft_consensus.cc:515] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.026904  8415 leader_election.cc:290] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:39.010699  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.027644  7923 raft_consensus.cc:2468] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:39.029563  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:39.029829  7963 leader_election.cc:304] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:39.030187  7996 raft_consensus.cc:2468] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:39.031158  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.031770  7920 raft_consensus.cc:2468] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:39.033942  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:39.034533  8072 raft_consensus.cc:2468] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:39.036017  8040 leader_election.cc:304] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:39.036971  8497 leader_election.cc:290] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:39.037190  8434 raft_consensus.cc:2804] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.043051  8434 raft_consensus.cc:493] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.043427  8434 raft_consensus.cc:3060] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.038524  7963 leader_election.cc:304] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:39.039249  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.045715  7920 raft_consensus.cc:2468] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:39.039939  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05f3e48c8014333a190a26992b87f9d" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:39.046625  8146 raft_consensus.cc:3060] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.047717  8517 raft_consensus.cc:515] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.048559  8194 tablet_bootstrap.cc:654] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.050139  8475 raft_consensus.cc:2804] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.053902  8475 raft_consensus.cc:493] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.054281  8475 raft_consensus.cc:3060] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.054949  8517 leader_election.cc:290] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:39.060304  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cafbe600ba4345a1a6fd83c004006b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:39.060953  8074 raft_consensus.cc:3060] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.062081  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cafbe600ba4345a1a6fd83c004006b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:39.051308  8417 raft_consensus.cc:2804] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.063774  8417 raft_consensus.cc:493] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.064177  8417 raft_consensus.cc:3060] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.052547  8189 tablet_bootstrap.cc:654] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.047163  8378 raft_consensus.cc:515] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.052403  8192 tablet_bootstrap.cc:492] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:39.065470  8192 ts_tablet_manager.cc:1403] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.107s	user 0.028s	sys 0.028s
I20260709 13:02:39.062402  8146 raft_consensus.cc:2468] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:39.066327  8378 leader_election.cc:290] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.067162  8148 raft_consensus.cc:2393] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate 87b2df8987cd4ac0b02b0632752c3a24 in this term.
I20260709 13:02:39.064226  8194 tablet_bootstrap.cc:492] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:39.067821  8194 ts_tablet_manager.cc:1403] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.001s
I20260709 13:02:39.068248  8192 raft_consensus.cc:359] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.068912  8192 raft_consensus.cc:385] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.069186  8192 raft_consensus.cc:740] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.069859  8192 consensus_queue.cc:260] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.073814  8189 tablet_bootstrap.cc:492] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:39.073900  8074 raft_consensus.cc:2468] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:39.074443  8189 ts_tablet_manager.cc:1403] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.000s
I20260709 13:02:39.075014  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05f3e48c8014333a190a26992b87f9d" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:39.075647  7997 raft_consensus.cc:3060] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.076692  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:39.077103  8189 raft_consensus.cc:359] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.077782  8189 raft_consensus.cc:385] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.078053  8189 raft_consensus.cc:740] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.070453  8194 raft_consensus.cc:359] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.079171  8194 raft_consensus.cc:385] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.079466  8194 raft_consensus.cc:740] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.081365  8194 consensus_queue.cc:260] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.086037  8037 leader_election.cc:304] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:39.087023  7888 leader_election.cc:304] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:39.088701  8496 raft_consensus.cc:2804] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.088992  8517 raft_consensus.cc:2804] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.089231  8496 raft_consensus.cc:697] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:39.089764  8517 raft_consensus.cc:697] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:39.090142  8496 consensus_queue.cc:237] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.090778  8202 leader_election.cc:290] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.090619  8517 consensus_queue.cc:237] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.094506  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:39.095341  7920 raft_consensus.cc:3060] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.096086  8378 raft_consensus.cc:493] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.096604  8378 raft_consensus.cc:515] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:39.100445  7888 leader_election.cc:343] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.102183  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:39.103570  8378 leader_election.cc:290] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
W20260709 13:02:39.104301  8114 leader_election.cc:343] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.107865  8192 ts_tablet_manager.cc:1434] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:02:39.108856  8192 tablet_bootstrap.cc:492] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:39.109388  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:39.112447  8111 leader_election.cc:343] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.086915  8189 consensus_queue.cc:260] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.113894  8111 leader_election.cc:304] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:39.088068  8194 ts_tablet_manager.cc:1434] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:02:39.115307  8194 tablet_bootstrap.cc:492] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:39.115336  8378 raft_consensus.cc:2749] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.117658  8417 raft_consensus.cc:515] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.119078  8434 raft_consensus.cc:515] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.123005  8189 ts_tablet_manager.cc:1434] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:02:39.124104  8189 tablet_bootstrap.cc:492] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:39.128072  8190 tablet_bootstrap.cc:492] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:39.128500  8190 ts_tablet_manager.cc:1403] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.267s	user 0.016s	sys 0.010s
I20260709 13:02:39.106297  8475 raft_consensus.cc:515] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.131466  7996 raft_consensus.cc:2393] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 87b2df8987cd4ac0b02b0632752c3a24 in current term 1: Already voted for candidate 17a4c4b3539b43108ef3481121d982bd in this term.
I20260709 13:02:39.132009  7920 raft_consensus.cc:2468] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:39.133509  8111 leader_election.cc:304] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:39.134447  8378 raft_consensus.cc:2804] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.134930  8378 raft_consensus.cc:697] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:39.135627  8378 consensus_queue.cc:237] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.140972  7818 catalog_manager.cc:5697] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.143283  8189 tablet_bootstrap.cc:654] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.144526  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:39.146759  8434 leader_election.cc:290] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.147310  8475 leader_election.cc:290] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:39.148034  8194 tablet_bootstrap.cc:654] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.148285  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:39.149163  7920 raft_consensus.cc:2393] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate 87b2df8987cd4ac0b02b0632752c3a24 in this term.
I20260709 13:02:39.150117  7963 leader_election.cc:304] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:39.153144  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:39.163388  7920 raft_consensus.cc:3060] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.164173  8367 raft_consensus.cc:493] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.164665  8367 raft_consensus.cc:515] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.166751  8367 leader_election.cc:290] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.167200  8367 raft_consensus.cc:493] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.167635  8367 raft_consensus.cc:515] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.167891  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.168848  7923 raft_consensus.cc:2468] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:39.170389  8111 leader_election.cc:304] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:39.152210  7997 raft_consensus.cc:2468] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:39.171505  8423 raft_consensus.cc:2804] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.172043  7920 raft_consensus.cc:2468] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:39.172132  8423 raft_consensus.cc:493] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.172730  8423 raft_consensus.cc:3060] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.156857  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:39.175612  7919 raft_consensus.cc:2393] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:39.157756  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:39.176883  8194 tablet_bootstrap.cc:492] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:39.177332  8194 ts_tablet_manager.cc:1403] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.009s
I20260709 13:02:39.177416  7996 raft_consensus.cc:2393] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc7af07a29d1443b8a3c4a3770d52344 in current term 1: Already voted for candidate 17a4c4b3539b43108ef3481121d982bd in this term.
I20260709 13:02:39.178028  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:39.157913  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:39.178989  8074 raft_consensus.cc:2393] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:39.179231  8367 leader_election.cc:290] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:39.158203  8192 tablet_bootstrap.cc:654] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.180286  8194 raft_consensus.cc:359] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.161026  8189 tablet_bootstrap.cc:492] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:39.181689  8189 ts_tablet_manager.cc:1403] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.002s
I20260709 13:02:39.160398  7818 catalog_manager.cc:5697] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.158658  8190 raft_consensus.cc:359] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.183211  8190 raft_consensus.cc:385] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.183507  8190 raft_consensus.cc:740] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.184178  8190 consensus_queue.cc:260] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.184366  8189 raft_consensus.cc:359] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.185112  8189 raft_consensus.cc:385] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.185398  8189 raft_consensus.cc:740] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.181035  8194 raft_consensus.cc:385] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.187131  8194 raft_consensus.cc:740] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.188184  7963 leader_election.cc:304] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:39.181044  8037 leader_election.cc:304] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:39.188395  8194 consensus_queue.cc:260] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.189364  8202 raft_consensus.cc:2804] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.189792  8202 raft_consensus.cc:697] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:39.190721  8415 raft_consensus.cc:2749] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.190510  8202 consensus_queue.cc:237] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.192366  8194 ts_tablet_manager.cc:1434] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:02:39.193123  8190 ts_tablet_manager.cc:1434] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:02:39.186162  8189 consensus_queue.cc:260] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.193956  8194 tablet_bootstrap.cc:492] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:39.194072  8190 tablet_bootstrap.cc:492] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:39.195428  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.196079  7919 raft_consensus.cc:2468] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:39.197798  8415 raft_consensus.cc:493] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.198295  8415 raft_consensus.cc:515] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.201838  8190 tablet_bootstrap.cc:654] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.209229  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:39.209882  8189 ts_tablet_manager.cc:1434] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 13:02:39.210799  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:39.211122  8111 leader_election.cc:304] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:39.211612  7997 raft_consensus.cc:2468] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:39.212334  8367 raft_consensus.cc:2804] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.212709  8367 raft_consensus.cc:493] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.213037  8367 raft_consensus.cc:3060] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.216405  8415 leader_election.cc:290] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:39.218003  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.218699  7919 raft_consensus.cc:2468] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:39.220985  8192 tablet_bootstrap.cc:492] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:39.221498  8192 ts_tablet_manager.cc:1403] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.113s	user 0.005s	sys 0.004s
I20260709 13:02:39.223117  7963 leader_election.cc:304] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:39.156388  8417 leader_election.cc:290] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:39.224184  8192 raft_consensus.cc:359] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.224890  8192 raft_consensus.cc:385] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.225381  8192 raft_consensus.cc:740] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.206300  8423 raft_consensus.cc:515] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.226056  8192 consensus_queue.cc:260] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.224870  8417 raft_consensus.cc:2804] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.227761  8423 leader_election.cc:290] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.227984  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:39.228607  7919 raft_consensus.cc:3060] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.230690  8148 raft_consensus.cc:2393] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate 87b2df8987cd4ac0b02b0632752c3a24 in this term.
I20260709 13:02:39.231482  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:39.151208  8475 raft_consensus.cc:2749] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:02:39.235662  8111 leader_election.cc:343] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.210846  8189 tablet_bootstrap.cc:492] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:39.227029  8417 raft_consensus.cc:493] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.207238  8194 tablet_bootstrap.cc:654] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.239148  8367 raft_consensus.cc:515] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.238819  8417 raft_consensus.cc:3060] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.243083  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:39.243793  7920 raft_consensus.cc:3060] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.249903  8189 tablet_bootstrap.cc:654] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.253213  8190 tablet_bootstrap.cc:492] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:39.253717  8190 ts_tablet_manager.cc:1403] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.004s
I20260709 13:02:39.253717  7819 catalog_manager.cc:5697] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.257651  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:39.258430  8194 tablet_bootstrap.cc:492] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:39.258965  8194 ts_tablet_manager.cc:1403] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 13:02:39.268500  8517 raft_consensus.cc:493] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.258942  7823 catalog_manager.cc:5697] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.269004  8517 raft_consensus.cc:515] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.263481  8192 ts_tablet_manager.cc:1434] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.005s
I20260709 13:02:39.271754  8192 tablet_bootstrap.cc:492] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
W20260709 13:02:39.260453  8111 leader_election.cc:343] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.273646  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ad60198ae44613945d4f009def4097" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:39.275913  7891 leader_election.cc:343] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.278152  8192 tablet_bootstrap.cc:654] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.280575  8517 leader_election.cc:290] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:39.281188  8194 raft_consensus.cc:359] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.282122  8194 raft_consensus.cc:385] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.250582  7920 raft_consensus.cc:2468] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:39.285307  7919 raft_consensus.cc:2468] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:39.287639  8367 leader_election.cc:290] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:39.288103  8417 raft_consensus.cc:515] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.282459  8194 raft_consensus.cc:740] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.289645  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ad60198ae44613945d4f009def4097" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:39.290303  8194 consensus_queue.cc:260] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.295183  8111 leader_election.cc:304] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:39.303654  8111 leader_election.cc:304] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:39.303529  8190 raft_consensus.cc:359] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.304313  8190 raft_consensus.cc:385] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.304603  8190 raft_consensus.cc:740] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.304774  8423 raft_consensus.cc:2804] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.304982  8367 raft_consensus.cc:2804] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.305351  8423 raft_consensus.cc:697] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:39.305570  8367 raft_consensus.cc:697] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:39.305620  8190 consensus_queue.cc:260] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.306226  8423 consensus_queue.cc:237] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.306494  8367 consensus_queue.cc:237] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.307936  8190 ts_tablet_manager.cc:1434] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:02:39.308848  8190 tablet_bootstrap.cc:492] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:39.297266  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:39.311559  7919 raft_consensus.cc:2393] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate 87b2df8987cd4ac0b02b0632752c3a24 in this term.
I20260709 13:02:39.297665  8194 ts_tablet_manager.cc:1434] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:02:39.313263  8194 tablet_bootstrap.cc:492] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:39.314386  8190 tablet_bootstrap.cc:654] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.297763  8417 leader_election.cc:290] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:39.301376  8192 tablet_bootstrap.cc:492] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:39.295013  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:39.318181  8192 ts_tablet_manager.cc:1403] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 13:02:39.318764  8517 raft_consensus.cc:493] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.319263  8517 raft_consensus.cc:515] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.321206  8517 leader_election.cc:290] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:39.321691  8192 raft_consensus.cc:359] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.322818  7963 leader_election.cc:304] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:39.324093  8421 raft_consensus.cc:2749] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.329391  8497 consensus_queue.cc:1048] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.334118  8194 tablet_bootstrap.cc:654] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.322584  8192 raft_consensus.cc:385] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.335253  8192 raft_consensus.cc:740] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.336112  8192 consensus_queue.cc:260] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
W20260709 13:02:39.294761  7888 leader_election.cc:343] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.338274  7888 leader_election.cc:304] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:39.339459  8517 raft_consensus.cc:2749] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:39.339486  7888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 44826us
I20260709 13:02:39.341661  8190 tablet_bootstrap.cc:492] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:39.342195  8190 ts_tablet_manager.cc:1403] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.016s
I20260709 13:02:39.338523  8189 tablet_bootstrap.cc:492] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:39.345065  8189 ts_tablet_manager.cc:1403] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.007s
I20260709 13:02:39.348512  8354 consensus_queue.cc:1048] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.351517  8192 ts_tablet_manager.cc:1434] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.004s
I20260709 13:02:39.352555  8192 tablet_bootstrap.cc:492] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:39.353258  8354 consensus_queue.cc:1048] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.356647  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:39.358180  8192 tablet_bootstrap.cc:654] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.366083  7819 catalog_manager.cc:5697] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.367862  7819 catalog_manager.cc:5697] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.389500  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:39.396075  8367 raft_consensus.cc:493] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.396342  8189 raft_consensus.cc:359] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.398182  8354 consensus_queue.cc:1048] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:02:39.398480  7888 leader_election.cc:343] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.396580  8367 raft_consensus.cc:515] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.411875  8367 leader_election.cc:290] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:39.414942  8378 raft_consensus.cc:493] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.414983  7888 leader_election.cc:343] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.415251  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cafbe600ba4345a1a6fd83c004006b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:39.415521  7888 leader_election.cc:304] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:39.415464  8378 raft_consensus.cc:515] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.427374  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a51a0a61adf4ce19d7ce6f958f2451b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:39.429102  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a51a0a61adf4ce19d7ce6f958f2451b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:39.416365  8517 raft_consensus.cc:2749] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.416101  8071 raft_consensus.cc:2393] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87b2df8987cd4ac0b02b0632752c3a24 in current term 1: Already voted for candidate 77c8a837918d478fb10b627dfdbf90e4 in this term.
I20260709 13:02:39.417307  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cafbe600ba4345a1a6fd83c004006b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.429812  7997 raft_consensus.cc:2468] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:39.432147  8114 leader_election.cc:304] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:39.433583  8316 raft_consensus.cc:2804] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.433954  8316 raft_consensus.cc:493] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.434263  8316 raft_consensus.cc:3060] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:39.439050  8111 leader_election.cc:343] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.440155  8111 leader_election.cc:304] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:39.440965  8367 raft_consensus.cc:3060] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.441633  8378 leader_election.cc:290] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:39.387089  8190 raft_consensus.cc:359] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.449034  8190 raft_consensus.cc:385] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.449425  8190 raft_consensus.cc:740] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.449457  8367 raft_consensus.cc:2749] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.450453  8190 consensus_queue.cc:260] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.452889  8190 ts_tablet_manager.cc:1434] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.000s
I20260709 13:02:39.453197  8189 raft_consensus.cc:385] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.454973  8189 raft_consensus.cc:740] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.456182  8189 consensus_queue.cc:260] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.453351  8497 raft_consensus.cc:493] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.457245  8497 raft_consensus.cc:515] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.460115  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.460813  7920 raft_consensus.cc:2468] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:39.463140  8037 leader_election.cc:304] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:39.463799  8354 raft_consensus.cc:2804] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.464164  8354 raft_consensus.cc:493] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.464488  8354 raft_consensus.cc:3060] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.472483  8434 raft_consensus.cc:493] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.473019  8434 raft_consensus.cc:515] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.475134  8434 leader_election.cc:290] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.475771  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b266a15c0d446148dc910d00fe07d0f" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.476372  7920 raft_consensus.cc:2468] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:39.478664  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b266a15c0d446148dc910d00fe07d0f" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:39.479880  8037 leader_election.cc:304] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
W20260709 13:02:39.480917  8040 leader_election.cc:343] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.481112  8434 raft_consensus.cc:2804] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.481686  8434 raft_consensus.cc:493] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.482081  8434 raft_consensus.cc:3060] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.489514  8354 raft_consensus.cc:515] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.492063  8497 leader_election.cc:290] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.492949  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:39.494191  8040 leader_election.cc:343] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.494426  8434 raft_consensus.cc:515] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.497789  8434 leader_election.cc:290] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.497931  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b266a15c0d446148dc910d00fe07d0f" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:39.498657  7920 raft_consensus.cc:3060] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.507771  8434 raft_consensus.cc:493] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.508543  8434 raft_consensus.cc:515] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.454209  8316 raft_consensus.cc:515] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.511760  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:39.512497  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:39.513018  8316 leader_election.cc:290] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:39.513361  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a51a0a61adf4ce19d7ce6f958f2451b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:39.513497  8146 raft_consensus.cc:2468] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:39.513965  8000 raft_consensus.cc:3060] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.515144  8189 ts_tablet_manager.cc:1434] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.170s	user 0.002s	sys 0.004s
I20260709 13:02:39.516096  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a51a0a61adf4ce19d7ce6f958f2451b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:39.516105  8037 leader_election.cc:304] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
W20260709 13:02:39.517612  8111 leader_election.cc:343] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:39.519702  8040 leader_election.cc:343] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.522028  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b266a15c0d446148dc910d00fe07d0f" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:39.527490  8498 raft_consensus.cc:2804] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.527904  8498 raft_consensus.cc:493] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.528229  8498 raft_consensus.cc:3060] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:39.536224  8040 leader_election.cc:343] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.537482  8498 raft_consensus.cc:515] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.540251  8192 tablet_bootstrap.cc:492] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:39.540788  8192 ts_tablet_manager.cc:1403] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.188s	user 0.052s	sys 0.064s
I20260709 13:02:39.540894  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
W20260709 13:02:39.542507  8040 leader_election.cc:343] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.543685  8354 leader_election.cc:290] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.544806  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:39.545380  8146 raft_consensus.cc:3060] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.546887  8190 tablet_bootstrap.cc:492] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:39.549830  8513 raft_consensus.cc:493] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.550421  8513 raft_consensus.cc:515] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.550943  8189 tablet_bootstrap.cc:492] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:39.551302  7920 raft_consensus.cc:2468] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:39.552513  8513 leader_election.cc:290] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.552930  8000 raft_consensus.cc:2468] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:39.554409  8114 leader_election.cc:304] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:39.556085  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:39.556453  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:39.556142  8378 raft_consensus.cc:2804] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.520797  8434 leader_election.cc:290] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:39.521695  8300 consensus_queue.cc:1048] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.557631  8378 raft_consensus.cc:697] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:39.558490  8378 consensus_queue.cc:237] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:39.561163  7891 leader_election.cc:343] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:39.563438  7888 leader_election.cc:343] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.563293  8192 raft_consensus.cc:359] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.563928  7888 leader_election.cc:304] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:39.564086  8192 raft_consensus.cc:385] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.564397  8192 raft_consensus.cc:740] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.564611  8513 raft_consensus.cc:2749] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.565101  8192 consensus_queue.cc:260] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.565817  8194 tablet_bootstrap.cc:492] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:39.566360  8194 ts_tablet_manager.cc:1403] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.253s	user 0.035s	sys 0.042s
I20260709 13:02:39.567391  8192 ts_tablet_manager.cc:1434] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:02:39.568347  8192 tablet_bootstrap.cc:492] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:39.569290  8189 tablet_bootstrap.cc:654] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.574987  8190 tablet_bootstrap.cc:654] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.577028  7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:39.577703  7919 raft_consensus.cc:3060] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.581773  8192 tablet_bootstrap.cc:654] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.583879  8037 leader_election.cc:304] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:39.584653  8434 raft_consensus.cc:2804] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.585151  8434 raft_consensus.cc:697] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:39.585989  8434 consensus_queue.cc:237] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.591045  8300 consensus_queue.cc:1048] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.577742  8194 raft_consensus.cc:359] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.601030  8194 raft_consensus.cc:385] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.601578  8194 raft_consensus.cc:740] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.602780  8194 consensus_queue.cc:260] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.603869  8146 raft_consensus.cc:2468] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:39.608129  8037 leader_election.cc:304] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:39.608246  8354 consensus_queue.cc:1048] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.611495  8194 ts_tablet_manager.cc:1434] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.001s
I20260709 13:02:39.613920  8194 tablet_bootstrap.cc:492] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:39.615309  8517 raft_consensus.cc:493] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.616756  8517 raft_consensus.cc:515] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.621122  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9da43a750ef48788d4da9f817f17b3c" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:39.621969  8000 raft_consensus.cc:2468] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 0.
I20260709 13:02:39.623728  7891 leader_election.cc:304] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:39.624941  8300 raft_consensus.cc:2804] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.625430  8300 raft_consensus.cc:493] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.625834  8300 raft_consensus.cc:3060] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.628831  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9da43a750ef48788d4da9f817f17b3c" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:39.634472  7888 leader_election.cc:343] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.643392  8517 leader_election.cc:290] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.646982  8300 raft_consensus.cc:515] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.649978  8434 raft_consensus.cc:2804] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.656113  8434 raft_consensus.cc:697] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:39.656984  8434 consensus_queue.cc:237] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.660187  7823 catalog_manager.cc:5697] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.661584  7919 raft_consensus.cc:2468] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:39.664121  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9da43a750ef48788d4da9f817f17b3c" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:39.703727  8000 raft_consensus.cc:3060] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.665601  8300 leader_election.cc:290] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.670821  8194 tablet_bootstrap.cc:654] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.709592  8037 leader_election.cc:304] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:39.710757  8434 raft_consensus.cc:2804] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.711474  8434 raft_consensus.cc:697] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:39.712499  8434 consensus_queue.cc:237] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.673530  8517 raft_consensus.cc:493] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.681488  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:39.690862  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9da43a750ef48788d4da9f817f17b3c" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:39.693197  8498 leader_election.cc:290] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:39.723291  8354 consensus_queue.cc:1048] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:02:39.740945  8192 tablet_bootstrap.cc:492] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:39.746475  8192 ts_tablet_manager.cc:1403] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.178s	user 0.023s	sys 0.028s
W20260709 13:02:39.748906  7888 leader_election.cc:343] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.726130  8517 raft_consensus.cc:515] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:39.783550  8000 raft_consensus.cc:2468] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 1.
I20260709 13:02:39.785765  8190 tablet_bootstrap.cc:492] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:39.786300  8190 ts_tablet_manager.cc:1403] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.240s	user 0.067s	sys 0.053s
I20260709 13:02:39.789512  8194 tablet_bootstrap.cc:492] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:39.790046  8194 ts_tablet_manager.cc:1403] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.176s	user 0.016s	sys 0.006s
I20260709 13:02:39.789726  7823 catalog_manager.cc:5697] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.792346  8202 consensus_queue.cc:1048] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.793916  8192 raft_consensus.cc:359] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.794461  8192 raft_consensus.cc:385] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.794698  8192 raft_consensus.cc:740] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.800227  7819 catalog_manager.cc:5697] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.795276  8192 consensus_queue.cc:260] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.804406  8190 raft_consensus.cc:359] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.805213  8190 raft_consensus.cc:385] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.805637  8190 raft_consensus.cc:740] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.805259  8189 tablet_bootstrap.cc:492] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:39.806926  8189 ts_tablet_manager.cc:1403] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.282s	user 0.048s	sys 0.048s
I20260709 13:02:39.806439  8190 consensus_queue.cc:260] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:39.814708  8194 raft_consensus.cc:359] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.819445  8194 raft_consensus.cc:385] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.819757  8194 raft_consensus.cc:740] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.820353  8194 consensus_queue.cc:260] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.815438  8192 ts_tablet_manager.cc:1434] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:02:39.821679  8192 tablet_bootstrap.cc:492] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:39.831967  8190 ts_tablet_manager.cc:1434] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:02:39.832979  8190 tablet_bootstrap.cc:492] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:39.807756  7891 leader_election.cc:304] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:39.836194  8194 ts_tablet_manager.cc:1434] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 13:02:39.836972  8194 tablet_bootstrap.cc:492] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
W20260709 13:02:39.809319  8040 leader_election.cc:343] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.816488  8517 leader_election.cc:290] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
W20260709 13:02:39.842638  7870 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:39.849195  8513 raft_consensus.cc:2804] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.853224  8559 consensus_queue.cc:1048] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.853595  8202 consensus_queue.cc:1048] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.839813  8378 consensus_queue.cc:1048] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:02:39.864701  8202 raft_consensus.cc:493] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.849730  8513 raft_consensus.cc:697] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:39.865288  8202 raft_consensus.cc:515] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.873903  8190 tablet_bootstrap.cc:654] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.881163  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:39.887341  8202 leader_election.cc:290] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:39.896451  8192 tablet_bootstrap.cc:654] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.897451  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
W20260709 13:02:39.899386  7888 leader_election.cc:343] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.881465  8513 consensus_queue.cc:237] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.904122  8367 consensus_queue.cc:1048] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.905722  8423 consensus_queue.cc:1048] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.906356  8367 raft_consensus.cc:493] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.906983  8367 raft_consensus.cc:515] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:39.914961  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:39.924309  8423 raft_consensus.cc:493] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.933903  8423 raft_consensus.cc:515] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:39.936175  8423 leader_election.cc:290] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:39.936515  8072 raft_consensus.cc:3060] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.938558  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c51858bb34dbda6f73fc33e498bca" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:39.940091  8194 tablet_bootstrap.cc:654] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.946523  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c51858bb34dbda6f73fc33e498bca" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
W20260709 13:02:39.950845  8111 leader_election.cc:343] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.957470  8367 leader_election.cc:290] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:39.969115  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9da43a750ef48788d4da9f817f17b3c" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:39.968984  8423 consensus_queue.cc:1048] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.983414  8037 leader_election.cc:304] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:39.985096  8354 raft_consensus.cc:2749] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.985901  8354 consensus_queue.cc:1048] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:40.001709  8564 log.cc:927] Time spent T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:02:39.998591  8423 consensus_queue.cc:1048] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:02:40.007611  8189 raft_consensus.cc:359] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.010620  8189 raft_consensus.cc:385] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.011420  8189 raft_consensus.cc:740] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.014021  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9da43a750ef48788d4da9f817f17b3c" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:40.024689  7999 raft_consensus.cc:2393] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87b2df8987cd4ac0b02b0632752c3a24 in current term 1: Already voted for candidate 77c8a837918d478fb10b627dfdbf90e4 in this term.
I20260709 13:02:40.036551  8194 tablet_bootstrap.cc:492] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:40.037153  8194 ts_tablet_manager.cc:1403] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.200s	user 0.033s	sys 0.024s
I20260709 13:02:40.052014  8189 consensus_queue.cc:260] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.058493  8189 ts_tablet_manager.cc:1434] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.251s	user 0.008s	sys 0.003s
I20260709 13:02:40.073969  8194 raft_consensus.cc:359] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.074954  8194 raft_consensus.cc:385] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.075320  8194 raft_consensus.cc:740] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.075443  8190 tablet_bootstrap.cc:492] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:40.075960  8190 ts_tablet_manager.cc:1403] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.243s	user 0.031s	sys 0.003s
I20260709 13:02:40.077059  8114 leader_election.cc:304] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:40.078352  8559 raft_consensus.cc:3060] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.087387  8189 tablet_bootstrap.cc:492] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:40.088819  8190 raft_consensus.cc:359] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.089512  8190 raft_consensus.cc:385] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.089767  8190 raft_consensus.cc:740] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.093122  8190 consensus_queue.cc:260] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.096968  8190 ts_tablet_manager.cc:1434] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:02:40.076066  8194 consensus_queue.cc:260] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.097906  8190 tablet_bootstrap.cc:492] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:40.099409  8194 ts_tablet_manager.cc:1434] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 13:02:40.100322  8194 tablet_bootstrap.cc:492] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:40.100641  7921 raft_consensus.cc:2468] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:40.101817  8111 leader_election.cc:304] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:40.103238  8316 raft_consensus.cc:2804] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.103585  8316 raft_consensus.cc:493] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.103924  8316 raft_consensus.cc:3060] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.103941  8190 tablet_bootstrap.cc:654] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.097937  7819 catalog_manager.cc:5697] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:40.100822  8565 log.cc:927] Time spent T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:02:40.130925  8037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 65426.3us
I20260709 13:02:40.131335  8192 tablet_bootstrap.cc:492] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:40.134227  8192 ts_tablet_manager.cc:1403] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.313s	user 0.022s	sys 0.005s
I20260709 13:02:40.142843  8202 raft_consensus.cc:493] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.143424  8202 raft_consensus.cc:515] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.145320  8202 leader_election.cc:290] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:40.149631  8475 raft_consensus.cc:493] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.150172  8475 raft_consensus.cc:515] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.126821  8367 raft_consensus.cc:493] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.160871  8559 raft_consensus.cc:2749] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.162598  8189 tablet_bootstrap.cc:654] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.163972  8475 leader_election.cc:290] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:40.165927  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:40.169803  8192 raft_consensus.cc:359] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.170521  8192 raft_consensus.cc:385] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.170792  8192 raft_consensus.cc:740] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.171373  8192 consensus_queue.cc:260] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.171741  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:40.172533  8147 raft_consensus.cc:2393] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
W20260709 13:02:40.173271  7891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36125, user_credentials={real_user=slave}} blocked reactor thread for 370108us
I20260709 13:02:40.179183  8071 raft_consensus.cc:3060] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.156349  8367 raft_consensus.cc:515] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.205035  8367 leader_election.cc:290] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:40.209528  8316 raft_consensus.cc:515] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.211629  8316 leader_election.cc:290] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:40.213827  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c51858bb34dbda6f73fc33e498bca" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:40.214497  7920 raft_consensus.cc:3060] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.216663  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c51858bb34dbda6f73fc33e498bca" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:40.217382  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5968d0a9e5b4f10b650229017d01068" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:40.219558  8192 ts_tablet_manager.cc:1434] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.002s
I20260709 13:02:40.220592  8192 tablet_bootstrap.cc:492] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:40.223912  8194 tablet_bootstrap.cc:654] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.226872  7920 raft_consensus.cc:2468] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
W20260709 13:02:40.231823  8111 leader_election.cc:343] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:40.234969  8111 leader_election.cc:343] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:40.238457  8040 consensus_peers.cc:597] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.239895  8190 tablet_bootstrap.cc:492] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:40.240401  8190 ts_tablet_manager.cc:1403] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.143s	user 0.024s	sys 0.014s
W20260709 13:02:40.244185  7963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 64461.4us
I20260709 13:02:40.244922  8111 leader_election.cc:304] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:40.247745  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:40.240306  8378 consensus_queue.cc:1048] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:02:40.250336  7963 leader_election.cc:304] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
W20260709 13:02:40.254283  7891 leader_election.cc:343] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.254804  7891 leader_election.cc:304] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:40.255561  8300 raft_consensus.cc:2749] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.256361  8192 tablet_bootstrap.cc:654] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.256843  8415 raft_consensus.cc:3060] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.260408  8189 tablet_bootstrap.cc:492] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:40.260910  8189 ts_tablet_manager.cc:1403] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.174s	user 0.009s	sys 0.005s
I20260709 13:02:40.265395  8189 raft_consensus.cc:359] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.267236  8189 raft_consensus.cc:385] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.267510  8189 raft_consensus.cc:740] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.267964  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a51a0a61adf4ce19d7ce6f958f2451b" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:40.268844  7996 raft_consensus.cc:2393] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc7af07a29d1443b8a3c4a3770d52344 in current term 1: Already voted for candidate 87b2df8987cd4ac0b02b0632752c3a24 in this term.
I20260709 13:02:40.261992  8367 raft_consensus.cc:2804] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.271006  8367 raft_consensus.cc:697] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:40.271864  8367 consensus_queue.cc:237] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.273758  8189 consensus_queue.cc:260] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.279126  8415 raft_consensus.cc:2749] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.273828  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a51a0a61adf4ce19d7ce6f958f2451b" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:40.293527  8111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 48701.2us
I20260709 13:02:40.294848  8189 ts_tablet_manager.cc:1434] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:02:40.296072  8189 tablet_bootstrap.cc:492] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:40.299568  8190 raft_consensus.cc:359] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.300540  8190 raft_consensus.cc:385] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.300899  8190 raft_consensus.cc:740] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.301714  8190 consensus_queue.cc:260] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.312994  8194 tablet_bootstrap.cc:492] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:40.313557  8194 ts_tablet_manager.cc:1403] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.213s	user 0.010s	sys 0.006s
I20260709 13:02:40.317221  8190 ts_tablet_manager.cc:1434] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.001s
I20260709 13:02:40.318291  8190 tablet_bootstrap.cc:492] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:40.319341  8577 consensus_queue.cc:1048] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:40.324400  8190 tablet_bootstrap.cc:654] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.326046  8415 raft_consensus.cc:493] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.326794  8415 raft_consensus.cc:515] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.330374  8415 leader_election.cc:290] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:40.331055  8194 raft_consensus.cc:359] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.331700  8194 raft_consensus.cc:385] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.332036  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6cabe1c12e4d4293ddb5333b2562d8" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:40.332710  7920 raft_consensus.cc:2468] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:40.332052  8194 raft_consensus.cc:740] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.334714  8194 consensus_queue.cc:260] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.336333  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5968d0a9e5b4f10b650229017d01068" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:40.337229  8513 consensus_queue.cc:1048] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.339550  7963 leader_election.cc:304] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:40.340517  8475 raft_consensus.cc:2804] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.340900  8475 raft_consensus.cc:493] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.341238  8475 raft_consensus.cc:3060] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.341681  8194 ts_tablet_manager.cc:1434] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:02:40.343611  8194 tablet_bootstrap.cc:492] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:40.344331  8192 tablet_bootstrap.cc:492] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:40.344849  8192 ts_tablet_manager.cc:1403] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.007s
I20260709 13:02:40.347028  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6cabe1c12e4d4293ddb5333b2562d8" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:40.348186  8192 raft_consensus.cc:359] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.348866  8192 raft_consensus.cc:385] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.349103  8192 raft_consensus.cc:740] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
W20260709 13:02:40.348209  7963 leader_election.cc:343] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.357089  8189 tablet_bootstrap.cc:654] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.359131  8584 raft_consensus.cc:493] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.359859  8584 raft_consensus.cc:515] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.361025  8037 leader_election.cc:304] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:40.355733  8192 consensus_queue.cc:260] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.372969  8513 consensus_queue.cc:1048] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.374123  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc94f423a414af7b77b41c61009a3a7" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:40.375011  8194 tablet_bootstrap.cc:654] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.375660  8496 raft_consensus.cc:2749] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.377880  8497 raft_consensus.cc:493] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.380105  8000 raft_consensus.cc:3060] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.378435  8497 raft_consensus.cc:515] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.368595  8584 leader_election.cc:290] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:40.387174  8354 consensus_queue.cc:1048] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.388125  8192 ts_tablet_manager.cc:1434] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.005s
I20260709 13:02:40.390025  8192 tablet_bootstrap.cc:492] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
W20260709 13:02:40.392859  8111 leader_election.cc:343] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.397753  7819 catalog_manager.cc:5697] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.405761  8417 raft_consensus.cc:493] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.406275  8417 raft_consensus.cc:515] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.412683  8475 raft_consensus.cc:515] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.447233  7823 catalog_manager.cc:5697] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.430635  8354 consensus_queue.cc:1048] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
W20260709 13:02:40.458354  8114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36125, user_credentials={real_user=slave}} blocked reactor thread for 55487.7us
W20260709 13:02:40.484623  8114 leader_election.cc:343] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.484907  8378 consensus_queue.cc:1048] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.470163  8475 leader_election.cc:290] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:40.474305  8417 leader_election.cc:290] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:40.477056  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ad60198ae44613945d4f009def4097" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:40.489472  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6cabe1c12e4d4293ddb5333b2562d8" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:40.478787  8194 tablet_bootstrap.cc:492] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:40.490036  7925 raft_consensus.cc:3060] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.490280  8194 ts_tablet_manager.cc:1403] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.147s	user 0.020s	sys 0.013s
I20260709 13:02:40.464540  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ad60198ae44613945d4f009def4097" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:40.482879  8192 tablet_bootstrap.cc:654] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.485096  8114 leader_election.cc:304] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:40.469719  8497 leader_election.cc:290] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:40.491611  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6cabe1c12e4d4293ddb5333b2562d8" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:40.505929  8561 raft_consensus.cc:493] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.497749  7925 raft_consensus.cc:2468] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:40.506444  8561 raft_consensus.cc:515] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.509568  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
W20260709 13:02:40.509930  8040 leader_election.cc:343] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.510499  7922 raft_consensus.cc:2468] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:40.510785  8561 leader_election.cc:290] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:40.513237  8037 leader_election.cc:304] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:40.514259  8354 raft_consensus.cc:2804] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.514604  8354 raft_consensus.cc:493] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.506974  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:40.515075  8592 raft_consensus.cc:2749] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.515172  8354 raft_consensus.cc:3060] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.515434  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d3c0e1e8574b868e633347d9be591b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:40.516909  8189 tablet_bootstrap.cc:492] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: No bootstrap required, opened a new log
I20260709 13:02:40.517414  8189 ts_tablet_manager.cc:1403] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.222s	user 0.025s	sys 0.020s
W20260709 13:02:40.518087  7888 leader_election.cc:343] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.514516  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d3c0e1e8574b868e633347d9be591b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:40.519495  7888 leader_election.cc:343] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.519872  7888 leader_election.cc:304] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:40.520246  8189 raft_consensus.cc:359] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.520903  8561 raft_consensus.cc:2749] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.520926  8189 raft_consensus.cc:385] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.522078  8189 raft_consensus.cc:740] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.523041  8189 consensus_queue.cc:260] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.534384  7963 leader_election.cc:304] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:40.539815  8189 ts_tablet_manager.cc:1434] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:02:40.544296  8354 raft_consensus.cc:515] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.548445  8202 consensus_queue.cc:1048] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.551748  7963 leader_election.cc:304] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
W20260709 13:02:40.552700  7963 leader_election.cc:343] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.556829  8194 raft_consensus.cc:359] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.557507  8194 raft_consensus.cc:385] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.557747  8194 raft_consensus.cc:740] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.553817  8415 raft_consensus.cc:2804] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.558316  8194 consensus_queue.cc:260] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.559391  8415 raft_consensus.cc:697] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:40.546593  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ad60198ae44613945d4f009def4097" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:40.567746  8202 raft_consensus.cc:493] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.567670  8194 ts_tablet_manager.cc:1434] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:02:40.569093  8194 tablet_bootstrap.cc:492] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:40.568397  8202 raft_consensus.cc:515] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.572083  8202 leader_election.cc:290] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:40.573144  8475 raft_consensus.cc:2749] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:40.585049  8190 tablet_bootstrap.cc:492] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:40.585567  8190 ts_tablet_manager.cc:1403] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.267s	user 0.016s	sys 0.016s
I20260709 13:02:40.574092  7924 raft_consensus.cc:3060] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.595898  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc94f423a414af7b77b41c61009a3a7" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:40.576681  8354 leader_election.cc:290] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:40.592360  7997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ad60198ae44613945d4f009def4097" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:40.592546  8415 consensus_queue.cc:237] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.593904  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:40.598253  7922 raft_consensus.cc:2468] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:40.601646  8037 leader_election.cc:304] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:40.602274  8202 raft_consensus.cc:2804] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.602578  8202 raft_consensus.cc:493] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.602977  8202 raft_consensus.cc:3060] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:40.604995  8040 leader_election.cc:343] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.617316  7924 raft_consensus.cc:2468] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:40.619176  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:40.620227  8190 raft_consensus.cc:359] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.631829  8190 raft_consensus.cc:385] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.632164  8192 tablet_bootstrap.cc:492] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:40.632176  8190 raft_consensus.cc:740] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.632993  8192 ts_tablet_manager.cc:1403] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.244s	user 0.010s	sys 0.021s
I20260709 13:02:40.633246  8190 consensus_queue.cc:260] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.632095  8202 raft_consensus.cc:515] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.629047  8194 tablet_bootstrap.cc:654] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:40.629475  8114 leader_election.cc:343] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.638089  8114 leader_election.cc:304] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:40.640878  8202 leader_election.cc:290] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:40.642553  8037 leader_election.cc:304] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:40.644017  8497 raft_consensus.cc:2804] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.644547  8497 raft_consensus.cc:697] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:40.645323  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:40.645975  7924 raft_consensus.cc:3060] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.645830  8192 raft_consensus.cc:359] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.646976  8190 ts_tablet_manager.cc:1434] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:02:40.645349  8497 consensus_queue.cc:237] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:40.648111  8378 raft_consensus.cc:2749] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.648046  8190 tablet_bootstrap.cc:492] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
W20260709 13:02:40.654440  8037 leader_election.cc:343] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.659926  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
W20260709 13:02:40.666465  8037 leader_election.cc:343] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.646623  8192 raft_consensus.cc:385] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.678650  8192 raft_consensus.cc:740] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.679574  8192 consensus_queue.cc:260] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.683825  8192 ts_tablet_manager.cc:1434] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:02:40.685364  8192 tablet_bootstrap.cc:492] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:40.696949  8192 tablet_bootstrap.cc:654] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.725484  8378 raft_consensus.cc:493] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.734556  8378 raft_consensus.cc:515] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.736601  8378 leader_election.cc:290] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:40.741096  7924 raft_consensus.cc:2468] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:40.746796  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:40.747769  7922 raft_consensus.cc:2468] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:40.750296  8037 leader_election.cc:304] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:40.752314  7822 catalog_manager.cc:5697] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.753675  8354 raft_consensus.cc:2804] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.754341  8354 raft_consensus.cc:697] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:40.754580  8190 tablet_bootstrap.cc:654] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.755360  8354 consensus_queue.cc:237] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.761474  8194 tablet_bootstrap.cc:492] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:40.763583  8194 ts_tablet_manager.cc:1403] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.195s	user 0.016s	sys 0.015s
I20260709 13:02:40.765653  8111 leader_election.cc:304] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:40.766716  8592 raft_consensus.cc:2804] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.766484  8194 raft_consensus.cc:359] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.767135  8592 raft_consensus.cc:493] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.767273  8194 raft_consensus.cc:385] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.767529  8592 raft_consensus.cc:3060] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.767578  8194 raft_consensus.cc:740] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.768386  8194 consensus_queue.cc:260] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.770463  8194 ts_tablet_manager.cc:1434] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
W20260709 13:02:40.773381  8111 consensus_peers.cc:597] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.777302  8194 tablet_bootstrap.cc:492] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:40.779976  8592 raft_consensus.cc:515] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.745301  7995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:40.783565  8114 leader_election.cc:343] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.784922  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
W20260709 13:02:40.786742  8114 leader_election.cc:343] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.788523  8194 tablet_bootstrap.cc:654] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.788646  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:40.789463  7922 raft_consensus.cc:3060] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.765591  8192 tablet_bootstrap.cc:492] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:40.802326  8192 ts_tablet_manager.cc:1403] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.014s
I20260709 13:02:40.804627  8592 leader_election.cc:290] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:40.807449  8192 raft_consensus.cc:359] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.808475  8192 raft_consensus.cc:385] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.808815  8192 raft_consensus.cc:740] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.866911  7823 catalog_manager.cc:5697] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.892292  8190 tablet_bootstrap.cc:492] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:40.893446  8190 ts_tablet_manager.cc:1403] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.246s	user 0.032s	sys 0.012s
I20260709 13:02:40.899382  8190 raft_consensus.cc:359] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.900382  8190 raft_consensus.cc:385] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.900743  8190 raft_consensus.cc:740] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.901546  8190 consensus_queue.cc:260] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:40.907223  8190 ts_tablet_manager.cc:1434] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.012s
I20260709 13:02:40.876569  8598 raft_consensus.cc:493] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.911142  8190 tablet_bootstrap.cc:492] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:40.922298  8192 consensus_queue.cc:260] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:40.925117  8192 ts_tablet_manager.cc:1434] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.000s
I20260709 13:02:40.943104  7922 raft_consensus.cc:2468] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:40.946174  8192 tablet_bootstrap.cc:492] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:40.910360  8598 raft_consensus.cc:515] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:40.962257  8598 leader_election.cc:290] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:40.988145  8194 tablet_bootstrap.cc:492] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:40.989176  8194 ts_tablet_manager.cc:1403] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.212s	user 0.016s	sys 0.011s
I20260709 13:02:40.994531  8111 leader_election.cc:304] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:40.996599  7995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767b01527e0d42ab9f574cee3fbbeaf9" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:40.999835  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767b01527e0d42ab9f574cee3fbbeaf9" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:41.003684  7891 leader_election.cc:343] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.012758  8592 raft_consensus.cc:2804] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.013473  8592 raft_consensus.cc:697] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:41.017627  7823 catalog_manager.cc:5697] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.019825  8592 consensus_queue.cc:237] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:41.023295  8192 tablet_bootstrap.cc:654] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.030835  8190 tablet_bootstrap.cc:654] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:41.051108  8111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 57070.9us
I20260709 13:02:41.055780  7995 raft_consensus.cc:3060] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.085820  8194 raft_consensus.cc:359] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:41.086795  8194 raft_consensus.cc:385] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.087109  8194 raft_consensus.cc:740] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.087882  8194 consensus_queue.cc:260] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
W20260709 13:02:41.093104  8040 consensus_peers.cc:597] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:41.100778  7888 leader_election.cc:343] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.102499  8595 raft_consensus.cc:493] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.103077  8595 raft_consensus.cc:515] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.101410  7888 leader_election.cc:304] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:41.109417  8592 consensus_queue.cc:1048] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.109272  8598 raft_consensus.cc:2749] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.117835  8595 leader_election.cc:290] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:41.129078  8190 tablet_bootstrap.cc:492] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:41.129678  8190 ts_tablet_manager.cc:1403] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.219s	user 0.012s	sys 0.008s
I20260709 13:02:41.141443  8192 tablet_bootstrap.cc:492] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:41.142045  8192 ts_tablet_manager.cc:1403] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.196s	user 0.011s	sys 0.005s
I20260709 13:02:41.143128  8190 raft_consensus.cc:359] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.143935  8190 raft_consensus.cc:385] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.144224  8190 raft_consensus.cc:740] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
W20260709 13:02:41.147012  7870 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:41.150844  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5968d0a9e5b4f10b650229017d01068" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:41.151525  7823 catalog_manager.cc:5697] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.153707  8190 consensus_queue.cc:260] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
W20260709 13:02:41.154245  7963 leader_election.cc:343] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.157933  8190 ts_tablet_manager.cc:1434] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:02:41.157994  8584 raft_consensus.cc:493] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.158586  8584 raft_consensus.cc:515] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:41.164535  8194 ts_tablet_manager.cc:1434] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.175s	user 0.007s	sys 0.006s
I20260709 13:02:41.165910  8194 tablet_bootstrap.cc:492] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:41.167505  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5968d0a9e5b4f10b650229017d01068" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:41.169539  8146 raft_consensus.cc:2468] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 0.
I20260709 13:02:41.170069  8584 leader_election.cc:290] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:41.170881  8434 raft_consensus.cc:493] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.173532  8434 raft_consensus.cc:515] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.174309  7963 leader_election.cc:304] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:41.178841  8595 raft_consensus.cc:2804] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.179291  8595 raft_consensus.cc:493] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.179584  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6cabe1c12e4d4293ddb5333b2562d8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:41.179881  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f6cabe1c12e4d4293ddb5333b2562d8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:41.180584  7925 raft_consensus.cc:2393] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87b2df8987cd4ac0b02b0632752c3a24 in current term 1: Already voted for candidate 17a4c4b3539b43108ef3481121d982bd in this term.
I20260709 13:02:41.180984  8190 tablet_bootstrap.cc:492] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:41.170543  8192 raft_consensus.cc:359] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.181671  8192 raft_consensus.cc:385] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.181998  8192 raft_consensus.cc:740] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.183252  8192 consensus_queue.cc:260] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.179694  8595 raft_consensus.cc:3060] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.187645  8475 raft_consensus.cc:493] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc7af07a29d1443b8a3c4a3770d52344)
I20260709 13:02:41.191210  8475 raft_consensus.cc:515] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.196547  8114 leader_election.cc:304] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:41.198522  8592 raft_consensus.cc:3060] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.202699  8415 consensus_queue.cc:1048] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.203235  8475 leader_election.cc:290] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:41.204634  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b266a15c0d446148dc910d00fe07d0f" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:41.205392  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b266a15c0d446148dc910d00fe07d0f" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:41.215581  7963 leader_election.cc:304] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:41.216248  8148 raft_consensus.cc:3060] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.216789  8415 raft_consensus.cc:2749] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:41.226228  7995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc94f423a414af7b77b41c61009a3a7" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:41.239214  8071 raft_consensus.cc:3060] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.239537  8496 consensus_queue.cc:1048] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.241624  8592 raft_consensus.cc:2749] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:41.234915  8040 leader_election.cc:343] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.248529  8415 consensus_queue.cc:1048] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.251224  8496 consensus_queue.cc:1048] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.252859  8192 ts_tablet_manager.cc:1434] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.110s	user 0.011s	sys 0.000s
I20260709 13:02:41.254076  8192 tablet_bootstrap.cc:492] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:41.254122  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc94f423a414af7b77b41c61009a3a7" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:41.255789  8148 raft_consensus.cc:2468] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:41.242440  8434 leader_election.cc:290] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:41.258411  8190 tablet_bootstrap.cc:654] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.274140  8037 leader_election.cc:304] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:41.275267  8434 raft_consensus.cc:2804] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.275637  8434 raft_consensus.cc:493] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.276016  8434 raft_consensus.cc:3060] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.289665  8194 tablet_bootstrap.cc:654] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.312606  8595 raft_consensus.cc:515] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.330339  8595 leader_election.cc:290] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:41.331301  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5968d0a9e5b4f10b650229017d01068" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:41.312815  8434 raft_consensus.cc:515] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:41.333305  7963 leader_election.cc:343] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.335180  8434 leader_election.cc:290] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:41.335444  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc94f423a414af7b77b41c61009a3a7" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:41.336302  8148 raft_consensus.cc:3060] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.341482  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5968d0a9e5b4f10b650229017d01068" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:41.342144  8147 raft_consensus.cc:3060] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.350955  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc94f423a414af7b77b41c61009a3a7" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
W20260709 13:02:41.352556  8040 leader_election.cc:343] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.359565  8434 consensus_queue.cc:1048] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.360744  8147 raft_consensus.cc:2468] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:41.368614  7963 leader_election.cc:304] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:41.370626  8475 raft_consensus.cc:2804] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.371325  8475 raft_consensus.cc:697] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:41.375082  8192 tablet_bootstrap.cc:654] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.372305  8475 consensus_queue.cc:237] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.382752  8190 tablet_bootstrap.cc:492] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:41.383260  8190 ts_tablet_manager.cc:1403] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.203s	user 0.008s	sys 0.013s
I20260709 13:02:41.388285  8148 raft_consensus.cc:2468] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:41.389513  8037 leader_election.cc:304] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:41.390384  8354 raft_consensus.cc:2804] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.390950  8354 raft_consensus.cc:697] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:41.391923  8354 consensus_queue.cc:237] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.386409  8190 raft_consensus.cc:359] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.395972  8190 raft_consensus.cc:385] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.396277  8190 raft_consensus.cc:740] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.398031  8190 consensus_queue.cc:260] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.450150  8190 ts_tablet_manager.cc:1434] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.001s
I20260709 13:02:41.451326  8190 tablet_bootstrap.cc:492] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:41.462772  8498 raft_consensus.cc:493] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.463380  8498 raft_consensus.cc:515] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.465744  8498 leader_election.cc:290] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:41.466096  8192 tablet_bootstrap.cc:492] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:41.466630  8192 ts_tablet_manager.cc:1403] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.213s	user 0.012s	sys 0.004s
I20260709 13:02:41.469439  8192 raft_consensus.cc:359] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.470122  8192 raft_consensus.cc:385] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.470386  8192 raft_consensus.cc:740] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.476146  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:41.479317  8192 consensus_queue.cc:260] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.487709  8475 raft_consensus.cc:493] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.488504  8475 raft_consensus.cc:515] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:41.482462  8040 leader_election.cc:343] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.490716  8475 leader_election.cc:290] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:41.488484  8192 ts_tablet_manager.cc:1434] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
W20260709 13:02:41.492702  8114 consensus_peers.cc:597] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:41.495697  8192 tablet_bootstrap.cc:492] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344: Bootstrap starting.
I20260709 13:02:41.496178  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc94f423a414af7b77b41c61009a3a7" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:41.497182  8148 raft_consensus.cc:2393] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:41.497378  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc94f423a414af7b77b41c61009a3a7" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:41.502435  8595 raft_consensus.cc:493] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.503000  8595 raft_consensus.cc:515] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.505216  8595 leader_election.cc:290] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:41.516621  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ad60198ae44613945d4f009def4097" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:41.523262  7963 leader_election.cc:304] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:41.524076  8417 raft_consensus.cc:3060] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.526651  8194 tablet_bootstrap.cc:492] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:41.526895  7917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:41.527316  8194 ts_tablet_manager.cc:1403] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.362s	user 0.028s	sys 0.014s
I20260709 13:02:41.527774  7917 raft_consensus.cc:2468] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:41.528080  7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ad60198ae44613945d4f009def4097" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:41.530476  8194 raft_consensus.cc:359] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:41.532081  8194 raft_consensus.cc:385] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.532465  8194 raft_consensus.cc:740] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.531572  7963 leader_election.cc:304] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:41.535893  8595 raft_consensus.cc:2749] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.532483  8417 raft_consensus.cc:2749] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.540544  8194 consensus_queue.cc:260] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:41.542467  8194 ts_tablet_manager.cc:1434] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:02:41.543002  8037 leader_election.cc:304] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:41.543946  8634 raft_consensus.cc:2804] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.544440  8634 raft_consensus.cc:493] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.544893  8634 raft_consensus.cc:3060] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.552510  8634 raft_consensus.cc:515] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.554611  8634 leader_election.cc:290] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:41.555681  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
W20260709 13:02:41.560240  8040 leader_election.cc:343] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.560328  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:41.560973  7922 raft_consensus.cc:3060] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.570330  8192 tablet_bootstrap.cc:654] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.575433  7922 raft_consensus.cc:2468] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:41.574761  8194 tablet_bootstrap.cc:492] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24: Bootstrap starting.
I20260709 13:02:41.580269  8037 leader_election.cc:304] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:41.582190  8354 raft_consensus.cc:2804] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.582757  8354 raft_consensus.cc:697] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:41.583633  8354 consensus_queue.cc:237] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.584781  8194 tablet_bootstrap.cc:654] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.612401  8190 tablet_bootstrap.cc:654] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.619906  7823 catalog_manager.cc:5697] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.675463  8190 tablet_bootstrap.cc:492] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:41.676100  8190 ts_tablet_manager.cc:1403] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.225s	user 0.018s	sys 0.007s
I20260709 13:02:41.666744  8581 consensus_queue.cc:1048] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:02:41.680611  8190 raft_consensus.cc:359] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:41.683457  8190 raft_consensus.cc:385] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.683772  8190 raft_consensus.cc:740] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.685500  8190 consensus_queue.cc:260] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:41.690840  8192 tablet_bootstrap.cc:492] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344: No bootstrap required, opened a new log
I20260709 13:02:41.691337  8192 ts_tablet_manager.cc:1403] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.029s
I20260709 13:02:41.691380  8190 ts_tablet_manager.cc:1434] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:02:41.692550  8190 tablet_bootstrap.cc:492] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:41.690371  7996 raft_consensus.cc:3060] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.693977  8192 raft_consensus.cc:359] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:41.694687  8192 raft_consensus.cc:385] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.694960  8192 raft_consensus.cc:740] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.695585  8192 consensus_queue.cc:260] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:41.698071  8192 ts_tablet_manager.cc:1434] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:41.699966  8190 tablet_bootstrap.cc:654] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.705678  8434 raft_consensus.cc:493] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.706317  8434 raft_consensus.cc:515] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:41.726644  8434 leader_election.cc:290] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:41.727237  8194 tablet_bootstrap.cc:492] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24: No bootstrap required, opened a new log
I20260709 13:02:41.727773  8194 ts_tablet_manager.cc:1403] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent bootstrapping tablet: real 0.153s	user 0.024s	sys 0.005s
I20260709 13:02:41.729082  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d3c0e1e8574b868e633347d9be591b" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:41.729993  8145 raft_consensus.cc:2468] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:41.738150  8037 leader_election.cc:304] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:41.739157  8496 raft_consensus.cc:2804] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.739590  8496 raft_consensus.cc:493] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.741937  8496 raft_consensus.cc:3060] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.739394  7821 catalog_manager.cc:5697] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.746505  8190 tablet_bootstrap.cc:492] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:41.747089  8190 ts_tablet_manager.cc:1403] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.012s
I20260709 13:02:41.752599  8190 raft_consensus.cc:359] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.753568  8190 raft_consensus.cc:385] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.753849  8190 raft_consensus.cc:740] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.754485  8190 consensus_queue.cc:260] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.758227  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d3c0e1e8574b868e633347d9be591b" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:41.759990  7925 raft_consensus.cc:2468] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 0.
I20260709 13:02:41.767066  8190 ts_tablet_manager.cc:1434] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:02:41.771381  8190 tablet_bootstrap.cc:492] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd: Bootstrap starting.
I20260709 13:02:41.779796  8190 tablet_bootstrap.cc:654] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.786311  8496 raft_consensus.cc:515] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:41.791113  8194 raft_consensus.cc:359] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:41.791812  8194 raft_consensus.cc:385] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.792057  8194 raft_consensus.cc:740] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.794716  8194 consensus_queue.cc:260] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:41.797752  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d3c0e1e8574b868e633347d9be591b" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:41.798324  8145 raft_consensus.cc:3060] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.800511  8496 leader_election.cc:290] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:41.805138  7917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d3c0e1e8574b868e633347d9be591b" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:41.805718  7917 raft_consensus.cc:3060] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.806874  8190 tablet_bootstrap.cc:492] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd: No bootstrap required, opened a new log
I20260709 13:02:41.807440  8190 ts_tablet_manager.cc:1403] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 13:02:41.805601  8145 raft_consensus.cc:2468] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:41.811604  8190 raft_consensus.cc:359] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:41.812270  8190 raft_consensus.cc:385] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.815479  8037 leader_election.cc:304] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:41.817394  8496 raft_consensus.cc:2804] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.818063  8496 raft_consensus.cc:697] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Leader. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:41.819856  8194 ts_tablet_manager.cc:1434] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:02:41.819798  8496 consensus_queue.cc:237] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:41.822386  8190 raft_consensus.cc:740] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.824779  8190 consensus_queue.cc:260] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:41.828054  8190 ts_tablet_manager.cc:1434] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:02:41.823366  7821 catalog_manager.cc:5697] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.840157  8415 consensus_queue.cc:1048] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.844096  7917 raft_consensus.cc:2468] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7af07a29d1443b8a3c4a3770d52344 in term 1.
I20260709 13:02:41.858307  7823 catalog_manager.cc:5697] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cc7af07a29d1443b8a3c4a3770d52344" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.874752  7996 raft_consensus.cc:3060] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.881181  8496 raft_consensus.cc:493] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.881738  8496 raft_consensus.cc:515] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:41.884493  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5968d0a9e5b4f10b650229017d01068" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:41.884581  8496 leader_election.cc:290] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:41.887513  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5968d0a9e5b4f10b650229017d01068" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:41.889091  8037 leader_election.cc:304] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:41.889182  8072 raft_consensus.cc:3060] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.896554  8496 raft_consensus.cc:2749] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.899025  8595 consensus_queue.cc:1048] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.915902  8640 consensus_queue.cc:1048] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.932355  8415 raft_consensus.cc:493] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.933254  8415 raft_consensus.cc:515] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:41.935570  8415 leader_election.cc:290] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:41.938238  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:41.939348  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:41.939814  7925 raft_consensus.cc:2393] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17a4c4b3539b43108ef3481121d982bd in current term 1: Already voted for candidate cc7af07a29d1443b8a3c4a3770d52344 in this term.
I20260709 13:02:41.941262  7963 leader_election.cc:304] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:41.942327  8415 raft_consensus.cc:3060] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.952824  8415 raft_consensus.cc:2749] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.967459  8640 consensus_queue.cc:1048] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.058993  8584 raft_consensus.cc:493] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.059767  8584 raft_consensus.cc:515] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:42.061614  8584 leader_election.cc:290] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:42.062834  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767b01527e0d42ab9f574cee3fbbeaf9" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:42.062781  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767b01527e0d42ab9f574cee3fbbeaf9" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4" is_pre_election: true
I20260709 13:02:42.063573  7996 raft_consensus.cc:2468] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:42.063623  7925 raft_consensus.cc:2468] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 0.
I20260709 13:02:42.064435  8114 leader_election.cc:304] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:42.065029  8584 raft_consensus.cc:2804] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.065407  8584 raft_consensus.cc:493] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.065692  8584 raft_consensus.cc:3060] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.067730  8354 consensus_queue.cc:1048] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.072664  8584 raft_consensus.cc:515] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:42.077311  8354 consensus_queue.cc:1048] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.082870  7917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767b01527e0d42ab9f574cee3fbbeaf9" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
I20260709 13:02:42.083556  7917 raft_consensus.cc:3060] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.084031  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767b01527e0d42ab9f574cee3fbbeaf9" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:42.084595  8000 raft_consensus.cc:3060] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.083760  8584 leader_election.cc:290] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:42.091014  7917 raft_consensus.cc:2468] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:42.093819  8111 leader_election.cc:304] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:42.094515  8584 raft_consensus.cc:2804] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.096056  8584 raft_consensus.cc:697] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:42.101991  8584 consensus_queue.cc:237] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:42.117169  8000 raft_consensus.cc:2468] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:42.130087  7821 catalog_manager.cc:5697] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:42.248272  8434 consensus_queue.cc:1048] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.250505  8354 consensus_queue.cc:1048] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.572284  8584 consensus_queue.cc:1048] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.590698  8657 consensus_queue.cc:1048] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.886886   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:02:42.898552  7963 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:42.916091  7963 consensus_peers.cc:597] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.922418  7963 consensus_peers.cc:597] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.926715  8111 consensus_peers.cc:597] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.937677  8111 consensus_peers.cc:597] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.940608  8111 consensus_peers.cc:597] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.945024  8037 consensus_peers.cc:597] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.946946   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:42.947710   431 tablet_replica.cc:333] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.948657   431 raft_consensus.cc:2243] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.949175   431 raft_consensus.cc:2272] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.951849   431 tablet_replica.cc:333] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.952468   431 raft_consensus.cc:2243] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.952952   431 raft_consensus.cc:2272] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.956548   431 tablet_replica.cc:333] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.958572   431 raft_consensus.cc:2243] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.959622   431 raft_consensus.cc:2272] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:42.961105  8037 consensus_peers.cc:597] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.961716  8037 consensus_peers.cc:597] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.962251   431 tablet_replica.cc:333] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.963044   431 raft_consensus.cc:2243] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.963469   431 raft_consensus.cc:2272] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.966152   431 tablet_replica.cc:333] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.967056   431 raft_consensus.cc:2243] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.967466   431 raft_consensus.cc:2272] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:42.968641  8111 consensus_peers.cc:597] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.969933   431 tablet_replica.cc:333] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.970541   431 raft_consensus.cc:2243] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.970952   431 raft_consensus.cc:2272] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.972834   431 tablet_replica.cc:333] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.973320   431 raft_consensus.cc:2243] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.973964   431 raft_consensus.cc:2272] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.975847   431 tablet_replica.cc:333] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.976373   431 raft_consensus.cc:2243] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.976832   431 raft_consensus.cc:2272] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.979123   431 tablet_replica.cc:333] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.979915   431 raft_consensus.cc:2243] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.980365   431 raft_consensus.cc:2272] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.982060   431 tablet_replica.cc:333] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.982760   431 raft_consensus.cc:2243] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.983331   431 raft_consensus.cc:2272] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.985954   431 tablet_replica.cc:333] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.986737   431 raft_consensus.cc:2243] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.987252   431 raft_consensus.cc:2272] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.989905   431 tablet_replica.cc:333] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.990697   431 raft_consensus.cc:2243] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.991241   431 raft_consensus.cc:2272] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.993750   431 tablet_replica.cc:333] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.994278   431 raft_consensus.cc:2243] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.994650   431 raft_consensus.cc:2272] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.996922   431 tablet_replica.cc:333] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:42.997490   431 raft_consensus.cc:2243] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.997874   431 raft_consensus.cc:2272] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.000092   431 tablet_replica.cc:333] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.000630   431 raft_consensus.cc:2243] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.001025   431 raft_consensus.cc:2272] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.002626   431 tablet_replica.cc:333] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.003193   431 raft_consensus.cc:2243] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.003688   431 raft_consensus.cc:2272] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.005918   431 tablet_replica.cc:333] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.006567   431 raft_consensus.cc:2243] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.007099   431 raft_consensus.cc:2272] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.009363   431 tablet_replica.cc:333] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.009974   431 raft_consensus.cc:2243] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.010325   431 raft_consensus.cc:2272] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.013036   431 tablet_replica.cc:333] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.013746   431 raft_consensus.cc:2243] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.014266   431 raft_consensus.cc:2272] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:43.014353  8111 consensus_peers.cc:597] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.016808   431 tablet_replica.cc:333] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.017549   431 raft_consensus.cc:2243] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.017992   431 raft_consensus.cc:2272] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.020475   431 tablet_replica.cc:333] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
W20260709 13:02:43.020783  8111 consensus_peers.cc:597] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.021293   431 raft_consensus.cc:2243] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.021857   431 raft_consensus.cc:2272] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.024467   431 tablet_replica.cc:333] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.025043   431 raft_consensus.cc:2243] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.025465   431 raft_consensus.cc:2272] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.027284   431 tablet_replica.cc:333] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.027741   431 raft_consensus.cc:2243] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.028141   431 raft_consensus.cc:2272] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.030553   431 tablet_replica.cc:333] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.031275   431 raft_consensus.cc:2243] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.031859   431 raft_consensus.cc:2272] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:43.032048  8111 consensus_peers.cc:597] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.033823   431 tablet_replica.cc:333] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.034446   431 raft_consensus.cc:2243] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.034885   431 raft_consensus.cc:2272] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.036824   431 tablet_replica.cc:333] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.037377   431 raft_consensus.cc:2243] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.038094   431 raft_consensus.cc:2272] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.040066   431 tablet_replica.cc:333] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.040576   431 raft_consensus.cc:2243] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.040999   431 raft_consensus.cc:2272] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.043000   431 tablet_replica.cc:333] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.043568   431 raft_consensus.cc:2243] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.043962   431 raft_consensus.cc:2272] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.045676   431 tablet_replica.cc:333] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.046255   431 raft_consensus.cc:2243] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.046782   431 raft_consensus.cc:2272] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.048668   431 tablet_replica.cc:333] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.049279   431 raft_consensus.cc:2243] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.049696   431 raft_consensus.cc:2272] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.051609   431 tablet_replica.cc:333] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.052143   431 raft_consensus.cc:2243] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.052546   431 raft_consensus.cc:2272] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.054911   431 tablet_replica.cc:333] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.055466   431 raft_consensus.cc:2243] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.056365   431 raft_consensus.cc:2272] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.058250   431 tablet_replica.cc:333] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.058838   431 raft_consensus.cc:2243] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.059257   431 raft_consensus.cc:2272] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.061821   431 tablet_replica.cc:333] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.062561   431 raft_consensus.cc:2243] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.063119   431 raft_consensus.cc:2272] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.065011   431 tablet_replica.cc:333] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.065779   431 raft_consensus.cc:2243] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.066251   431 raft_consensus.cc:2272] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.068745   431 tablet_replica.cc:333] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.069293   431 raft_consensus.cc:2243] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.070276   431 raft_consensus.cc:2272] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.072472   431 tablet_replica.cc:333] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.072958   431 raft_consensus.cc:2243] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.073375   431 raft_consensus.cc:2272] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.075307   431 tablet_replica.cc:333] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.075868   431 raft_consensus.cc:2243] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.076289   431 raft_consensus.cc:2272] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.079008   431 tablet_replica.cc:333] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.079703   431 raft_consensus.cc:2243] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.080174   431 raft_consensus.cc:2272] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.082161   431 tablet_replica.cc:333] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.082710   431 raft_consensus.cc:2243] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.083197   431 raft_consensus.cc:2272] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.085582   431 tablet_replica.cc:333] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.086095   431 raft_consensus.cc:2243] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.086572   431 raft_consensus.cc:2272] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:43.088105  8037 consensus_peers.cc:597] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.088990   431 tablet_replica.cc:333] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.089615   431 raft_consensus.cc:2243] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.090059   431 raft_consensus.cc:2272] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.091980   431 tablet_replica.cc:333] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.092490   431 raft_consensus.cc:2243] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.093345   431 raft_consensus.cc:2272] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.095242   431 tablet_replica.cc:333] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
I20260709 13:02:43.095733   431 raft_consensus.cc:2243] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.096616   431 raft_consensus.cc:2272] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.101277   431 tablet_replica.cc:333] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: stopping tablet replica
W20260709 13:02:43.101524  7963 consensus_peers.cc:597] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.101886   431 raft_consensus.cc:2243] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.102439   431 raft_consensus.cc:2272] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:43.124202  8037 consensus_peers.cc:597] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.130666  7963 consensus_peers.cc:597] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.132913  8037 consensus_peers.cc:597] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.135070  8037 consensus_peers.cc:597] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.158195  8111 consensus_peers.cc:597] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.160056  8037 consensus_peers.cc:597] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.168403   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:43.183712  8037 consensus_peers.cc:597] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.235579  8037 consensus_peers.cc:597] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.253299  8111 consensus_peers.cc:597] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.261175  8037 consensus_peers.cc:597] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.265049  8111 consensus_peers.cc:597] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.271296  8111 consensus_peers.cc:597] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.432833  8111 consensus_peers.cc:597] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.433347  8111 consensus_peers.cc:597] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.438941  8037 consensus_peers.cc:597] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.450275  8111 consensus_peers.cc:597] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.454680  8037 consensus_peers.cc:597] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.454914  8111 consensus_peers.cc:597] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.455296  8037 consensus_peers.cc:597] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.455637  7963 consensus_peers.cc:597] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.604576  8037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 149395us
W20260709 13:02:43.604679  7963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 149141us
W20260709 13:02:43.605118  8037 consensus_peers.cc:597] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.470441  8111 consensus_peers.cc:597] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.616283  8111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40547, user_credentials={real_user=slave}} blocked reactor thread for 145958us
I20260709 13:02:43.581112   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:43.605355  7963 consensus_peers.cc:597] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.628244  8681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.630793  8682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.615495  8037 consensus_peers.cc:597] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.713052  8684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:43.715035   431 server_base.cc:1061] running on GCE node
I20260709 13:02:43.718060   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:43.718333   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:43.718539   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602163718525 us; error 0 us; skew 500 ppm
I20260709 13:02:43.719381   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:43.725977   431 webserver.cc:533] Webserver started at http://127.0.107.193:41495/ using document root <none> and password file <none>
I20260709 13:02:43.726663   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:43.726944   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:02:43.731813   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:43.743598  8689 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.744660   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:02:43.745002   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "77c8a837918d478fb10b627dfdbf90e4"
format_stamp: "Formatted at 2026-07-09 13:02:31 on dist-test-slave-szgt"
I20260709 13:02:43.745467   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:43.758296   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:43.759737   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:43.761166   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:43.765534  8696 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:02:43.938057  8670 raft_consensus.cc:493] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:43.939100  8670 raft_consensus.cc:515] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:43.941282  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cafbe600ba4345a1a6fd83c004006b" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:43.940802  8670 leader_election.cc:290] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
W20260709 13:02:43.944582  8037 leader_election.cc:336] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:43.944931  8037 leader_election.cc:304] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:43.945477  8670 raft_consensus.cc:2749] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:44.008901   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:02:44.009263   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.245s	user 0.008s	sys 0.000s
I20260709 13:02:44.009584   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:02:44.013682  8696 tablet_bootstrap.cc:492] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.031575  8696 tablet_bootstrap.cc:492] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.032487  8696 tablet_bootstrap.cc:492] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.033118  8696 ts_tablet_manager.cc:1403] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 13:02:44.035614  8696 raft_consensus.cc:359] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.036321  8696 raft_consensus.cc:740] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.037156  8696 consensus_queue.cc:260] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.043949  8696 ts_tablet_manager.cc:1434] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:44.044739  8696 tablet_bootstrap.cc:492] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.045100  8673 raft_consensus.cc:493] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.045621  8673 raft_consensus.cc:515] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.047686  8673 leader_election.cc:290] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.049615  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cafbe600ba4345a1a6fd83c004006b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:44.050307  8072 raft_consensus.cc:2468] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:44.051482  8111 leader_election.cc:304] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
W20260709 13:02:44.052161  8111 leader_election.cc:336] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.052309  8673 raft_consensus.cc:2804] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:44.052940  8673 raft_consensus.cc:493] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.053829  8673 raft_consensus.cc:3060] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.060746  8673 raft_consensus.cc:515] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.068068  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cafbe600ba4345a1a6fd83c004006b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:44.068650  8072 raft_consensus.cc:3060] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:44.069200  8111 leader_election.cc:336] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.070039  8673 leader_election.cc:290] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.076120  8696 tablet_bootstrap.cc:492] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.077150  8696 tablet_bootstrap.cc:492] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.077822  8696 ts_tablet_manager.cc:1403] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.000s
I20260709 13:02:44.080572  8696 raft_consensus.cc:359] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.081241  8696 raft_consensus.cc:740] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.081928  8696 consensus_queue.cc:260] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.084002  8696 ts_tablet_manager.cc:1434] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:44.084762  8696 tablet_bootstrap.cc:492] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.087003  8072 raft_consensus.cc:2468] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 2.
I20260709 13:02:44.088266  8111 leader_election.cc:304] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.089793  8673 raft_consensus.cc:2804] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:44.090263  8673 raft_consensus.cc:697] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:44.091080  8673 consensus_queue.cc:237] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.120046  8660 raft_consensus.cc:493] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.120776  8660 raft_consensus.cc:515] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.140030  8657 raft_consensus.cc:493] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.140205  8660 leader_election.cc:290] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:44.140606  8657 raft_consensus.cc:515] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.142632  8657 leader_election.cc:290] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:44.151398  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefeddccd22947cb8bb9c24c3688456f" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:44.152333  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9da43a750ef48788d4da9f817f17b3c" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:44.154439  8696 tablet_bootstrap.cc:492] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.155416  8696 tablet_bootstrap.cc:492] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.156052  8696 ts_tablet_manager.cc:1403] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.071s	user 0.033s	sys 0.020s
I20260709 13:02:44.158519  8696 raft_consensus.cc:359] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:44.159176  8696 raft_consensus.cc:740] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.159965  8696 consensus_queue.cc:260] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:44.159758  7823 catalog_manager.cc:5697] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 1 to 2, leader changed from 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193) to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.161875  8696 ts_tablet_manager.cc:1434] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:44.162724  8696 tablet_bootstrap.cc:492] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:44.164898  8111 leader_election.cc:336] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.165373  8111 leader_election.cc:304] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.166067  8584 raft_consensus.cc:2749] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:44.172926  8111 leader_election.cc:336] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.173435  8111 leader_election.cc:304] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.174332  8584 raft_consensus.cc:2749] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:44.183890  8696 tablet_bootstrap.cc:492] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.184904  8696 tablet_bootstrap.cc:492] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.185571  8696 ts_tablet_manager.cc:1403] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:02:44.189014  8696 raft_consensus.cc:359] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.189522  8696 raft_consensus.cc:740] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.190231  8696 consensus_queue.cc:260] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.192108  8696 ts_tablet_manager.cc:1434] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:44.192816  8696 tablet_bootstrap.cc:492] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.197990  8658 raft_consensus.cc:493] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.198487  8658 raft_consensus.cc:515] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.200549  8658 leader_election.cc:290] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.201951  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefeddccd22947cb8bb9c24c3688456f" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:44.202590  8148 raft_consensus.cc:2468] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:44.204041  7963 leader_election.cc:304] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
W20260709 13:02:44.205013  7963 leader_election.cc:336] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.211308  8680 raft_consensus.cc:493] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.211923  8658 raft_consensus.cc:2804] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:44.211858  8680 raft_consensus.cc:515] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.212352  8658 raft_consensus.cc:493] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.212725  8658 raft_consensus.cc:3060] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.214051  8680 leader_election.cc:290] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.211009  8696 tablet_bootstrap.cc:492] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.216468  8696 tablet_bootstrap.cc:492] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.217188  8696 ts_tablet_manager.cc:1403] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 13:02:44.219409  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9da43a750ef48788d4da9f817f17b3c" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:44.220031  8148 raft_consensus.cc:2468] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 1.
I20260709 13:02:44.219763  8696 raft_consensus.cc:359] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.220681  8696 raft_consensus.cc:740] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
W20260709 13:02:44.219799  7963 leader_election.cc:336] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.221617  8696 consensus_queue.cc:260] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.221740  7963 leader_election.cc:304] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.223928  8680 raft_consensus.cc:2804] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:44.224303  8680 raft_consensus.cc:493] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.224643  8680 raft_consensus.cc:3060] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.223687  8696 ts_tablet_manager.cc:1434] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:44.227591  8696 tablet_bootstrap.cc:492] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.231393  8680 raft_consensus.cc:515] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.233444  8680 leader_election.cc:290] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.234182  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9da43a750ef48788d4da9f817f17b3c" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:44.234733  8148 raft_consensus.cc:3060] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.234658  8658 raft_consensus.cc:515] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.236771  8658 leader_election.cc:290] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.240832  8148 raft_consensus.cc:2468] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
W20260709 13:02:44.243643  7963 leader_election.cc:336] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.244717  7963 leader_election.cc:304] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.245405  8658 raft_consensus.cc:2804] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:44.245880  8658 raft_consensus.cc:697] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:44.247568  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefeddccd22947cb8bb9c24c3688456f" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:44.248186  8145 raft_consensus.cc:3060] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.246742  8658 consensus_queue.cc:237] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.254331  8696 tablet_bootstrap.cc:492] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.255331  8696 tablet_bootstrap.cc:492] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.255826  8145 raft_consensus.cc:2468] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:44.255990  8696 ts_tablet_manager.cc:1403] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.007s
W20260709 13:02:44.256945  7963 leader_election.cc:336] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.257802  7963 leader_election.cc:304] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.258538  8680 raft_consensus.cc:2804] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:44.258998  8670 raft_consensus.cc:493] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.259042  8680 raft_consensus.cc:697] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:44.259382  8696 raft_consensus.cc:359] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:44.259550  8670 raft_consensus.cc:515] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.260295  8696 raft_consensus.cc:740] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.260270  8680 consensus_queue.cc:237] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.261061  8696 consensus_queue.cc:260] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:44.261677  8670 leader_election.cc:290] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.264001  8696 ts_tablet_manager.cc:1434] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:44.264505  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:44.264802  8696 tablet_bootstrap.cc:492] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:44.269869  8037 leader_election.cc:336] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.270360  8037 leader_election.cc:304] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:44.271562  8678 raft_consensus.cc:2749] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:44.282850  7823 catalog_manager.cc:5697] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 1 to 2, leader changed from 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193) to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.287938  8696 tablet_bootstrap.cc:492] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.288866  8696 tablet_bootstrap.cc:492] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.289477  8696 ts_tablet_manager.cc:1403] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:02:44.291941  8696 raft_consensus.cc:359] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.292568  8696 raft_consensus.cc:740] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.293277  8696 consensus_queue.cc:260] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.295312  8696 ts_tablet_manager.cc:1434] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:44.296041  8696 tablet_bootstrap.cc:492] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.301390  7819 catalog_manager.cc:5697] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 1 to 2, leader changed from 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193) to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.313171  8696 tablet_bootstrap.cc:492] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.314086  8696 tablet_bootstrap.cc:492] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.314651  8696 ts_tablet_manager.cc:1403] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.008s
I20260709 13:02:44.317016  8696 raft_consensus.cc:359] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.317644  8696 raft_consensus.cc:740] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.318303  8696 consensus_queue.cc:260] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.320160  8696 ts_tablet_manager.cc:1434] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:02:44.320850  8696 tablet_bootstrap.cc:492] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.325457  8657 raft_consensus.cc:493] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.326025  8657 raft_consensus.cc:515] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.328037  8657 leader_election.cc:290] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.333506  8658 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.334239  8658 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
W20260709 13:02:44.335839  8111 leader_election.cc:336] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.338195  8658 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:44.343204  8696 tablet_bootstrap.cc:492] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.343294  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:44.343829  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:44.344285  8696 tablet_bootstrap.cc:492] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.344517  8072 raft_consensus.cc:2468] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:44.345927  8111 leader_election.cc:304] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.346982  8657 raft_consensus.cc:2804] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:44.347415  8657 raft_consensus.cc:493] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.347707  8696 ts_tablet_manager.cc:1403] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 13:02:44.347771  8657 raft_consensus.cc:3060] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.350353  8696 raft_consensus.cc:359] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.351040  8696 raft_consensus.cc:740] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.351785  8696 consensus_queue.cc:260] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.353796  8696 ts_tablet_manager.cc:1434] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:44.354509  8696 tablet_bootstrap.cc:492] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:44.355069  7963 leader_election.cc:336] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.355558  7963 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:44.356616  8658 raft_consensus.cc:2749] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:44.360088  8657 raft_consensus.cc:515] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.362871  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:44.363436  8072 raft_consensus.cc:3060] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.369943  8072 raft_consensus.cc:2468] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 2.
I20260709 13:02:44.371170  8657 leader_election.cc:290] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.371181  8111 leader_election.cc:304] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:44.372200  8657 raft_consensus.cc:2804] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:44.373462  8657 raft_consensus.cc:697] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:44.374742  8696 tablet_bootstrap.cc:492] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.374394  8657 consensus_queue.cc:237] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.375695  8696 tablet_bootstrap.cc:492] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.376374  8696 ts_tablet_manager.cc:1403] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:02:44.378028   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:02:44.378487   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.369s	user 0.241s	sys 0.012s
I20260709 13:02:44.379016  8696 raft_consensus.cc:359] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.379788  8696 raft_consensus.cc:740] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.380492  8696 consensus_queue.cc:260] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.382529  8696 ts_tablet_manager.cc:1434] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:44.383307  8696 tablet_bootstrap.cc:492] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.388094  8678 raft_consensus.cc:493] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.388650  8678 raft_consensus.cc:515] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.391674  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeecb381a054a5e834ec07d2a92c30b" candidate_uuid: "cc7af07a29d1443b8a3c4a3770d52344" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
W20260709 13:02:44.392033  8111 leader_election.cc:336] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.393289  8678 leader_election.cc:290] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.395795  8584 raft_consensus.cc:493] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.396454  8584 raft_consensus.cc:515] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.398988  8584 leader_election.cc:290] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
W20260709 13:02:44.399897  8037 leader_election.cc:336] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.400581  8037 leader_election.cc:304] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:44.408985  8670 raft_consensus.cc:2749] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:44.408201  7819 catalog_manager.cc:5697] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 1 to 2, leader changed from 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193) to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.434530  8696 tablet_bootstrap.cc:492] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.435640  8696 tablet_bootstrap.cc:492] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
W20260709 13:02:44.436142  8111 leader_election.cc:336] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.436365  8696 ts_tablet_manager.cc:1403] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.053s	user 0.033s	sys 0.016s
I20260709 13:02:44.439723  8696 raft_consensus.cc:359] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.440724  8696 raft_consensus.cc:740] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.441687  8696 consensus_queue.cc:260] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.443984  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:44.444640  8072 raft_consensus.cc:2468] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:44.446832  8696 ts_tablet_manager.cc:1434] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:44.448093  8696 tablet_bootstrap.cc:492] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.458381  8111 leader_election.cc:304] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.459266  8584 raft_consensus.cc:2804] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:44.459618  8584 raft_consensus.cc:493] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.459937  8584 raft_consensus.cc:3060] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.470080  8584 raft_consensus.cc:515] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.475703  8584 leader_election.cc:290] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.475847  8696 tablet_bootstrap.cc:492] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.478931  8696 tablet_bootstrap.cc:492] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.479612  8696 ts_tablet_manager.cc:1403] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.006s
I20260709 13:02:44.483060  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:44.483492  8069 raft_consensus.cc:1275] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 87b2df8987cd4ac0b02b0632752c3a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.483645  8072 raft_consensus.cc:3060] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.486436  8696 raft_consensus.cc:359] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.487133  8696 raft_consensus.cc:740] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
W20260709 13:02:44.487960  8111 leader_election.cc:336] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.487803  8696 consensus_queue.cc:260] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
W20260709 13:02:44.489169  8111 consensus_peers.cc:597] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.490296  8696 ts_tablet_manager.cc:1434] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:02:44.491168  8696 tablet_bootstrap.cc:492] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.495242  8660 consensus_queue.cc:1048] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.497045  8072 raft_consensus.cc:2468] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 2.
I20260709 13:02:44.502373  8111 leader_election.cc:304] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.503334  8660 raft_consensus.cc:2804] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:44.504541  8660 raft_consensus.cc:697] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:44.505649  8660 consensus_queue.cc:237] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.515532  8696 tablet_bootstrap.cc:492] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:02:44.515688  8021 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa700 after lost signal to thread 434
I20260709 13:02:44.516618  8696 tablet_bootstrap.cc:492] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
W20260709 13:02:44.516870  8021 debug-util.cc:398] Leaking SignalData structure 0x7b08002927c0 after lost signal to thread 7857
I20260709 13:02:44.517314  8696 ts_tablet_manager.cc:1403] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
W20260709 13:02:44.518226  8021 debug-util.cc:398] Leaking SignalData structure 0x7b08000b5d80 after lost signal to thread 8024
W20260709 13:02:44.519436  8021 debug-util.cc:398] Leaking SignalData structure 0x7b080011dba0 after lost signal to thread 8098
I20260709 13:02:44.519784  8696 raft_consensus.cc:359] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:44.520419  8696 raft_consensus.cc:740] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
W20260709 13:02:44.520567  8021 debug-util.cc:398] Leaking SignalData structure 0x7b08000df9c0 after lost signal to thread 8172
I20260709 13:02:44.521406  8696 consensus_queue.cc:260] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:44.523439  8696 ts_tablet_manager.cc:1434] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:44.524211  8696 tablet_bootstrap.cc:492] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.563654  8657 raft_consensus.cc:493] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.564373  8657 raft_consensus.cc:515] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.586589  8736 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.587476  8736 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:44.603804  8657 leader_election.cc:290] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.615196  8736 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:44.615634  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:44.626941  8040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36125, user_credentials={real_user=slave}} blocked reactor thread for 55871.8us
I20260709 13:02:44.633713  7999 raft_consensus.cc:2468] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 2.
I20260709 13:02:44.646502  7819 catalog_manager.cc:5697] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 1 to 2, leader changed from 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193) to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.649534  8114 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
W20260709 13:02:44.659416  8111 leader_election.cc:336] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.661908  8696 tablet_bootstrap.cc:492] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.656005  8657 raft_consensus.cc:2804] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:44.696734  8037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39391, user_credentials={real_user=slave}} blocked reactor thread for 53537.8us
I20260709 13:02:44.684230  8657 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.710384  8696 tablet_bootstrap.cc:492] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.711454  8696 ts_tablet_manager.cc:1403] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.187s	user 0.059s	sys 0.021s
I20260709 13:02:44.717233  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeecb381a054a5e834ec07d2a92c30b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:44.717957  8071 raft_consensus.cc:2468] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 1.
I20260709 13:02:44.707731  8657 raft_consensus.cc:3060] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:44.723475  7963 consensus_peers.cc:597] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.740934  8111 leader_election.cc:336] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.745484  8111 leader_election.cc:304] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.749758  8737 raft_consensus.cc:2804] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:44.750133  8737 raft_consensus.cc:493] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:02:44.750898  8737 raft_consensus.cc:3060] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.750066  8696 raft_consensus.cc:359] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.758536  8696 raft_consensus.cc:740] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.759454  8696 consensus_queue.cc:260] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:44.769239  8696 ts_tablet_manager.cc:1434] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.000s
I20260709 13:02:44.770037  8696 tablet_bootstrap.cc:492] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.778503  8657 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:44.764030  8737 raft_consensus.cc:515] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.793409  8737 leader_election.cc:290] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:44.795286  8657 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 election: Requested vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:44.797521  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:44.798161  8000 raft_consensus.cc:3060] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.804595  8000 raft_consensus.cc:2468] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 3.
I20260709 13:02:44.807649  8114 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:44.808467  8740 raft_consensus.cc:2804] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:44.810276  8740 raft_consensus.cc:697] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:44.812129  8148 raft_consensus.cc:1275] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.813642  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeecb381a054a5e834ec07d2a92c30b" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:44.814381  8072 raft_consensus.cc:3060] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.811075  8740 consensus_queue.cc:237] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:44.816879  8747 consensus_queue.cc:1048] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:44.817319  8111 leader_election.cc:336] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
W20260709 13:02:44.817982  8111 leader_election.cc:336] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:02:44.828325  8072 raft_consensus.cc:2468] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 2.
I20260709 13:02:44.830307  8696 tablet_bootstrap.cc:492] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:02:44.833117  8111 consensus_peers.cc:597] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.842422  8111 leader_election.cc:304] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:44.843493  8657 raft_consensus.cc:2804] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:44.844056  8657 raft_consensus.cc:697] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:44.844906  8657 consensus_queue.cc:237] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.845500  8696 tablet_bootstrap.cc:492] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.845748  8145 raft_consensus.cc:1275] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.848385  8696 ts_tablet_manager.cc:1403] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.001s
I20260709 13:02:44.849164  8747 consensus_queue.cc:1048] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:44.856389  8696 raft_consensus.cc:359] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:44.857554  8696 raft_consensus.cc:740] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.858700  8696 consensus_queue.cc:260] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:44.860605  7819 catalog_manager.cc:5697] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 2 to 3, leader changed from 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193) to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.861431  8696 ts_tablet_manager.cc:1434] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
W20260709 13:02:44.871050  7963 consensus_peers.cc:597] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.871097  8696 tablet_bootstrap.cc:492] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.917229  7823 catalog_manager.cc:5697] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 1 to 2, leader changed from 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193) to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:44.939200  8111 consensus_peers.cc:597] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.965557  8696 tablet_bootstrap.cc:492] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.967124  8696 tablet_bootstrap.cc:492] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:44.967775  8696 ts_tablet_manager.cc:1403] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.020s
I20260709 13:02:44.969501  8072 raft_consensus.cc:1275] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 87b2df8987cd4ac0b02b0632752c3a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.970530  8696 raft_consensus.cc:359] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.972695  8696 raft_consensus.cc:740] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.973462  8696 consensus_queue.cc:260] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:44.974207  8069 raft_consensus.cc:1275] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 87b2df8987cd4ac0b02b0632752c3a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.975539  8696 ts_tablet_manager.cc:1434] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:44.976372  8696 tablet_bootstrap.cc:492] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:44.979212  8740 consensus_queue.cc:1048] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.974313  8657 consensus_queue.cc:1048] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:02:45.002388  8696 tablet_bootstrap.cc:492] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.003332  8696 tablet_bootstrap.cc:492] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.003948  8696 ts_tablet_manager.cc:1403] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.003s
I20260709 13:02:45.006335  8696 raft_consensus.cc:359] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.008313  8696 raft_consensus.cc:740] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.009104  8696 consensus_queue.cc:260] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.011780  8696 ts_tablet_manager.cc:1434] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:02:45.012513  8696 tablet_bootstrap.cc:492] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:45.029122  8111 consensus_peers.cc:597] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.035559  8696 tablet_bootstrap.cc:492] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.036605  8696 tablet_bootstrap.cc:492] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.037259  8696 ts_tablet_manager.cc:1403] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 13:02:45.039760  8696 raft_consensus.cc:359] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:45.040392  8696 raft_consensus.cc:740] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.041203  8696 consensus_queue.cc:260] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:45.043416  8696 ts_tablet_manager.cc:1434] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:02:45.044173  8696 tablet_bootstrap.cc:492] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.066223  8696 tablet_bootstrap.cc:492] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.067229  8696 tablet_bootstrap.cc:492] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.067813  8696 ts_tablet_manager.cc:1403] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:02:45.070159  8696 raft_consensus.cc:359] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.070847  8696 raft_consensus.cc:740] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.071674  8696 consensus_queue.cc:260] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.073815  8696 ts_tablet_manager.cc:1434] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:45.074571  8696 tablet_bootstrap.cc:492] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.095834  8696 tablet_bootstrap.cc:492] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.096778  8696 tablet_bootstrap.cc:492] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.097360  8696 ts_tablet_manager.cc:1403] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:02:45.101218  8696 raft_consensus.cc:359] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.101804  8696 raft_consensus.cc:740] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.102582  8696 consensus_queue.cc:260] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.104609  8696 ts_tablet_manager.cc:1434] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:45.105361  8696 tablet_bootstrap.cc:492] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.143123  8696 tablet_bootstrap.cc:492] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.144027  8696 tablet_bootstrap.cc:492] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.144660  8696 ts_tablet_manager.cc:1403] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.003s
I20260709 13:02:45.149145  8696 raft_consensus.cc:359] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.149794  8696 raft_consensus.cc:740] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.150524  8696 consensus_queue.cc:260] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.152660  8696 ts_tablet_manager.cc:1434] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:45.153362  8696 tablet_bootstrap.cc:492] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.194038  8696 tablet_bootstrap.cc:492] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.194850  8696 tablet_bootstrap.cc:492] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.195436  8696 ts_tablet_manager.cc:1403] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.042s	user 0.032s	sys 0.008s
I20260709 13:02:45.197698  8696 raft_consensus.cc:359] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.198374  8696 raft_consensus.cc:740] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.199015  8696 consensus_queue.cc:260] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.201077  8696 ts_tablet_manager.cc:1434] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:02:45.201774  8696 tablet_bootstrap.cc:492] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.223846  8698 raft_consensus.cc:493] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.224376  8698 raft_consensus.cc:515] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.225791  8696 tablet_bootstrap.cc:492] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.228628  8696 tablet_bootstrap.cc:492] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.229454  8696 ts_tablet_manager.cc:1403] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.000s
I20260709 13:02:45.234086  8696 raft_consensus.cc:359] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.234973  8696 raft_consensus.cc:740] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.235880  8696 consensus_queue.cc:260] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.246752  8696 ts_tablet_manager.cc:1434] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:02:45.247768  8696 tablet_bootstrap.cc:492] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:45.253615  8037 consensus_peers.cc:597] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.257696  8698 leader_election.cc:290] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:45.274457  8696 tablet_bootstrap.cc:492] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.287778  8696 tablet_bootstrap.cc:492] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.288067  8072 raft_consensus.cc:1275] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 87b2df8987cd4ac0b02b0632752c3a24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:45.288676  8696 ts_tablet_manager.cc:1403] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.004s
I20260709 13:02:45.292273  8696 raft_consensus.cc:359] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.293108  8696 raft_consensus.cc:740] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.294004  8696 consensus_queue.cc:260] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.295053  8657 consensus_queue.cc:1048] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:02:45.296571  8696 ts_tablet_manager.cc:1434] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:45.297377  8696 tablet_bootstrap.cc:492] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:45.302786  8111 consensus_peers.cc:597] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:45.341974  8111 consensus_peers.cc:597] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.354104  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefeddccd22947cb8bb9c24c3688456f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
W20260709 13:02:45.360025  7963 consensus_peers.cc:597] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.363832  7999 raft_consensus.cc:1275] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 3 FOLLOWER]: Refusing update from remote peer 87b2df8987cd4ac0b02b0632752c3a24: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:45.365669  8660 consensus_queue.cc:1048] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:45.369943  8111 consensus_peers.cc:597] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.360242  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefeddccd22947cb8bb9c24c3688456f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:45.388445  8690 leader_election.cc:304] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:45.389818  8698 raft_consensus.cc:2749] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:45.429755  8698 raft_consensus.cc:493] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.430377  8698 raft_consensus.cc:515] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:45.432857  8698 leader_election.cc:290] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:45.435761  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:45.435804  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8f59ad4a54890b1b6e01058db213e" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:45.441869  8690 leader_election.cc:304] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:45.448261  8698 raft_consensus.cc:2749] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:45.450716  8037 consensus_peers.cc:597] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:45.461547  8037 consensus_peers.cc:597] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:45.465646  8111 consensus_peers.cc:597] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.503010  8111 consensus_peers.cc:597] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.511768  8696 tablet_bootstrap.cc:492] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.513110  8696 tablet_bootstrap.cc:492] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.513911  8696 ts_tablet_manager.cc:1403] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.217s	user 0.009s	sys 0.008s
I20260709 13:02:45.548532  8696 raft_consensus.cc:359] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.549439  8696 raft_consensus.cc:740] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.561946  8696 consensus_queue.cc:260] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.567028  8696 ts_tablet_manager.cc:1434] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 13:02:45.568058  8696 tablet_bootstrap.cc:492] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.574180  8698 raft_consensus.cc:493] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.575102  8698 raft_consensus.cc:515] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.584242  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35aead4728d347f19af0f42f8cdef593" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:45.584196  8698 leader_election.cc:290] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:45.595451  8698 raft_consensus.cc:493] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.596011  8698 raft_consensus.cc:515] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.599550  8698 leader_election.cc:290] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:45.600226  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:45.601748  8799 raft_consensus.cc:493] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.602228  8799 raft_consensus.cc:515] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:45.605159  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:45.604557  8799 leader_election.cc:290] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:45.611260   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40547
I20260709 13:02:45.611259  8820 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40547 every 8 connection(s)
W20260709 13:02:45.665201  8111 consensus_peers.cc:597] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.667162  8696 tablet_bootstrap.cc:492] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.668409  8696 tablet_bootstrap.cc:492] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.669174  8696 ts_tablet_manager.cc:1403] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.101s	user 0.016s	sys 0.003s
I20260709 13:02:45.673534  8696 raft_consensus.cc:359] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:45.674192  8696 raft_consensus.cc:740] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.675055  8696 consensus_queue.cc:260] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:45.677830  8696 ts_tablet_manager.cc:1434] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:02:45.680518  8777 raft_consensus.cc:3060] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.684242  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35aead4728d347f19af0f42f8cdef593" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:45.684700  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc3d5be218446ebeebf6018140a264" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:45.684824  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:45.680123  8696 tablet_bootstrap.cc:492] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.686821  8690 leader_election.cc:304] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:45.693714  8799 raft_consensus.cc:2749] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:45.694205  8690 leader_election.cc:304] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:45.695449  8698 raft_consensus.cc:2749] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:45.696589  8698 raft_consensus.cc:493] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.697033  8698 raft_consensus.cc:515] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.697710  8690 leader_election.cc:304] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:45.699445  8799 raft_consensus.cc:2749] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:45.699728  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:45.700043  8799 raft_consensus.cc:493] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.700608  8799 raft_consensus.cc:515] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.701721  8698 leader_election.cc:290] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:45.702245  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:45.702626  8799 leader_election.cc:290] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:45.704903  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17a4c4b3539b43108ef3481121d982bd" is_pre_election: true
I20260709 13:02:45.719802  8690 leader_election.cc:304] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:45.720461  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:45.723834  8690 leader_election.cc:304] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:02:45.724670  8799 raft_consensus.cc:2749] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:45.725205  8829 raft_consensus.cc:2749] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:45.744022  8696 tablet_bootstrap.cc:492] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.745371  8696 tablet_bootstrap.cc:492] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.746008  8696 ts_tablet_manager.cc:1403] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.007s
W20260709 13:02:45.748252  8111 consensus_peers.cc:597] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.748656  8696 raft_consensus.cc:359] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.749459  8696 raft_consensus.cc:740] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.750250  8696 consensus_queue.cc:260] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.753074  8696 ts_tablet_manager.cc:1434] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:45.753948  8696 tablet_bootstrap.cc:492] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.781803  8825 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34449
I20260709 13:02:45.782346  8825 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:45.784817  8825 heartbeater.cc:507] Master 127.0.107.254:34449 requested a full tablet report, sending...
W20260709 13:02:45.785609  7963 consensus_peers.cc:597] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.792778  8696 tablet_bootstrap.cc:492] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.793776  8696 tablet_bootstrap.cc:492] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.794323  8777 raft_consensus.cc:3060] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.794400  8696 ts_tablet_manager.cc:1403] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.019s
I20260709 13:02:45.797152  8696 raft_consensus.cc:359] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.798161  8696 raft_consensus.cc:740] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.798811  8696 consensus_queue.cc:260] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:45.801607  8696 ts_tablet_manager.cc:1434] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:45.802477  8696 tablet_bootstrap.cc:492] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.836443  8777 raft_consensus.cc:3060] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:45.843401  8111 consensus_peers.cc:597] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:45.846349  7963 consensus_peers.cc:597] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.863483  7823 ts_manager.cc:194] Re-registered known tserver with Master: 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547)
I20260709 13:02:45.884994  8776 raft_consensus.cc:3060] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:45.889725  8111 consensus_peers.cc:597] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:45.895159  8037 consensus_peers.cc:597] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.900302  8696 tablet_bootstrap.cc:492] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.901072  8696 tablet_bootstrap.cc:492] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.901732  8696 ts_tablet_manager.cc:1403] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.099s	user 0.026s	sys 0.040s
I20260709 13:02:45.904069  8696 raft_consensus.cc:359] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:45.904729  8696 raft_consensus.cc:740] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.905469  8696 consensus_queue.cc:260] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:45.907403  8696 ts_tablet_manager.cc:1434] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:02:45.908170  8696 tablet_bootstrap.cc:492] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:45.910723  8037 consensus_peers.cc:597] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:45.914036  8037 consensus_peers.cc:597] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.915562  8777 raft_consensus.cc:3060] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.938814  7823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46798
I20260709 13:02:45.941511  8696 tablet_bootstrap.cc:492] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.942528  8696 tablet_bootstrap.cc:492] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:45.943253  8696 ts_tablet_manager.cc:1403] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.008s
I20260709 13:02:45.945936  8696 raft_consensus.cc:359] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:45.946637  8696 raft_consensus.cc:740] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.947372  8696 consensus_queue.cc:260] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:45.949505  8696 ts_tablet_manager.cc:1434] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:45.950295  8696 tablet_bootstrap.cc:492] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:45.967523  8829 raft_consensus.cc:493] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87b2df8987cd4ac0b02b0632752c3a24)
I20260709 13:02:45.968075  8829 raft_consensus.cc:515] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:45.970525  8825 heartbeater.cc:499] Master 127.0.107.254:34449 was elected leader, sending a full tablet report...
I20260709 13:02:45.975489  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344" is_pre_election: true
I20260709 13:02:45.978184  8829 leader_election.cc:290] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:45.978410  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b5a7ece3ac41af97886d7a3aff6f0f" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24" is_pre_election: true
I20260709 13:02:45.980005  8690 leader_election.cc:304] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4; no voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344
I20260709 13:02:45.981151  8829 raft_consensus.cc:2749] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:45.998797  8696 tablet_bootstrap.cc:492] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.999715  8696 tablet_bootstrap.cc:492] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.000339  8696 ts_tablet_manager.cc:1403] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.004s
I20260709 13:02:46.002948  8696 raft_consensus.cc:359] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.003643  8696 raft_consensus.cc:740] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.004519  8696 consensus_queue.cc:260] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.006346  8696 ts_tablet_manager.cc:1434] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:46.007172  8696 tablet_bootstrap.cc:492] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.025553  8696 tablet_bootstrap.cc:492] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.026465  8696 tablet_bootstrap.cc:492] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.028199  8696 ts_tablet_manager.cc:1403] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:02:46.030907  8696 raft_consensus.cc:359] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.031613  8696 raft_consensus.cc:740] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.032284  8696 consensus_queue.cc:260] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.035748  8696 ts_tablet_manager.cc:1434] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:46.036537  8696 tablet_bootstrap.cc:492] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.052680  8696 tablet_bootstrap.cc:492] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.053577  8696 tablet_bootstrap.cc:492] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.054226  8696 ts_tablet_manager.cc:1403] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:02:46.056924  8696 raft_consensus.cc:359] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.057585  8696 raft_consensus.cc:740] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.058324  8696 consensus_queue.cc:260] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.060591  8696 ts_tablet_manager.cc:1434] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:02:46.061334  8696 tablet_bootstrap.cc:492] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.087707  8696 tablet_bootstrap.cc:492] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.088640  8696 tablet_bootstrap.cc:492] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.089341  8696 ts_tablet_manager.cc:1403] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.010s
I20260709 13:02:46.096680  8696 raft_consensus.cc:359] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.097342  8696 raft_consensus.cc:740] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.099303  8696 consensus_queue.cc:260] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.101569  8696 ts_tablet_manager.cc:1434] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:02:46.104561  8696 tablet_bootstrap.cc:492] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:46.115708  8037 consensus_peers.cc:597] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:46.137617  8696 tablet_bootstrap.cc:492] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.138612  8696 tablet_bootstrap.cc:492] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.139297  8696 ts_tablet_manager.cc:1403] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.004s
I20260709 13:02:46.142277  8696 raft_consensus.cc:359] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.142666  8777 raft_consensus.cc:3060] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.143160  8696 raft_consensus.cc:740] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.143918  8696 consensus_queue.cc:260] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.146095  8696 ts_tablet_manager.cc:1434] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:46.147074  8696 tablet_bootstrap.cc:492] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.165832  8696 tablet_bootstrap.cc:492] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.166764  8696 tablet_bootstrap.cc:492] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.167441  8696 ts_tablet_manager.cc:1403] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:02:46.169945  8696 raft_consensus.cc:359] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.170614  8696 raft_consensus.cc:740] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.171272  8696 consensus_queue.cc:260] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.173599  8696 ts_tablet_manager.cc:1434] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:02:46.174373  8696 tablet_bootstrap.cc:492] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:46.183838  8111 consensus_peers.cc:597] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:46.189261  8696 tablet_bootstrap.cc:492] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.190181  8696 tablet_bootstrap.cc:492] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.190789  8696 ts_tablet_manager.cc:1403] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:02:46.192955  8696 raft_consensus.cc:359] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.193544  8696 raft_consensus.cc:740] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.194149  8696 consensus_queue.cc:260] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.196111  8696 ts_tablet_manager.cc:1434] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:46.197371  8696 tablet_bootstrap.cc:492] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.208745  8696 tablet_bootstrap.cc:492] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.209622  8696 tablet_bootstrap.cc:492] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.210197  8696 ts_tablet_manager.cc:1403] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:02:46.213430  8696 raft_consensus.cc:359] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.214013  8696 raft_consensus.cc:740] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.214578  8696 consensus_queue.cc:260] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.216706  8696 ts_tablet_manager.cc:1434] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:46.218073  8696 tablet_bootstrap.cc:492] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.241175  8696 tablet_bootstrap.cc:492] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.242105  8696 tablet_bootstrap.cc:492] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.242744  8696 ts_tablet_manager.cc:1403] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:02:46.245543  8696 raft_consensus.cc:359] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:46.246236  8696 raft_consensus.cc:740] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.246922  8696 consensus_queue.cc:260] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:46.249058  8696 ts_tablet_manager.cc:1434] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:46.249928  8696 tablet_bootstrap.cc:492] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.283190  8696 tablet_bootstrap.cc:492] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.284099  8696 tablet_bootstrap.cc:492] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.284746  8696 ts_tablet_manager.cc:1403] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 13:02:46.287154  8696 raft_consensus.cc:359] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.287822  8696 raft_consensus.cc:740] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.291424  8696 consensus_queue.cc:260] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.293570  8696 ts_tablet_manager.cc:1434] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:02:46.294379  8696 tablet_bootstrap.cc:492] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.319067  8696 tablet_bootstrap.cc:492] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.320021  8696 tablet_bootstrap.cc:492] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.320659  8696 ts_tablet_manager.cc:1403] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.003s
I20260709 13:02:46.323218  8696 raft_consensus.cc:359] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.323902  8696 raft_consensus.cc:740] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.324695  8696 consensus_queue.cc:260] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.326985  8696 ts_tablet_manager.cc:1434] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:46.327766  8696 tablet_bootstrap.cc:492] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
W20260709 13:02:46.364154  8111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43745, user_credentials={real_user=slave}} blocked reactor thread for 69333.9us
I20260709 13:02:46.418102  8696 tablet_bootstrap.cc:492] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.419157  8696 tablet_bootstrap.cc:492] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.420111  8696 ts_tablet_manager.cc:1403] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.093s	user 0.045s	sys 0.044s
I20260709 13:02:46.422816  8696 raft_consensus.cc:359] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.423509  8696 raft_consensus.cc:740] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.424187  8696 consensus_queue.cc:260] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:46.430764  8696 ts_tablet_manager.cc:1434] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:46.431535  8696 tablet_bootstrap.cc:492] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.452688  8696 tablet_bootstrap.cc:492] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.453655  8696 tablet_bootstrap.cc:492] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.454372  8696 ts_tablet_manager.cc:1403] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:02:46.457247  8696 raft_consensus.cc:359] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:46.457937  8696 raft_consensus.cc:740] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.458724  8696 consensus_queue.cc:260] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:46.460891  8696 ts_tablet_manager.cc:1434] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:46.461712  8696 tablet_bootstrap.cc:492] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.483456  8696 tablet_bootstrap.cc:492] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.484416  8696 tablet_bootstrap.cc:492] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.485112  8696 ts_tablet_manager.cc:1403] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 13:02:46.487721  8696 raft_consensus.cc:359] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.488404  8696 raft_consensus.cc:740] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.489261  8696 consensus_queue.cc:260] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.491381  8696 ts_tablet_manager.cc:1434] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:46.492254  8696 tablet_bootstrap.cc:492] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap starting.
I20260709 13:02:46.553866  8696 tablet_bootstrap.cc:492] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:46.554824  8696 tablet_bootstrap.cc:492] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: Bootstrap complete.
I20260709 13:02:46.555505  8696 ts_tablet_manager.cc:1403] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.023s
I20260709 13:02:46.558043  8696 raft_consensus.cc:359] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.558890  8696 raft_consensus.cc:740] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.559777  8696 consensus_queue.cc:260] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:46.561342  8696 ts_tablet_manager.cc:1434] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:46.593197  8776 raft_consensus.cc:3060] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.681551   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:55.735498  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e294669f34040248436fbc8c97e5087"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:60498
I20260709 13:02:55.736346  8145 raft_consensus.cc:606] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:55.747170  8072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47e337f219804508a9d4c890819e542c"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:55.747689  8072 raft_consensus.cc:606] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:55.750408  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:60498
I20260709 13:02:55.750989  8145 raft_consensus.cc:606] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:55.753803  8147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:60498
I20260709 13:02:55.754249  8147 raft_consensus.cc:606] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:55.756402  8147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:60498
I20260709 13:02:55.756810  8147 raft_consensus.cc:606] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:55.758821  8147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:60498
I20260709 13:02:55.759219  8147 raft_consensus.cc:606] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:55.760208   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:55.761322   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:55.797544  8878 raft_consensus.cc:993] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:55.798111  8882 raft_consensus.cc:1081] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:55.799649  8777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48318
I20260709 13:02:55.800163  8777 raft_consensus.cc:493] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.800570  8777 raft_consensus.cc:3060] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.807324  8777 raft_consensus.cc:515] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:55.810998  8777 leader_election.cc:290] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 3 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:55.812109  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:55.812901  8145 raft_consensus.cc:3055] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:55.813189  8145 raft_consensus.cc:740] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:55.813198  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff8964cbfc34a829de298f8a261f5ac" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:55.813941  8072 raft_consensus.cc:3060] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.814014  8145 consensus_queue.cc:260] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:55.815145  8145 raft_consensus.cc:3060] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.820550  8072 raft_consensus.cc:2468] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 3.
I20260709 13:02:55.821651  8145 raft_consensus.cc:2468] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 3.
I20260709 13:02:55.821856  8690 leader_election.cc:304] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:55.823990  8888 raft_consensus.cc:2804] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:55.825886  8888 raft_consensus.cc:697] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 3 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:55.827299  8888 consensus_queue.cc:237] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:55.836421  8878 raft_consensus.cc:993] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:55.836830  8882 raft_consensus.cc:1081] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:55.838218  8776 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48318
I20260709 13:02:55.838702  8776 raft_consensus.cc:493] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.838994  8776 raft_consensus.cc:3060] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.840312  7820 catalog_manager.cc:5697] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 2 to 3, leader changed from 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.844012  8776 raft_consensus.cc:515] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:55.846390  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:55.846939  8145 raft_consensus.cc:3055] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:55.847193  8145 raft_consensus.cc:740] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:55.847936  8145 consensus_queue.cc:260] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:55.848954  8145 raft_consensus.cc:3060] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.849098  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e13884242a4736ae8ed6f4dc84fa69" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:55.849689  7998 raft_consensus.cc:3060] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.855345  8880 raft_consensus.cc:993] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:55.855823  8880 raft_consensus.cc:1081] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:55.856900  8145 raft_consensus.cc:2468] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:55.857839  8690 leader_election.cc:304] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:55.858387  7999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47e337f219804508a9d4c890819e542c"
dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:59964
I20260709 13:02:55.858703  8888 raft_consensus.cc:2804] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.858909  7999 raft_consensus.cc:493] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.859632  7999 raft_consensus.cc:3060] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.859668  8888 raft_consensus.cc:697] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:55.860658  8888 consensus_queue.cc:237] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:55.861199  7998 raft_consensus.cc:2468] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:55.848470  8776 leader_election.cc:290] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:55.867057  7999 raft_consensus.cc:515] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:55.871910  7999 leader_election.cc:290] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:55.872807  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e337f219804508a9d4c890819e542c" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:55.873351  8072 raft_consensus.cc:3055] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:55.873555  8882 raft_consensus.cc:993] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:55.874258  8873 raft_consensus.cc:1081] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:55.873636  8072 raft_consensus.cc:740] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:55.875407  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e337f219804508a9d4c890819e542c" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:55.875584  8072 consensus_queue.cc:260] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:55.875872  8777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e294669f34040248436fbc8c97e5087"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48318
I20260709 13:02:55.875967  8147 raft_consensus.cc:3060] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.876480  8777 raft_consensus.cc:493] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.876873  8072 raft_consensus.cc:3060] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.876910  8777 raft_consensus.cc:3060] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.885218  8147 raft_consensus.cc:2468] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:55.885804  8777 raft_consensus.cc:515] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:55.886355  7963 leader_election.cc:304] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:55.887305  8881 raft_consensus.cc:2804] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.887738  8881 raft_consensus.cc:697] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:55.889460  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:55.889154  8881 consensus_queue.cc:237] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:55.889971  8147 raft_consensus.cc:3055] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:55.890287  8147 raft_consensus.cc:740] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:55.890370  8072 raft_consensus.cc:2468] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:55.889104  8777 leader_election.cc:290] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:55.892984  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e294669f34040248436fbc8c97e5087" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:55.891060  8147 consensus_queue.cc:260] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:55.893500  7998 raft_consensus.cc:3060] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.894613  8147 raft_consensus.cc:3060] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.904583  7820 catalog_manager.cc:5697] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.906387  7998 raft_consensus.cc:2468] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:55.907873  8147 raft_consensus.cc:2468] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:55.908156  8693 leader_election.cc:304] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:55.909209  8888 raft_consensus.cc:2804] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.908697  7819 catalog_manager.cc:5697] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.909732  8888 raft_consensus.cc:697] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:55.911026  8888 consensus_queue.cc:237] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:55.928468  7819 catalog_manager.cc:5697] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.111640  8878 raft_consensus.cc:993] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:56.112080  8873 raft_consensus.cc:1081] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:56.113225  8777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48318
I20260709 13:02:56.113580  8777 raft_consensus.cc:493] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:56.113787  8777 raft_consensus.cc:3060] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.118484  8777 raft_consensus.cc:515] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:56.120128  8777 leader_election.cc:290] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:56.120796  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:56.121022  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0855572867543ee8bed7e2b29bb3005" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:56.121387  8145 raft_consensus.cc:3055] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:56.121536  7999 raft_consensus.cc:3060] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.121721  8145 raft_consensus.cc:740] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:56.122551  8145 consensus_queue.cc:260] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:56.123783  8145 raft_consensus.cc:3060] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.127657  7999 raft_consensus.cc:2468] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:56.128813  8693 leader_election.cc:304] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:56.129563  8888 raft_consensus.cc:2804] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:56.129990  8145 raft_consensus.cc:2468] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:56.129999  8888 raft_consensus.cc:697] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:56.131171  8888 consensus_queue.cc:237] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:56.139223  7819 catalog_manager.cc:5697] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.158622  8878 raft_consensus.cc:993] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:56.159087  8873 raft_consensus.cc:1081] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:56.160266  8777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48318
I20260709 13:02:56.160796  8777 raft_consensus.cc:493] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:56.161074  8777 raft_consensus.cc:3060] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.166349  8777 raft_consensus.cc:515] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:56.167874  8777 leader_election.cc:290] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:56.168459  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:56.168780  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a78d3bd51f64fda9a5f156b754231a4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:56.168972  8145 raft_consensus.cc:3055] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:56.169330  7999 raft_consensus.cc:3060] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.169363  8145 raft_consensus.cc:740] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:56.170116  8145 consensus_queue.cc:260] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:56.171205  8145 raft_consensus.cc:3060] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.175845  7999 raft_consensus.cc:2468] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:56.176877  8693 leader_election.cc:304] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:56.177574  8888 raft_consensus.cc:2804] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:56.177748  8145 raft_consensus.cc:2468] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:56.178050  8888 raft_consensus.cc:697] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:56.179919  8888 consensus_queue.cc:237] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:56.188521  7819 catalog_manager.cc:5697] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.352466  8145 raft_consensus.cc:1275] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.353716  8879 consensus_queue.cc:1048] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.367203  8072 raft_consensus.cc:1275] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 3 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:56.368367  8074 raft_consensus.cc:1275] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.370329  8902 consensus_queue.cc:1048] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:56.376682  8888 consensus_queue.cc:1048] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.381162  8148 raft_consensus.cc:1275] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.383178  8889 consensus_queue.cc:1048] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:56.402681  8147 raft_consensus.cc:1275] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:56.405797  8888 consensus_queue.cc:1048] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:56.438334  7998 raft_consensus.cc:1275] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.440752  8889 consensus_queue.cc:1048] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.498096  7998 raft_consensus.cc:1275] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.499722  8888 consensus_queue.cc:1048] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.511158  8147 raft_consensus.cc:1275] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.512745  8888 consensus_queue.cc:1048] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.563072  8148 raft_consensus.cc:1275] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.564504  8888 consensus_queue.cc:1048] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.581434  7999 raft_consensus.cc:1275] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.582715  8889 consensus_queue.cc:1048] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.603024  7999 raft_consensus.cc:1275] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.604380  8888 consensus_queue.cc:1048] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.613641  8148 raft_consensus.cc:1275] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.615068  8915 consensus_queue.cc:1048] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:56.762257   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:56.798383   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:56.837976  8148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07417a526f87454faf6742412f2e65dd"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:60498
I20260709 13:02:56.838691  8148 raft_consensus.cc:606] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:56.841197  8148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:60498
I20260709 13:02:56.841676  8148 raft_consensus.cc:606] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:56.843804  8148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:60498
I20260709 13:02:56.844313  8148 raft_consensus.cc:606] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:56.846405  8074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:56.846891  8074 raft_consensus.cc:606] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:56.849161  8074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:56.849524  8074 raft_consensus.cc:606] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:56.850369   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:56.851455   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:56.998320  8914 raft_consensus.cc:993] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:56.998885  8914 raft_consensus.cc:1081] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:57.000464  8778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48318
I20260709 13:02:57.000955  8778 raft_consensus.cc:493] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.001294  8778 raft_consensus.cc:3060] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.006615  8778 raft_consensus.cc:515] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:57.008445  8778 leader_election.cc:290] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:57.009690  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:57.010272  8148 raft_consensus.cc:3055] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:57.010627  8148 raft_consensus.cc:740] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:57.011452  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c215591dba4b6f96aab23f4aa927a3" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:57.011416  8148 consensus_queue.cc:260] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:57.012117  8072 raft_consensus.cc:3060] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.013917  8148 raft_consensus.cc:3060] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.019461  8072 raft_consensus.cc:2468] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:57.020565  8690 leader_election.cc:304] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:57.020922  8148 raft_consensus.cc:2468] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:57.021476  8889 raft_consensus.cc:2804] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:57.021965  8889 raft_consensus.cc:697] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:57.022913  8889 consensus_queue.cc:237] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:57.032565  7819 catalog_manager.cc:5697] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:57.132102  8914 raft_consensus.cc:993] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:57.132539  8914 raft_consensus.cc:1081] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:57.133948  8777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48318
I20260709 13:02:57.134426  8777 raft_consensus.cc:493] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.134788  8777 raft_consensus.cc:3060] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.139175  8777 raft_consensus.cc:515] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:57.141010  8777 leader_election.cc:290] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:57.141326  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:57.141499  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f12b86efa14c62a7abac9a5e904f02" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:57.141929  8148 raft_consensus.cc:3055] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:57.142078  7998 raft_consensus.cc:3060] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.142274  8148 raft_consensus.cc:740] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:57.143271  8148 consensus_queue.cc:260] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:57.143968  8928 raft_consensus.cc:993] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:57.144491  8148 raft_consensus.cc:3060] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.144758  8884 raft_consensus.cc:1081] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:57.146296  7999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8"
dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:59964
I20260709 13:02:57.146782  7999 raft_consensus.cc:493] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.147099  7999 raft_consensus.cc:3060] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.147981  7998 raft_consensus.cc:2468] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:57.152504  8693 leader_election.cc:304] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:57.153414  8889 raft_consensus.cc:2804] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:57.154588  8889 raft_consensus.cc:697] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:57.154572  8148 raft_consensus.cc:2468] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:57.155778  8889 consensus_queue.cc:237] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:57.158744  7999 raft_consensus.cc:515] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:57.160846  8873 raft_consensus.cc:993] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:57.161299  8873 raft_consensus.cc:1081] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:57.161834  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:57.162400  8072 raft_consensus.cc:3055] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:57.162688  7999 leader_election.cc:290] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:57.162722  8072 raft_consensus.cc:740] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:57.164106  8072 consensus_queue.cc:260] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:57.164981  8072 raft_consensus.cc:3060] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.167788  8777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07417a526f87454faf6742412f2e65dd"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48318
I20260709 13:02:57.167876  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f4e5f4ba454fe887ce0f19d5b475f8" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:57.168439  8777 raft_consensus.cc:493] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.168594  8148 raft_consensus.cc:3060] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.169210  8777 raft_consensus.cc:3060] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.171007  8072 raft_consensus.cc:2468] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:57.172216  7963 leader_election.cc:304] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:57.171993  7819 catalog_manager.cc:5697] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.173727  8923 raft_consensus.cc:2804] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:57.174193  8923 raft_consensus.cc:697] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:57.174994  8923 consensus_queue.cc:237] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:57.175887  8777 raft_consensus.cc:515] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:57.177457  8777 leader_election.cc:290] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:02:57.178440  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:57.179028  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07417a526f87454faf6742412f2e65dd" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:57.179669  7999 raft_consensus.cc:3060] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.183146  8148 raft_consensus.cc:2468] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:57.179060  8147 raft_consensus.cc:3055] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:57.185389  8147 raft_consensus.cc:740] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:02:57.186058  8147 consensus_queue.cc:260] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:57.187055  8147 raft_consensus.cc:3060] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.192519  7999 raft_consensus.cc:2468] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:57.193755  8693 leader_election.cc:304] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:57.194604  8889 raft_consensus.cc:2804] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:57.195147  8889 raft_consensus.cc:697] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:57.196086  8889 consensus_queue.cc:237] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:02:57.196684  8147 raft_consensus.cc:2468] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:57.196086  7819 catalog_manager.cc:5697] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.207813  7820 catalog_manager.cc:5697] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.232689  8880 raft_consensus.cc:993] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:57.233127  8884 raft_consensus.cc:1081] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:57.234356  8778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48328
I20260709 13:02:57.234804  8778 raft_consensus.cc:493] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.235080  8778 raft_consensus.cc:3060] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.239442  8778 raft_consensus.cc:515] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:57.240945  8778 leader_election.cc:290] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:57.241532  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:57.241874  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e60fd6b5324519ad6b01b87733d566" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:57.242129  7999 raft_consensus.cc:3060] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.242475  8072 raft_consensus.cc:3055] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:57.242805  8072 raft_consensus.cc:740] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:57.243436  8072 consensus_queue.cc:260] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:57.244406  8072 raft_consensus.cc:3060] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.246881  7999 raft_consensus.cc:2468] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:57.247934  8693 leader_election.cc:304] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:57.248728  8889 raft_consensus.cc:2804] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:57.249119  8889 raft_consensus.cc:697] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:57.249167  8072 raft_consensus.cc:2468] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:57.249969  8889 consensus_queue.cc:237] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:57.259320  7820 catalog_manager.cc:5697] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.528236  8072 raft_consensus.cc:1275] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.529366  8889 consensus_queue.cc:1048] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.553352  8148 raft_consensus.cc:1275] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.556123  8915 consensus_queue.cc:1048] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.624890  8148 raft_consensus.cc:1275] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.626358  8915 consensus_queue.cc:1048] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.631528  7999 raft_consensus.cc:1275] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.645797  8889 consensus_queue.cc:1048] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.694016  8148 raft_consensus.cc:1275] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.695065  8902 consensus_queue.cc:1048] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.704092  8072 raft_consensus.cc:1275] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.705891  8923 consensus_queue.cc:1048] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.744849  7999 raft_consensus.cc:1275] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.746063  8889 consensus_queue.cc:1048] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.758234  8148 raft_consensus.cc:1275] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.759513  8889 consensus_queue.cc:1048] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.774441  7999 raft_consensus.cc:1275] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.775676  8889 consensus_queue.cc:1048] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.787137  8072 raft_consensus.cc:1275] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:57.789057  8888 consensus_queue.cc:1048] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.852275   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:57.899421   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:57.936419  8072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "326598313429494cb184f94c8b0ee3b9"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:57.936920  8072 raft_consensus.cc:606] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:57.938993  8072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:57.939419  8072 raft_consensus.cc:606] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:57.941248  8072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "983879845d1844958e5fd90a18c596ee"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:57.941639  8072 raft_consensus.cc:606] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:57.943765  8072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:57.944147  8072 raft_consensus.cc:606] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:57.946374  8072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:57.946781  8072 raft_consensus.cc:606] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:57.947678   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:57.948725   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:58.004920  8928 raft_consensus.cc:993] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:58.005497  8928 raft_consensus.cc:1081] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:58.006786  7999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8"
dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:59964
I20260709 13:02:58.007265  7999 raft_consensus.cc:493] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.007540  7999 raft_consensus.cc:3060] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.012272  7999 raft_consensus.cc:515] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:58.013823  7999 leader_election.cc:290] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:58.014457  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:58.014739  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:58.015094  8072 raft_consensus.cc:3055] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.015313  8147 raft_consensus.cc:3060] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.015462  8072 raft_consensus.cc:740] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:58.016228  8072 consensus_queue.cc:260] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:58.017436  8072 raft_consensus.cc:3060] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.021718  8147 raft_consensus.cc:2468] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:58.023373  7963 leader_election.cc:304] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:58.024048  8072 raft_consensus.cc:2468] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:58.024082  8902 raft_consensus.cc:2804] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:58.024920  8902 raft_consensus.cc:697] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:58.025839  8902 consensus_queue.cc:237] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:58.037627  7821 catalog_manager.cc:5697] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.083215  8928 raft_consensus.cc:993] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:58.083786  8880 raft_consensus.cc:1081] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:58.085264  8778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "983879845d1844958e5fd90a18c596ee"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48328
I20260709 13:02:58.085656  8778 raft_consensus.cc:493] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.085943  8778 raft_consensus.cc:3060] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.092409  8778 raft_consensus.cc:515] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:58.095361  8778 leader_election.cc:290] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:58.096812  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:58.097376  7998 raft_consensus.cc:3060] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.107074  7998 raft_consensus.cc:2468] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:58.100221  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983879845d1844958e5fd90a18c596ee" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:58.107601  8072 raft_consensus.cc:3055] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.107949  8072 raft_consensus.cc:740] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:58.108731  8072 consensus_queue.cc:260] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:58.109949  8072 raft_consensus.cc:3060] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.116403  8072 raft_consensus.cc:2468] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:58.117425  8690 leader_election.cc:304] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:02:58.118427  8888 raft_consensus.cc:2804] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:58.119107  8888 raft_consensus.cc:697] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:58.120091  8888 consensus_queue.cc:237] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:58.135665  8880 raft_consensus.cc:993] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:58.136080  8880 raft_consensus.cc:1081] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:58.137645  8778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48328
I20260709 13:02:58.138248  8778 raft_consensus.cc:493] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.140149  8778 raft_consensus.cc:3060] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.149145  8778 raft_consensus.cc:515] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:58.150839  8778 leader_election.cc:290] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:58.152433  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:58.152941  8147 raft_consensus.cc:3060] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.158077  7821 catalog_manager.cc:5697] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.160647  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f75e786cc94c4cee9ae8ce44a2a42f47" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:58.161238  8074 raft_consensus.cc:3055] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.161494  8074 raft_consensus.cc:740] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:58.162168  8074 consensus_queue.cc:260] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:58.163350  8074 raft_consensus.cc:3060] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.171285  8147 raft_consensus.cc:2468] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:58.172309  8690 leader_election.cc:304] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c8a837918d478fb10b627dfdbf90e4, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:58.173131  8889 raft_consensus.cc:2804] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:58.173563  8889 raft_consensus.cc:697] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:58.174268  8889 consensus_queue.cc:237] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } }
I20260709 13:02:58.177516  8074 raft_consensus.cc:2468] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:58.190006  7821 catalog_manager.cc:5697] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.256145  8884 raft_consensus.cc:993] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:58.256721  8880 raft_consensus.cc:1081] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:58.257872  7999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "326598313429494cb184f94c8b0ee3b9"
dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:59964
I20260709 13:02:58.258323  7999 raft_consensus.cc:493] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.258600  7999 raft_consensus.cc:3060] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.262851  7999 raft_consensus.cc:515] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:58.264304  7999 leader_election.cc:290] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:58.264909  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326598313429494cb184f94c8b0ee3b9" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:58.265218  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326598313429494cb184f94c8b0ee3b9" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:58.265498  8074 raft_consensus.cc:3055] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.265820  8147 raft_consensus.cc:3060] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.265851  8074 raft_consensus.cc:740] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:58.266793  8074 consensus_queue.cc:260] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:58.267935  8074 raft_consensus.cc:3060] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.272087  8147 raft_consensus.cc:2468] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:58.273144  7963 leader_election.cc:304] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:58.273542  8074 raft_consensus.cc:2468] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:58.273908  8942 raft_consensus.cc:2804] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:58.274442  8942 raft_consensus.cc:697] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:58.275236  8942 consensus_queue.cc:237] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:58.283977  7821 catalog_manager.cc:5697] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.346079  8928 raft_consensus.cc:993] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:58.346585  8880 raft_consensus.cc:1081] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:58.348058  8778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48328
I20260709 13:02:58.348580  8778 raft_consensus.cc:493] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.348853  8778 raft_consensus.cc:3060] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.353627  8778 raft_consensus.cc:515] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:58.355109  8778 leader_election.cc:290] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:58.355726  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:58.356026  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdc7706f4fd4d82beebc68dd83efef4" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:58.356319  7999 raft_consensus.cc:3060] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.356581  8072 raft_consensus.cc:3055] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.356920  8072 raft_consensus.cc:740] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:58.357578  8072 consensus_queue.cc:260] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:58.358425  8072 raft_consensus.cc:3060] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.360983  7999 raft_consensus.cc:2468] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:58.362162  8693 leader_election.cc:304] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:58.362943  8888 raft_consensus.cc:2804] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:58.363629  8888 raft_consensus.cc:697] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:58.364370  8888 consensus_queue.cc:237] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:58.365295  8072 raft_consensus.cc:2468] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:58.373045  7821 catalog_manager.cc:5697] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.454449  8148 raft_consensus.cc:1275] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.455660  8902 consensus_queue.cc:1048] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.471719  8072 raft_consensus.cc:1275] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.473595  8942 consensus_queue.cc:1048] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.606251  7999 raft_consensus.cc:1275] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.607458  8915 consensus_queue.cc:1048] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.622686  8072 raft_consensus.cc:1275] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.624248  8947 consensus_queue.cc:1048] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:58.710644  8147 raft_consensus.cc:1275] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.712060  8947 consensus_queue.cc:1048] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.723681  8069 raft_consensus.cc:1275] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.725706  8947 consensus_queue.cc:1048] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.758970  8148 raft_consensus.cc:1275] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.760219  8902 consensus_queue.cc:1048] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.763362  8069 raft_consensus.cc:1275] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.765914  8942 consensus_queue.cc:1048] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.868640  7998 raft_consensus.cc:1275] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.869745  8947 consensus_queue.cc:1048] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.881117  8069 raft_consensus.cc:1275] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:58.882412  8947 consensus_queue.cc:1048] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.949395   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:58.991242   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:59.027781  8072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:59.028357  8072 raft_consensus.cc:606] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 17a4c4b3539b43108ef3481121d982bd
I20260709 13:02:59.030704  8072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9"
dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:53662
I20260709 13:02:59.031059  8072 raft_consensus.cc:606] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:02:59.031945   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:59.033561   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:59.057521  8928 raft_consensus.cc:993] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:59.058025  8880 raft_consensus.cc:1081] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 17a4c4b3539b43108ef3481121d982bd to start an election
I20260709 13:02:59.059208  7998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373"
dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
 from {username='slave'} at 127.0.0.1:59964
I20260709 13:02:59.059635  7998 raft_consensus.cc:493] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.059912  7998 raft_consensus.cc:3060] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.065233  7998 raft_consensus.cc:515] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:59.066722  7998 leader_election.cc:290] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Requested vote from peers cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745), 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391)
I20260709 13:02:59.067265  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:59.067561  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab13524d2b346b598a1dba6c6756373" candidate_uuid: "17a4c4b3539b43108ef3481121d982bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:02:59.067857  8072 raft_consensus.cc:3055] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.068112  8147 raft_consensus.cc:3060] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.068198  8072 raft_consensus.cc:740] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:59.069060  8072 consensus_queue.cc:260] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:59.070188  8072 raft_consensus.cc:3060] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.074107  8147 raft_consensus.cc:2468] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:59.075227  7963 leader_election.cc:304] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 87b2df8987cd4ac0b02b0632752c3a24; no voters: 
I20260709 13:02:59.075906  8902 raft_consensus.cc:2804] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:59.076316  8902 raft_consensus.cc:697] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Becoming Leader. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:02:59.076336  8072 raft_consensus.cc:2468] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a4c4b3539b43108ef3481121d982bd in term 2.
I20260709 13:02:59.077124  8902 consensus_queue.cc:237] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:02:59.085903  7821 catalog_manager.cc:5697] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 17a4c4b3539b43108ef3481121d982bd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "17a4c4b3539b43108ef3481121d982bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.399768  8880 raft_consensus.cc:993] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:59.400230  8928 raft_consensus.cc:1081] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:02:59.401499  8778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48328
I20260709 13:02:59.401938  8778 raft_consensus.cc:493] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.402211  8778 raft_consensus.cc:3060] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.406467  8778 raft_consensus.cc:515] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:59.408787  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:02:59.409024  8778 leader_election.cc:290] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:02:59.409313  7999 raft_consensus.cc:3060] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.409137  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49a6e4bb1e842ee88622db4dca5eca9" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:02:59.410058  8069 raft_consensus.cc:3055] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.410358  8069 raft_consensus.cc:740] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7af07a29d1443b8a3c4a3770d52344, State: Running, Role: LEADER
I20260709 13:02:59.411084  8069 consensus_queue.cc:260] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:59.411932  8069 raft_consensus.cc:3060] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.414183  7999 raft_consensus.cc:2468] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:59.415328  8693 leader_election.cc:304] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:02:59.416105  8947 raft_consensus.cc:2804] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:59.416558  8947 raft_consensus.cc:697] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:02:59.417316  8947 consensus_queue.cc:237] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } }
I20260709 13:02:59.417788  8069 raft_consensus.cc:2468] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:02:59.425892  7821 catalog_manager.cc:5697] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.584959  8148 raft_consensus.cc:1275] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.586043  8902 consensus_queue.cc:1048] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.602952  8069 raft_consensus.cc:1275] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 17a4c4b3539b43108ef3481121d982bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.604413  8942 consensus_queue.cc:1048] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.944332  7998 raft_consensus.cc:1275] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.945631  8947 consensus_queue.cc:1048] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.954978  8072 raft_consensus.cc:1275] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.956270  8947 consensus_queue.cc:1048] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.034411   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:00.081373   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:00.128182  8000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8"
dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
mode: GRACEFUL
new_leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
 from {username='slave'} at 127.0.0.1:40146
I20260709 13:03:00.128683  8000 raft_consensus.cc:606] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Received request to transfer leadership to TS 87b2df8987cd4ac0b02b0632752c3a24
I20260709 13:03:00.129827   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:00.130990   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:00.632557  8942 raft_consensus.cc:993] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd: : Instructing follower 87b2df8987cd4ac0b02b0632752c3a24 to start an election
I20260709 13:03:00.633082  8942 raft_consensus.cc:1081] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Signalling peer 87b2df8987cd4ac0b02b0632752c3a24 to start an election
I20260709 13:03:00.634289  8147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
 from {username='slave'} at 127.0.0.1:36296
I20260709 13:03:00.634779  8147 raft_consensus.cc:493] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:00.635064  8147 raft_consensus.cc:3060] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.639164  8147 raft_consensus.cc:515] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:03:00.641108  8147 leader_election.cc:290] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 election: Requested vote from peers 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125), cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745)
I20260709 13:03:00.641626  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:03:00.642017  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74617d411849f2a2d0ffb987f974a8" candidate_uuid: "87b2df8987cd4ac0b02b0632752c3a24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc7af07a29d1443b8a3c4a3770d52344"
I20260709 13:03:00.642249  8000 raft_consensus.cc:3055] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:00.642549  8000 raft_consensus.cc:740] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17a4c4b3539b43108ef3481121d982bd, State: Running, Role: LEADER
I20260709 13:03:00.642572  8072 raft_consensus.cc:3060] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.643393  8000 consensus_queue.cc:260] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:03:00.644560  8000 raft_consensus.cc:3060] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.648924  8072 raft_consensus.cc:2468] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 3.
I20260709 13:03:00.650066  8111 leader_election.cc:304] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24, cc7af07a29d1443b8a3c4a3770d52344; no voters: 
I20260709 13:03:00.650660  8988 raft_consensus.cc:2804] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:00.650727  8000 raft_consensus.cc:2468] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b2df8987cd4ac0b02b0632752c3a24 in term 3.
I20260709 13:03:00.651247  8988 raft_consensus.cc:697] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 LEADER]: Becoming Leader. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:03:00.652083  8988 consensus_queue.cc:237] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } }
I20260709 13:03:00.660033  7821 catalog_manager.cc:5697] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 reported cstate change: term changed from 2 to 3, leader changed from 17a4c4b3539b43108ef3481121d982bd (127.0.107.194) to 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "87b2df8987cd4ac0b02b0632752c3a24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:01.124168  7963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39391, user_credentials={real_user=slave}} blocked reactor thread for 82632.7us
I20260709 13:03:01.132373   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:01.167220  8069 raft_consensus.cc:1275] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 3 FOLLOWER]: Refusing update from remote peer 87b2df8987cd4ac0b02b0632752c3a24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:01.170466  8996 consensus_queue.cc:1048] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7af07a29d1443b8a3c4a3770d52344" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:01.201009  7963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39391, user_credentials={real_user=slave}} blocked reactor thread for 43647.9us
I20260709 13:03:01.270016  7998 raft_consensus.cc:1275] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 3 FOLLOWER]: Refusing update from remote peer 87b2df8987cd4ac0b02b0632752c3a24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:01.272984  8988 consensus_queue.cc:1048] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:01.321115   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:01.361080  8147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b"
dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
mode: GRACEFUL
new_leader_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:60498
I20260709 13:03:01.361611  8147 raft_consensus.cc:606] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Received request to transfer leadership to TS 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:03:01.362917   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:01.364019   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:01.901201  8996 raft_consensus.cc:993] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24: : Instructing follower 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:03:01.901999  8996 raft_consensus.cc:1081] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Signalling peer 77c8a837918d478fb10b627dfdbf90e4 to start an election
I20260709 13:03:01.903672  8777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b"
dest_uuid: "77c8a837918d478fb10b627dfdbf90e4"
 from {username='slave'} at 127.0.0.1:48318
I20260709 13:03:01.904265  8777 raft_consensus.cc:493] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:01.904616  8777 raft_consensus.cc:3060] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.910354  8777 raft_consensus.cc:515] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:03:01.912094  8777 leader_election.cc:290] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Requested vote from peers 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196:39391), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
I20260709 13:03:01.913030  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87b2df8987cd4ac0b02b0632752c3a24"
I20260709 13:03:01.913327  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11950f22bed418aa2dbf7639e0bfb9b" candidate_uuid: "77c8a837918d478fb10b627dfdbf90e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17a4c4b3539b43108ef3481121d982bd"
I20260709 13:03:01.913676  8145 raft_consensus.cc:3055] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:01.913952  7999 raft_consensus.cc:3060] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.913990  8145 raft_consensus.cc:740] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87b2df8987cd4ac0b02b0632752c3a24, State: Running, Role: LEADER
I20260709 13:03:01.914979  8145 consensus_queue.cc:260] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:03:01.915970  8145 raft_consensus.cc:3060] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.919539  7999 raft_consensus.cc:2468] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:03:01.920892  8693 leader_election.cc:304] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4; no voters: 
I20260709 13:03:01.921808  8999 raft_consensus.cc:2804] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:01.922329  8999 raft_consensus.cc:697] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Becoming Leader. State: Replica: 77c8a837918d478fb10b627dfdbf90e4, State: Running, Role: LEADER
I20260709 13:03:01.922921  8145 raft_consensus.cc:2468] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c8a837918d478fb10b627dfdbf90e4 in term 2.
I20260709 13:03:01.923343  8999 consensus_queue.cc:237] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:03:01.931809  7821 catalog_manager.cc:5697] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 reported cstate change: term changed from 1 to 2, leader changed from 87b2df8987cd4ac0b02b0632752c3a24 (127.0.107.196) to 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "77c8a837918d478fb10b627dfdbf90e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.364879   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:02.400972   431 tablet_server.cc:179] TabletServer@127.0.107.193:40547 shutting down...
I20260709 13:03:02.445664   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:02.446619   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.447809   431 raft_consensus.cc:2243] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.448297   431 raft_consensus.cc:2272] T 81919804d363474eb3975b2d6a675ac0 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.451370   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.452118   431 raft_consensus.cc:2243] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.452539   431 raft_consensus.cc:2272] T 767b01527e0d42ab9f574cee3fbbeaf9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.455262   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.455811   431 raft_consensus.cc:2243] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.456617   431 raft_consensus.cc:2272] T 72f12b86efa14c62a7abac9a5e904f02 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.458920   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.459542   431 raft_consensus.cc:2243] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.460594   431 raft_consensus.cc:2272] T 9ff8964cbfc34a829de298f8a261f5ac P 77c8a837918d478fb10b627dfdbf90e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.467608   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.468281   431 raft_consensus.cc:2243] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.468721   431 raft_consensus.cc:2272] T be12bd60158949b196454b71328950b3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.471163   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.471767   431 raft_consensus.cc:2243] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.472611   431 raft_consensus.cc:2272] T b1e60fd6b5324519ad6b01b87733d566 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.475188   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.475785   431 raft_consensus.cc:2243] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.476217   431 raft_consensus.cc:2272] T 88cafbe600ba4345a1a6fd83c004006b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.478454   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.479285   431 raft_consensus.cc:2243] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.479738   431 raft_consensus.cc:2272] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.482811   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.483439   431 raft_consensus.cc:2243] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.484324   431 raft_consensus.cc:2272] T 983879845d1844958e5fd90a18c596ee P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.486125  7999 raft_consensus.cc:1275] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Refusing update from remote peer 77c8a837918d478fb10b627dfdbf90e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:02.487625   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.488718   431 raft_consensus.cc:2243] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.488474  8986 consensus_queue.cc:1048] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:02.489331   431 raft_consensus.cc:2272] T 3b266a15c0d446148dc910d00fe07d0f P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.489864  8037 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 224 similar messages]
I20260709 13:03:02.492717   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.494064   431 raft_consensus.cc:2243] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.495193   431 raft_consensus.cc:2272] T 0e5c76efc53c42d2858b26bbd9765c31 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.499346   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.500439   431 raft_consensus.cc:2243] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.500942   431 raft_consensus.cc:2272] T 1bb31e8f2e434d26bb70e47682995df3 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.504345   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.505024   431 raft_consensus.cc:2243] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.505949   431 pending_rounds.cc:70] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Trying to abort 1 pending ops.
I20260709 13:03:02.506232   431 pending_rounds.cc:77] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634537166475264 op_type: NO_OP noop_request { }
I20260709 13:03:02.506664   431 raft_consensus.cc:2889] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:02.507047   431 raft_consensus.cc:2272] T b11950f22bed418aa2dbf7639e0bfb9b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.510197  8037 consensus_peers.cc:597] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.511222   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.512423   431 raft_consensus.cc:2243] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.513043   431 raft_consensus.cc:2272] T c1f6e282d9af4b97b6361970cce263c2 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.515410  7963 consensus_peers.cc:597] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.516458   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:02.517351  8037 consensus_peers.cc:597] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.517361   431 raft_consensus.cc:2243] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.518401   431 raft_consensus.cc:2272] T d49a6e4bb1e842ee88622db4dca5eca9 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.520676   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.521508   431 raft_consensus.cc:2243] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.522593   431 raft_consensus.cc:2272] T 2e294669f34040248436fbc8c97e5087 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.525094   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.525619   431 raft_consensus.cc:2243] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.526059   431 raft_consensus.cc:2272] T d912e9dce93246b191ef13bbfe19b004 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.528787   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.529568   431 raft_consensus.cc:2243] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.530102   431 raft_consensus.cc:2272] T 1b60099f55e74a53b4e0533192c560dd P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.532622  7963 consensus_peers.cc:597] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.533248   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.533978   431 raft_consensus.cc:2243] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.534423   431 raft_consensus.cc:2272] T 08b5a7ece3ac41af97886d7a3aff6f0f P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.536931   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.537529   431 raft_consensus.cc:2243] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.537921   431 raft_consensus.cc:2272] T 1b0220849a2f497ebf0514d72a9dfddb P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.540335   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.541038   431 raft_consensus.cc:2243] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.541527   431 raft_consensus.cc:2272] T 3ece29e9f66146e0bca321315b184bcc P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.543974   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.544526   431 raft_consensus.cc:2243] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.544900   431 raft_consensus.cc:2272] T e8f247634f9942119a6d67c513aa16ab P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.546975   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.547667   431 raft_consensus.cc:2243] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.548259   431 raft_consensus.cc:2272] T ffeecb381a054a5e834ec07d2a92c30b P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.550937   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.551486   431 raft_consensus.cc:2243] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.551879   431 raft_consensus.cc:2272] T 25ad60198ae44613945d4f009def4097 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.553948   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.554509   431 raft_consensus.cc:2243] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.554915   431 raft_consensus.cc:2272] T 4dc05153abdb4954a1da06558e4961d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.557178   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.557827   431 raft_consensus.cc:2243] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.558347   431 raft_consensus.cc:2272] T 35aead4728d347f19af0f42f8cdef593 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.561861   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.562604   431 raft_consensus.cc:2243] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.563695   431 raft_consensus.cc:2272] T b5e13884242a4736ae8ed6f4dc84fa69 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.566608  8111 consensus_peers.cc:597] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.566855   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.567852   431 raft_consensus.cc:2243] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:02.567910  8037 consensus_peers.cc:597] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.568077  8111 consensus_peers.cc:597] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.568781   431 raft_consensus.cc:2272] T f75e786cc94c4cee9ae8ce44a2a42f47 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.570812   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.571319   431 raft_consensus.cc:2243] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.572153   431 raft_consensus.cc:2272] T efdc7706f4fd4d82beebc68dd83efef4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.574939  8037 consensus_peers.cc:597] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.575039   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.575927   431 raft_consensus.cc:2243] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.576469   431 raft_consensus.cc:2272] T c4dc3d5be218446ebeebf6018140a264 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.576967  8111 consensus_peers.cc:597] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.577682  8111 consensus_peers.cc:597] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.579681   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.580432   431 raft_consensus.cc:2243] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.580933   431 raft_consensus.cc:2272] T 2079bb44476c41ef908915825b1fa87c P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.581243  8037 consensus_peers.cc:597] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.583537   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.584154   431 raft_consensus.cc:2243] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.584969   431 raft_consensus.cc:2272] T 20c215591dba4b6f96aab23f4aa927a3 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.587052   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.587589   431 raft_consensus.cc:2243] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.588501   431 raft_consensus.cc:2272] T 07417a526f87454faf6742412f2e65dd P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.590719   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.591454   431 raft_consensus.cc:2243] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.591934   431 raft_consensus.cc:2272] T 99565f0cecd744f18755d8039eabf963 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.594990   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.595662   431 raft_consensus.cc:2243] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.596172   431 raft_consensus.cc:2272] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.596299  8111 consensus_peers.cc:597] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.598531   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.599200   431 raft_consensus.cc:2243] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.599815   431 raft_consensus.cc:2272] T aefeddccd22947cb8bb9c24c3688456f P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.602806   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:02.603323  7963 consensus_peers.cc:597] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.603549   431 raft_consensus.cc:2243] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.604813   431 raft_consensus.cc:2272] T 4a78d3bd51f64fda9a5f156b754231a4 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.607249   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.607800   431 raft_consensus.cc:2243] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.608201   431 raft_consensus.cc:2272] T d0d3c0e1e8574b868e633347d9be591b P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.610435   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.611140   431 raft_consensus.cc:2243] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.611546   431 raft_consensus.cc:2272] T 69487ed068ba41aeabc5dddafc528950 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.614214   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.614908   431 raft_consensus.cc:2243] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.615517   431 raft_consensus.cc:2272] T 91a8f59ad4a54890b1b6e01058db213e P 77c8a837918d478fb10b627dfdbf90e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.618003   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.618505   431 raft_consensus.cc:2243] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.618878   431 raft_consensus.cc:2272] T a9da43a750ef48788d4da9f817f17b3c P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.620992   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.621464   431 raft_consensus.cc:2243] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.621816   431 raft_consensus.cc:2272] T 393c51858bb34dbda6f73fc33e498bca P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.623770   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.624202   431 raft_consensus.cc:2243] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.624536   431 raft_consensus.cc:2272] T 731b36cb6f91433d818856a5aa867b7d P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.626442   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.626891   431 raft_consensus.cc:2243] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.627631   431 raft_consensus.cc:2272] T f0855572867543ee8bed7e2b29bb3005 P 77c8a837918d478fb10b627dfdbf90e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.629778   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:02.630241   431 raft_consensus.cc:2243] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.630610   431 raft_consensus.cc:2272] T 623d31b1b0e94c7580c2403f41e8a553 P 77c8a837918d478fb10b627dfdbf90e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.639284  8037 consensus_peers.cc:597] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.657231  8037 consensus_peers.cc:597] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.661091  8037 consensus_peers.cc:597] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.674398  8111 consensus_peers.cc:597] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.681995  7963 consensus_peers.cc:597] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.682832  8037 consensus_peers.cc:597] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.684346  8111 consensus_peers.cc:597] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.699117   431 tablet_server.cc:196] TabletServer@127.0.107.193:40547 shutdown complete.
W20260709 13:03:02.707494  8111 consensus_peers.cc:597] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.714586  8111 consensus_peers.cc:597] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.754738  7963 consensus_peers.cc:597] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.778791  7963 consensus_peers.cc:597] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.786397   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:02.786877  7963 consensus_peers.cc:597] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.797179  7963 consensus_peers.cc:597] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.806007  8037 consensus_peers.cc:597] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.816424  8111 consensus_peers.cc:597] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:02.828035  8040 consensus_peers.cc:597] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.841670   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:02.843582   431 tablet_replica.cc:333] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.844606   431 raft_consensus.cc:2243] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.845188   431 raft_consensus.cc:2272] T 767b01527e0d42ab9f574cee3fbbeaf9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.846473  8114 consensus_peers.cc:597] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.848137   431 tablet_replica.cc:333] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.849102   431 raft_consensus.cc:2243] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.849702   431 raft_consensus.cc:2272] T 07417a526f87454faf6742412f2e65dd P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.852701   431 tablet_replica.cc:333] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.853617   431 raft_consensus.cc:2243] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.854120   431 raft_consensus.cc:2272] T 25ad60198ae44613945d4f009def4097 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.857038   431 tablet_replica.cc:333] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.857884   431 raft_consensus.cc:2243] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.858911   431 raft_consensus.cc:2272] T b5968d0a9e5b4f10b650229017d01068 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.861238  8040 consensus_peers.cc:597] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.861820   431 tablet_replica.cc:333] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.862725   431 raft_consensus.cc:2243] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.863258   431 raft_consensus.cc:2272] T 983879845d1844958e5fd90a18c596ee P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.866153   431 tablet_replica.cc:333] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.867019   431 raft_consensus.cc:2243] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.868068   431 raft_consensus.cc:2272] T a9da43a750ef48788d4da9f817f17b3c P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.870810   431 tablet_replica.cc:333] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.871552   431 raft_consensus.cc:2243] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.872087   431 raft_consensus.cc:2272] T 7a51a0a61adf4ce19d7ce6f958f2451b P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.875089   431 tablet_replica.cc:333] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.875854   431 raft_consensus.cc:2243] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.876408   431 raft_consensus.cc:2272] T b1e60fd6b5324519ad6b01b87733d566 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.879313   431 tablet_replica.cc:333] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.880077   431 raft_consensus.cc:2243] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.880589   431 raft_consensus.cc:2272] T 3e74617d411849f2a2d0ffb987f974a8 P 17a4c4b3539b43108ef3481121d982bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.883368   431 tablet_replica.cc:333] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.884178   431 raft_consensus.cc:2243] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.884752   431 raft_consensus.cc:2272] T f7ec32e1ae354730b6b9edf944d5e934 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.887748   431 tablet_replica.cc:333] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.888566   431 raft_consensus.cc:2243] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.889173   431 raft_consensus.cc:2272] T 72f12b86efa14c62a7abac9a5e904f02 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.889575  8037 consensus_peers.cc:597] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.891875   431 tablet_replica.cc:333] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.892889   431 raft_consensus.cc:2243] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.893473   431 raft_consensus.cc:2272] T c4dc3d5be218446ebeebf6018140a264 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.896291   431 tablet_replica.cc:333] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.897051   431 raft_consensus.cc:2243] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.897621   431 raft_consensus.cc:2272] T 2079bb44476c41ef908915825b1fa87c P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.900463   431 tablet_replica.cc:333] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.901252   431 raft_consensus.cc:2243] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.901857   431 raft_consensus.cc:2272] T efdc7706f4fd4d82beebc68dd83efef4 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.904785   431 tablet_replica.cc:333] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.905547   431 raft_consensus.cc:2243] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.906157   431 raft_consensus.cc:2272] T 3b266a15c0d446148dc910d00fe07d0f P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.907485  8040 consensus_peers.cc:597] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.908842   431 tablet_replica.cc:333] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.909577   431 raft_consensus.cc:2243] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.910565   431 raft_consensus.cc:2272] T 326598313429494cb184f94c8b0ee3b9 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.910779  8040 consensus_peers.cc:597] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.912791   431 tablet_replica.cc:333] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.913434   431 raft_consensus.cc:2243] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.913801   431 raft_consensus.cc:2272] T c1f6e282d9af4b97b6361970cce263c2 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.915731   431 tablet_replica.cc:333] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.916231   431 raft_consensus.cc:2243] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.917059   431 raft_consensus.cc:2272] T 47e337f219804508a9d4c890819e542c P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.919092   431 tablet_replica.cc:333] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.919741   431 raft_consensus.cc:2243] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.920212   431 raft_consensus.cc:2272] T 35aead4728d347f19af0f42f8cdef593 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.922749   431 tablet_replica.cc:333] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
W20260709 13:03:02.923146  8114 consensus_peers.cc:597] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.923502   431 raft_consensus.cc:2243] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.924086   431 raft_consensus.cc:2272] T b5e13884242a4736ae8ed6f4dc84fa69 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.926787   431 tablet_replica.cc:333] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.927443   431 raft_consensus.cc:2243] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.928445   431 raft_consensus.cc:2272] T aab13524d2b346b598a1dba6c6756373 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.930576   431 tablet_replica.cc:333] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.931218   431 raft_consensus.cc:2243] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.932039   431 raft_consensus.cc:2272] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.934165   431 tablet_replica.cc:333] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.934751   431 raft_consensus.cc:2243] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.935168   431 raft_consensus.cc:2272] T 3ece29e9f66146e0bca321315b184bcc P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.937304   431 tablet_replica.cc:333] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.937868   431 raft_consensus.cc:2243] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.938628   431 raft_consensus.cc:2272] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.940728   431 tablet_replica.cc:333] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.941269   431 raft_consensus.cc:2243] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.942051   431 raft_consensus.cc:2272] T 99565f0cecd744f18755d8039eabf963 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.944144   431 tablet_replica.cc:333] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.944746   431 raft_consensus.cc:2243] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.945230   431 pending_rounds.cc:70] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd: Trying to abort 1 pending ops.
I20260709 13:03:02.945478   431 pending_rounds.cc:77] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634537166475264 op_type: NO_OP noop_request { }
I20260709 13:03:02.945823   431 raft_consensus.cc:2889] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:02.946168   431 raft_consensus.cc:2272] T b11950f22bed418aa2dbf7639e0bfb9b P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.951597   431 tablet_replica.cc:333] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.952409   431 raft_consensus.cc:2243] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.952913   431 raft_consensus.cc:2272] T f0855572867543ee8bed7e2b29bb3005 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.955628   431 tablet_replica.cc:333] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.956395   431 raft_consensus.cc:2243] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.956933   431 raft_consensus.cc:2272] T 731b36cb6f91433d818856a5aa867b7d P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.959723   431 tablet_replica.cc:333] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.960420   431 raft_consensus.cc:2243] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.961413   431 raft_consensus.cc:2272] T 623d31b1b0e94c7580c2403f41e8a553 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.962714  8111 consensus_peers.cc:597] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.964103   431 tablet_replica.cc:333] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.964983   431 raft_consensus.cc:2243] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.965997   431 raft_consensus.cc:2272] T 4ca6d20b17dd439abc7de41f57b0e344 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.968894   431 tablet_replica.cc:333] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
W20260709 13:03:02.969135  8040 consensus_peers.cc:597] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.969588   431 raft_consensus.cc:2243] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.970266   431 raft_consensus.cc:2272] T 4a78d3bd51f64fda9a5f156b754231a4 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.972937   431 tablet_replica.cc:333] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.973732   431 raft_consensus.cc:2243] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:02.973954  8111 consensus_peers.cc:597] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Couldn't send request to peer 77c8a837918d478fb10b627dfdbf90e4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.974787   431 raft_consensus.cc:2272] T aefeddccd22947cb8bb9c24c3688456f P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.977830   431 tablet_replica.cc:333] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.978554   431 raft_consensus.cc:2243] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.979573   431 raft_consensus.cc:2272] T 9ce49c9d02c14d8b97ea4388e1928362 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.982416   431 tablet_replica.cc:333] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.983099   431 raft_consensus.cc:2243] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.984185   431 raft_consensus.cc:2272] T 69487ed068ba41aeabc5dddafc528950 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.986920   431 tablet_replica.cc:333] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.987694   431 raft_consensus.cc:2243] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.988250   431 raft_consensus.cc:2272] T e761965cbcb44c408a097b79b0899da0 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.990820   431 tablet_replica.cc:333] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.991468   431 raft_consensus.cc:2243] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.991940   431 raft_consensus.cc:2272] T a1559ecc34a84f3bbfc97b60579b1ecd P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.994386   431 tablet_replica.cc:333] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.994979   431 raft_consensus.cc:2243] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.995474   431 raft_consensus.cc:2272] T 91a8f59ad4a54890b1b6e01058db213e P 17a4c4b3539b43108ef3481121d982bd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.996878  8040 consensus_peers.cc:597] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.997527   431 tablet_replica.cc:333] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:02.998121   431 raft_consensus.cc:2243] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.998533   431 raft_consensus.cc:2272] T 7bc94f423a414af7b77b41c61009a3a7 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.000557   431 tablet_replica.cc:333] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:03.001153   431 raft_consensus.cc:2243] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.001565   431 raft_consensus.cc:2272] T 2e294669f34040248436fbc8c97e5087 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.004055   431 tablet_replica.cc:333] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:03.004714   431 raft_consensus.cc:2243] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.005213   431 raft_consensus.cc:2272] T d49a6e4bb1e842ee88622db4dca5eca9 P 17a4c4b3539b43108ef3481121d982bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.007797   431 tablet_replica.cc:333] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:03.008402   431 raft_consensus.cc:2243] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.009178   431 raft_consensus.cc:2272] T c30f9c4ed64f49d4a6b1e484c334a1a9 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.011490   431 tablet_replica.cc:333] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:03.012126   431 raft_consensus.cc:2243] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.012603   431 raft_consensus.cc:2272] T f05f3e48c8014333a190a26992b87f9d P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.014010  8040 consensus_peers.cc:597] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.015110   431 tablet_replica.cc:333] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:03.015777   431 raft_consensus.cc:2243] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.016294   431 raft_consensus.cc:2272] T 1bb31e8f2e434d26bb70e47682995df3 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.017884  8114 consensus_peers.cc:597] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.018821   431 tablet_replica.cc:333] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd: stopping tablet replica
I20260709 13:03:03.019299   431 raft_consensus.cc:2243] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.019987   431 raft_consensus.cc:2272] T be12bd60158949b196454b71328950b3 P 17a4c4b3539b43108ef3481121d982bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.063688  8040 consensus_peers.cc:597] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:03.099099  8114 consensus_peers.cc:597] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:03.113425  8114 consensus_peers.cc:597] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:03.121824  8114 consensus_peers.cc:597] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.129323   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:03.139003  8040 consensus_peers.cc:597] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:03.147331  8040 consensus_peers.cc:597] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:03.195814  8040 consensus_peers.cc:597] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.209388   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:03.262203   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:03.263099   431 tablet_replica.cc:333] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.263993   431 raft_consensus.cc:2243] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.264587   431 raft_consensus.cc:2272] T b5968d0a9e5b4f10b650229017d01068 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.267015   431 tablet_replica.cc:333] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.267580   431 raft_consensus.cc:2243] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.267967   431 raft_consensus.cc:2272] T f75e786cc94c4cee9ae8ce44a2a42f47 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.269873   431 tablet_replica.cc:333] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.270375   431 raft_consensus.cc:2243] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.271150   431 raft_consensus.cc:2272] T 25ad60198ae44613945d4f009def4097 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.273378   431 tablet_replica.cc:333] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.274185   431 raft_consensus.cc:2243] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.274761   431 raft_consensus.cc:2272] T 20c215591dba4b6f96aab23f4aa927a3 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.275277  8111 consensus_peers.cc:597] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.276971   431 tablet_replica.cc:333] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.277650   431 raft_consensus.cc:2243] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.278095   431 raft_consensus.cc:2272] T 7a51a0a61adf4ce19d7ce6f958f2451b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.280160   431 tablet_replica.cc:333] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.280733   431 raft_consensus.cc:2243] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.281144   431 raft_consensus.cc:2272] T 983879845d1844958e5fd90a18c596ee P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.283160   431 tablet_replica.cc:333] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.283726   431 raft_consensus.cc:2243] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.284161   431 raft_consensus.cc:2272] T b1e60fd6b5324519ad6b01b87733d566 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.285962   431 tablet_replica.cc:333] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.286561   431 raft_consensus.cc:2243] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.287014   431 raft_consensus.cc:2272] T 88cafbe600ba4345a1a6fd83c004006b P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.288818   431 tablet_replica.cc:333] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.289402   431 raft_consensus.cc:2243] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.289826   431 raft_consensus.cc:2272] T 3e74617d411849f2a2d0ffb987f974a8 P cc7af07a29d1443b8a3c4a3770d52344 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.291980   431 tablet_replica.cc:333] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.292742   431 raft_consensus.cc:2243] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.293304   431 raft_consensus.cc:2272] T 81919804d363474eb3975b2d6a675ac0 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.295328   431 tablet_replica.cc:333] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.295881   431 raft_consensus.cc:2243] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.296639   431 raft_consensus.cc:2272] T 3b266a15c0d446148dc910d00fe07d0f P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.298418   431 tablet_replica.cc:333] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.298996   431 raft_consensus.cc:2243] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.299468   431 raft_consensus.cc:2272] T 326598313429494cb184f94c8b0ee3b9 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.301247   431 tablet_replica.cc:333] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.301736   431 raft_consensus.cc:2243] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.302450   431 raft_consensus.cc:2272] T d0d3c0e1e8574b868e633347d9be591b P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.304910   431 tablet_replica.cc:333] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.305691   431 raft_consensus.cc:2243] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.306247   431 raft_consensus.cc:2272] T a1559ecc34a84f3bbfc97b60579b1ecd P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.308634  8114 consensus_peers.cc:597] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Couldn't send request to peer 17a4c4b3539b43108ef3481121d982bd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.308938   431 tablet_replica.cc:333] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.309607   431 raft_consensus.cc:2243] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.310283   431 raft_consensus.cc:2272] T c4dc3d5be218446ebeebf6018140a264 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.312193   431 tablet_replica.cc:333] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.312711   431 raft_consensus.cc:2243] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.313401   431 raft_consensus.cc:2272] T 2079bb44476c41ef908915825b1fa87c P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.315375   431 tablet_replica.cc:333] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.316006   431 raft_consensus.cc:2243] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.316370   431 raft_consensus.cc:2272] T efdc7706f4fd4d82beebc68dd83efef4 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.318038   431 tablet_replica.cc:333] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.318655   431 raft_consensus.cc:2243] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.319509   431 raft_consensus.cc:2272] T 7bc94f423a414af7b77b41c61009a3a7 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.322146   431 tablet_replica.cc:333] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.322960   431 raft_consensus.cc:2243] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.323563   431 raft_consensus.cc:2272] T d49a6e4bb1e842ee88622db4dca5eca9 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.326261   431 tablet_replica.cc:333] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.327054   431 raft_consensus.cc:2243] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.327558   431 raft_consensus.cc:2272] T d912e9dce93246b191ef13bbfe19b004 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.329463  8111 consensus_peers.cc:597] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.330255   431 tablet_replica.cc:333] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.331117   431 raft_consensus.cc:2243] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.332087   431 raft_consensus.cc:2272] T f7ec32e1ae354730b6b9edf944d5e934 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.332226  8111 consensus_peers.cc:597] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.334910   431 tablet_replica.cc:333] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.335692   431 raft_consensus.cc:2243] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.336213   431 raft_consensus.cc:2272] T 99565f0cecd744f18755d8039eabf963 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.338819   431 tablet_replica.cc:333] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.339550   431 raft_consensus.cc:2243] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.340047   431 raft_consensus.cc:2272] T 393c51858bb34dbda6f73fc33e498bca P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.342566   431 tablet_replica.cc:333] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.343115   431 raft_consensus.cc:2243] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.343816   431 raft_consensus.cc:2272] T 731b36cb6f91433d818856a5aa867b7d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.345517   431 tablet_replica.cc:333] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.345993   431 raft_consensus.cc:2243] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.346338   431 raft_consensus.cc:2272] T 623d31b1b0e94c7580c2403f41e8a553 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.348134   431 tablet_replica.cc:333] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.348588   431 raft_consensus.cc:2243] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.348944   431 raft_consensus.cc:2272] T 4ca6d20b17dd439abc7de41f57b0e344 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.350822   431 tablet_replica.cc:333] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.351290   431 raft_consensus.cc:2243] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.351692   431 raft_consensus.cc:2272] T 9ff8964cbfc34a829de298f8a261f5ac P cc7af07a29d1443b8a3c4a3770d52344 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.353404   431 tablet_replica.cc:333] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.353883   431 raft_consensus.cc:2243] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.354327   431 raft_consensus.cc:2272] T ffeecb381a054a5e834ec07d2a92c30b P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.356482   431 tablet_replica.cc:333] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.357164   431 raft_consensus.cc:2243] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:03.357591  8111 consensus_peers.cc:597] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.357678   431 raft_consensus.cc:2272] T e8f247634f9942119a6d67c513aa16ab P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.359879   431 tablet_replica.cc:333] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.360446   431 raft_consensus.cc:2243] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.360867   431 raft_consensus.cc:2272] T be12bd60158949b196454b71328950b3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.363029   431 tablet_replica.cc:333] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.363561   431 raft_consensus.cc:2243] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.364095   431 raft_consensus.cc:2272] T 9ce49c9d02c14d8b97ea4388e1928362 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.366894   431 tablet_replica.cc:333] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.367702   431 raft_consensus.cc:2243] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.368688   431 raft_consensus.cc:2272] T 1b60099f55e74a53b4e0533192c560dd P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.371495   431 tablet_replica.cc:333] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.372278   431 raft_consensus.cc:2243] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:03.372557  8111 consensus_peers.cc:597] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:03.373256  8111 consensus_peers.cc:597] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.373297   431 raft_consensus.cc:2272] T 1b0220849a2f497ebf0514d72a9dfddb P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.375723   431 tablet_replica.cc:333] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.376297   431 raft_consensus.cc:2243] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.376731   431 raft_consensus.cc:2272] T 08b5a7ece3ac41af97886d7a3aff6f0f P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.379093   431 tablet_replica.cc:333] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.379662   431 raft_consensus.cc:2243] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.380125   431 raft_consensus.cc:2272] T aab13524d2b346b598a1dba6c6756373 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.382131   431 tablet_replica.cc:333] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.382735   431 raft_consensus.cc:2243] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.383172   431 raft_consensus.cc:2272] T e1f4e5f4ba454fe887ce0f19d5b475f8 P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.385092   431 tablet_replica.cc:333] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.385599   431 raft_consensus.cc:2243] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.386018   431 raft_consensus.cc:2272] T c30f9c4ed64f49d4a6b1e484c334a1a9 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.387954   431 tablet_replica.cc:333] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.388459   431 raft_consensus.cc:2243] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.389194   431 raft_consensus.cc:2272] T f05f3e48c8014333a190a26992b87f9d P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.391053   431 tablet_replica.cc:333] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.391535   431 raft_consensus.cc:2243] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.392258   431 raft_consensus.cc:2272] T 0e5c76efc53c42d2858b26bbd9765c31 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.394104   431 tablet_replica.cc:333] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.394588   431 raft_consensus.cc:2243] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.395416   431 raft_consensus.cc:2272] T 1bb31e8f2e434d26bb70e47682995df3 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.397275   431 tablet_replica.cc:333] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.397763   431 raft_consensus.cc:2243] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.398638   431 raft_consensus.cc:2272] T e761965cbcb44c408a097b79b0899da0 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.400846   431 tablet_replica.cc:333] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.401299   431 raft_consensus.cc:2243] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.401921   431 raft_consensus.cc:2272] T 47e337f219804508a9d4c890819e542c P cc7af07a29d1443b8a3c4a3770d52344 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.403961   431 tablet_replica.cc:333] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.404526   431 raft_consensus.cc:2243] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.404934   431 raft_consensus.cc:2272] T 4dc05153abdb4954a1da06558e4961d8 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.406955   431 tablet_replica.cc:333] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344: stopping tablet replica
I20260709 13:03:03.407397   431 raft_consensus.cc:2243] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.408151   431 raft_consensus.cc:2272] T 35aead4728d347f19af0f42f8cdef593 P cc7af07a29d1443b8a3c4a3770d52344 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.471549  8111 consensus_peers.cc:597] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:43745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.478830   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:03:03.480340  8111 consensus_peers.cc:597] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:43745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:03.524065  8111 consensus_peers.cc:597] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:43745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.558655   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:03:03.577126  8996 raft_consensus.cc:493] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77c8a837918d478fb10b627dfdbf90e4)
I20260709 13:03:03.577924  8996 raft_consensus.cc:515] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b2df8987cd4ac0b02b0632752c3a24" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39391 } } peers { permanent_uuid: "77c8a837918d478fb10b627dfdbf90e4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40547 } } peers { permanent_uuid: "17a4c4b3539b43108ef3481121d982bd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36125 } }
I20260709 13:03:03.580566  8996 leader_election.cc:290] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547), 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125)
W20260709 13:03:03.588418  8114 leader_election.cc:336] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17a4c4b3539b43108ef3481121d982bd (127.0.107.194:36125): Network error: Client connection negotiation failed: client connection to 127.0.107.194:36125: connect: Connection refused (error 111)
W20260709 13:03:03.592582  8111 leader_election.cc:336] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 77c8a837918d478fb10b627dfdbf90e4 (127.0.107.193:40547): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40547: connect: Connection refused (error 111)
I20260709 13:03:03.593071  8111 leader_election.cc:304] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87b2df8987cd4ac0b02b0632752c3a24; no voters: 17a4c4b3539b43108ef3481121d982bd, 77c8a837918d478fb10b627dfdbf90e4
I20260709 13:03:03.593957  9027 raft_consensus.cc:2749] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:03.607892   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:03.608608   431 tablet_replica.cc:333] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.609226   431 raft_consensus.cc:2243] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.610100   431 raft_consensus.cc:2272] T 767b01527e0d42ab9f574cee3fbbeaf9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.612075   431 tablet_replica.cc:333] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.612601   431 raft_consensus.cc:2243] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.613065   431 raft_consensus.cc:2272] T f75e786cc94c4cee9ae8ce44a2a42f47 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.614990   431 tablet_replica.cc:333] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.615515   431 raft_consensus.cc:2243] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.615949   431 raft_consensus.cc:2272] T 7f6cabe1c12e4d4293ddb5333b2562d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.618340   431 tablet_replica.cc:333] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.619150   431 raft_consensus.cc:2243] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.619663   431 raft_consensus.cc:2272] T b5968d0a9e5b4f10b650229017d01068 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.621721   431 tablet_replica.cc:333] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.622289   431 raft_consensus.cc:2243] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.622749   431 raft_consensus.cc:2272] T a9da43a750ef48788d4da9f817f17b3c P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.624584   431 tablet_replica.cc:333] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.625097   431 raft_consensus.cc:2243] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.625900   431 raft_consensus.cc:2272] T 7a51a0a61adf4ce19d7ce6f958f2451b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.627779   431 tablet_replica.cc:333] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.628314   431 raft_consensus.cc:2243] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.628715   431 raft_consensus.cc:2272] T 07417a526f87454faf6742412f2e65dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.631203   431 tablet_replica.cc:333] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.631767   431 raft_consensus.cc:2243] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.632189   431 raft_consensus.cc:2272] T 20c215591dba4b6f96aab23f4aa927a3 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.633936   431 tablet_replica.cc:333] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.634654   431 raft_consensus.cc:2243] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.635447   431 raft_consensus.cc:2272] T 393c51858bb34dbda6f73fc33e498bca P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.637131   431 tablet_replica.cc:333] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.637611   431 raft_consensus.cc:2243] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.637962   431 raft_consensus.cc:2272] T f0855572867543ee8bed7e2b29bb3005 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.640136   431 tablet_replica.cc:333] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.640748   431 raft_consensus.cc:2243] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.641700   431 raft_consensus.cc:2272] T 88cafbe600ba4345a1a6fd83c004006b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.643716   431 tablet_replica.cc:333] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.644335   431 raft_consensus.cc:2243] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.645154   431 raft_consensus.cc:2272] T 3e74617d411849f2a2d0ffb987f974a8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.647413   431 tablet_replica.cc:333] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.647985   431 raft_consensus.cc:2243] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.648466   431 raft_consensus.cc:2272] T f05f3e48c8014333a190a26992b87f9d P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.650279   431 tablet_replica.cc:333] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.650796   431 raft_consensus.cc:2243] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.651132   431 raft_consensus.cc:2272] T 0e5c76efc53c42d2858b26bbd9765c31 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.652842   431 tablet_replica.cc:333] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.653304   431 raft_consensus.cc:2243] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.653642   431 raft_consensus.cc:2272] T 72f12b86efa14c62a7abac9a5e904f02 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.655521   431 tablet_replica.cc:333] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.656081   431 raft_consensus.cc:2243] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.656535   431 raft_consensus.cc:2272] T f7ec32e1ae354730b6b9edf944d5e934 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.658798   431 tablet_replica.cc:333] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.659247   431 raft_consensus.cc:2243] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.659919   431 raft_consensus.cc:2272] T ffeecb381a054a5e834ec07d2a92c30b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.661782   431 tablet_replica.cc:333] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.662276   431 raft_consensus.cc:2243] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.663116   431 raft_consensus.cc:2272] T e8f247634f9942119a6d67c513aa16ab P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.664913   431 tablet_replica.cc:333] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.665405   431 raft_consensus.cc:2243] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.665791   431 raft_consensus.cc:2272] T 326598313429494cb184f94c8b0ee3b9 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.667604   431 tablet_replica.cc:333] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.668064   431 raft_consensus.cc:2243] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.668406   431 raft_consensus.cc:2272] T aab13524d2b346b598a1dba6c6756373 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.670113   431 tablet_replica.cc:333] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.670614   431 raft_consensus.cc:2243] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.671043   431 raft_consensus.cc:2272] T e1f4e5f4ba454fe887ce0f19d5b475f8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.672909   431 tablet_replica.cc:333] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.673380   431 raft_consensus.cc:2243] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.674054   431 raft_consensus.cc:2272] T 3ece29e9f66146e0bca321315b184bcc P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.675853   431 tablet_replica.cc:333] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.676333   431 raft_consensus.cc:2243] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.676671   431 raft_consensus.cc:2272] T 7bc94f423a414af7b77b41c61009a3a7 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.678501   431 tablet_replica.cc:333] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.679088   431 raft_consensus.cc:2243] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.679512   431 raft_consensus.cc:2272] T 2e294669f34040248436fbc8c97e5087 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.681293   431 tablet_replica.cc:333] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.681840   431 raft_consensus.cc:2243] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.682542   431 raft_consensus.cc:2272] T d912e9dce93246b191ef13bbfe19b004 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.684746   431 tablet_replica.cc:333] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.685351   431 raft_consensus.cc:2243] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.685751   431 raft_consensus.cc:2272] T 1b60099f55e74a53b4e0533192c560dd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.687424  8111 consensus_peers.cc:597] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 -> Peer cc7af07a29d1443b8a3c4a3770d52344 (127.0.107.195:43745): Couldn't send request to peer cc7af07a29d1443b8a3c4a3770d52344. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:43745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.687719   431 tablet_replica.cc:333] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.688369   431 raft_consensus.cc:2243] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.689069   431 raft_consensus.cc:2272] T 08b5a7ece3ac41af97886d7a3aff6f0f P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.691004   431 tablet_replica.cc:333] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.691522   431 raft_consensus.cc:2243] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.691936   431 raft_consensus.cc:2272] T 1b0220849a2f497ebf0514d72a9dfddb P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.693782   431 tablet_replica.cc:333] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.694305   431 raft_consensus.cc:2243] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.695271   431 raft_consensus.cc:2272] T 4dc05153abdb4954a1da06558e4961d8 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.697242   431 tablet_replica.cc:333] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.697767   431 raft_consensus.cc:2243] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.698165   431 raft_consensus.cc:2272] T b5e13884242a4736ae8ed6f4dc84fa69 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.700107   431 tablet_replica.cc:333] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.700637   431 raft_consensus.cc:2243] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.701047   431 raft_consensus.cc:2272] T 9ff8964cbfc34a829de298f8a261f5ac P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.702972   431 tablet_replica.cc:333] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.703464   431 raft_consensus.cc:2243] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.703850   431 raft_consensus.cc:2272] T 9ce49c9d02c14d8b97ea4388e1928362 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.705597   431 tablet_replica.cc:333] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.706089   431 raft_consensus.cc:2243] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.706499   431 raft_consensus.cc:2272] T 69487ed068ba41aeabc5dddafc528950 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.708339   431 tablet_replica.cc:333] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.708845   431 raft_consensus.cc:2243] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.709287   431 raft_consensus.cc:2272] T e761965cbcb44c408a097b79b0899da0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.711138   431 tablet_replica.cc:333] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.711620   431 raft_consensus.cc:2243] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.712003   431 raft_consensus.cc:2272] T b11950f22bed418aa2dbf7639e0bfb9b P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.713779   431 tablet_replica.cc:333] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.714288   431 raft_consensus.cc:2243] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.715111   431 raft_consensus.cc:2272] T 81919804d363474eb3975b2d6a675ac0 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.716915   431 tablet_replica.cc:333] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.717401   431 raft_consensus.cc:2243] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.718088   431 raft_consensus.cc:2272] T c1f6e282d9af4b97b6361970cce263c2 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.719806   431 tablet_replica.cc:333] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.720263   431 raft_consensus.cc:2243] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.720671   431 raft_consensus.cc:2272] T 47e337f219804508a9d4c890819e542c P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.722389   431 tablet_replica.cc:333] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.722925   431 raft_consensus.cc:2243] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.723290   431 raft_consensus.cc:2272] T d0d3c0e1e8574b868e633347d9be591b P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.725100   431 tablet_replica.cc:333] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.725567   431 raft_consensus.cc:2243] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.726280   431 raft_consensus.cc:2272] T a1559ecc34a84f3bbfc97b60579b1ecd P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.728113   431 tablet_replica.cc:333] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.728590   431 raft_consensus.cc:2243] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.729252   431 raft_consensus.cc:2272] T 91a8f59ad4a54890b1b6e01058db213e P 87b2df8987cd4ac0b02b0632752c3a24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.731097   431 tablet_replica.cc:333] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.731616   431 raft_consensus.cc:2243] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.732019   431 raft_consensus.cc:2272] T 4ca6d20b17dd439abc7de41f57b0e344 P 87b2df8987cd4ac0b02b0632752c3a24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.733875   431 tablet_replica.cc:333] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.734323   431 raft_consensus.cc:2243] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.734720   431 raft_consensus.cc:2272] T aefeddccd22947cb8bb9c24c3688456f P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.736517   431 tablet_replica.cc:333] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24: stopping tablet replica
I20260709 13:03:03.736958   431 raft_consensus.cc:2243] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.737358   431 raft_consensus.cc:2272] T 4a78d3bd51f64fda9a5f156b754231a4 P 87b2df8987cd4ac0b02b0632752c3a24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.802146   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:03.862529   431 master.cc:562] Master@127.0.107.254:34449 shutting down...
I20260709 13:03:03.887063   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.887630   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.887979   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7d9d53d74e944dc38d0ff7befa59eaab: stopping tablet replica
I20260709 13:03:03.910254   431 master.cc:584] Master@127.0.107.254:34449 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32223 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:03:03.994485   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38735
I20260709 13:03:03.995645   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.001463  9032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.001464  9031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.001821  9034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.003701   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.004715   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:04.004884   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.005002   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184004985 us; error 0 us; skew 500 ppm
I20260709 13:03:04.005455   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.007694   431 webserver.cc:533] Webserver started at http://127.0.107.254:35235/ using document root <none> and password file <none>
I20260709 13:03:04.008124   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.008275   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.008481   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.009496   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/master-0-root/instance:
uuid: "faf01ea9d5b24cfb99fccd8a21ddef89"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-szgt"
I20260709 13:03:04.013789   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:04.016829  9039 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.017521   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:04.017802   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/master-0-root
uuid: "faf01ea9d5b24cfb99fccd8a21ddef89"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-szgt"
I20260709 13:03:04.018078   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.045207   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.046433   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.083770   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38735
I20260709 13:03:04.083874  9090 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38735 every 8 connection(s)
I20260709 13:03:04.087571  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.097496  9091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89: Bootstrap starting.
I20260709 13:03:04.102002  9091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.105888  9091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89: No bootstrap required, opened a new log
I20260709 13:03:04.107905  9091 raft_consensus.cc:359] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faf01ea9d5b24cfb99fccd8a21ddef89" member_type: VOTER }
I20260709 13:03:04.108255  9091 raft_consensus.cc:385] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.108428  9091 raft_consensus.cc:740] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf01ea9d5b24cfb99fccd8a21ddef89, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.108913  9091 consensus_queue.cc:260] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faf01ea9d5b24cfb99fccd8a21ddef89" member_type: VOTER }
I20260709 13:03:04.109292  9091 raft_consensus.cc:399] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:04.109470  9091 raft_consensus.cc:493] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:04.109668  9091 raft_consensus.cc:3060] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:04.113734  9091 raft_consensus.cc:515] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faf01ea9d5b24cfb99fccd8a21ddef89" member_type: VOTER }
I20260709 13:03:04.114156  9091 leader_election.cc:304] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: faf01ea9d5b24cfb99fccd8a21ddef89; no voters: 
I20260709 13:03:04.115171  9091 leader_election.cc:290] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:04.115496  9094 raft_consensus.cc:2804] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:04.116788  9094 raft_consensus.cc:697] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 1 LEADER]: Becoming Leader. State: Replica: faf01ea9d5b24cfb99fccd8a21ddef89, State: Running, Role: LEADER
I20260709 13:03:04.117439  9094 consensus_queue.cc:237] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faf01ea9d5b24cfb99fccd8a21ddef89" member_type: VOTER }
I20260709 13:03:04.118122  9091 sys_catalog.cc:565] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:04.122161  9096 sys_catalog.cc:455] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader faf01ea9d5b24cfb99fccd8a21ddef89. Latest consensus state: current_term: 1 leader_uuid: "faf01ea9d5b24cfb99fccd8a21ddef89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faf01ea9d5b24cfb99fccd8a21ddef89" member_type: VOTER } }
I20260709 13:03:04.122970  9096 sys_catalog.cc:458] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:04.123766  9095 sys_catalog.cc:455] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "faf01ea9d5b24cfb99fccd8a21ddef89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faf01ea9d5b24cfb99fccd8a21ddef89" member_type: VOTER } }
I20260709 13:03:04.124222  9095 sys_catalog.cc:458] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:04.125212  9101 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:04.131125  9101 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:04.133487   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:04.139285  9101 catalog_manager.cc:1383] Generated new cluster ID: d83a9ae119cc45a799da024dbbc7f264
I20260709 13:03:04.139515  9101 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:04.163659  9101 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:04.164908  9101 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:04.187666  9101 catalog_manager.cc:6070] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89: Generated new TSK 0
I20260709 13:03:04.188218  9101 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:04.200089   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.205690  9112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.206578  9113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.207964  9115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.208169   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.209125   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:04.209300   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.209416   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184209406 us; error 0 us; skew 500 ppm
I20260709 13:03:04.209868   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.212071   431 webserver.cc:533] Webserver started at http://127.0.107.193:42683/ using document root <none> and password file <none>
I20260709 13:03:04.212507   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.212654   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.212863   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.213850   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-0-root/instance:
uuid: "7ca8b1e786984ac581ce2308f04f2efd"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-szgt"
I20260709 13:03:04.217918   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:03:04.221259  9120 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.221971   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:04.222246   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "7ca8b1e786984ac581ce2308f04f2efd"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-szgt"
I20260709 13:03:04.222527   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.234884   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.236024   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.237401   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:04.239593   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:04.239816   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.240051   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:04.240231   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.278625   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42813
I20260709 13:03:04.278802  9182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42813 every 8 connection(s)
I20260709 13:03:04.283654   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.290441  9187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.292220  9188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.295264  9190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.295825   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.296851   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:04.297205   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.297395   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184297362 us; error 0 us; skew 500 ppm
I20260709 13:03:04.297966   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.300854  9183 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38735
I20260709 13:03:04.300876   431 webserver.cc:533] Webserver started at http://127.0.107.194:44689/ using document root <none> and password file <none>
I20260709 13:03:04.301222  9183 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:04.301602   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.301899   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.301977  9183 heartbeater.cc:507] Master 127.0.107.254:38735 requested a full tablet report, sending...
I20260709 13:03:04.302165   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.303745   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-1-root/instance:
uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-szgt"
I20260709 13:03:04.304312  9056 ts_manager.cc:194] Registered new tserver with Master: 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813)
I20260709 13:03:04.306797  9056 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40034
I20260709 13:03:04.309674   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:03:04.313002  9195 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.313733   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:03:04.314007   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-1-root
uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-szgt"
I20260709 13:03:04.314272   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.340353   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.341562   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.342968   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:04.345130   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:04.345322   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.345578   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:04.345746   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.383492   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:42647
I20260709 13:03:04.383605  9257 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:42647 every 8 connection(s)
I20260709 13:03:04.388093   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.395499  9261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.396732  9262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.399765  9264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.400615   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.400897  9258 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38735
I20260709 13:03:04.401321  9258 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:04.401542   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:04.401803   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.401975   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184401955 us; error 0 us; skew 500 ppm
I20260709 13:03:04.402062  9258 heartbeater.cc:507] Master 127.0.107.254:38735 requested a full tablet report, sending...
I20260709 13:03:04.402558   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.404263  9056 ts_manager.cc:194] Registered new tserver with Master: b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:04.405264   431 webserver.cc:533] Webserver started at http://127.0.107.195:43699/ using document root <none> and password file <none>
I20260709 13:03:04.405916   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.406152   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.406088  9056 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40046
I20260709 13:03:04.406646   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.408157   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-2-root/instance:
uuid: "a6bcc62f665849f09a58081d7e222a3a"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-szgt"
I20260709 13:03:04.412442   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:03:04.415323  9269 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.416100   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:04.416409   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-2-root
uuid: "a6bcc62f665849f09a58081d7e222a3a"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-szgt"
I20260709 13:03:04.416663   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.426487   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.427603   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.428997   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:04.431006   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:04.431221   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.431437   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:04.431599   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.470003   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:36001
I20260709 13:03:04.470103  9331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:36001 every 8 connection(s)
I20260709 13:03:04.483423  9332 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38735
I20260709 13:03:04.483839  9332 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:04.484535  9332 heartbeater.cc:507] Master 127.0.107.254:38735 requested a full tablet report, sending...
I20260709 13:03:04.486333  9056 ts_manager.cc:194] Registered new tserver with Master: a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:04.487423   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014263371s
I20260709 13:03:04.487633  9056 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40062
I20260709 13:03:04.509822  9056 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40076:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:04.513012  9056 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:04.579852  9222 tablet_service.cc:1511] Processing CreateTablet for tablet 9223119a5d98444daf976419d90c6670 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:04.579869  9223 tablet_service.cc:1511] Processing CreateTablet for tablet b329f33dd9274eac8826771258e523d0 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:04.581362  9222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9223119a5d98444daf976419d90c6670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.582085  9223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b329f33dd9274eac8826771258e523d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.582974  9221 tablet_service.cc:1511] Processing CreateTablet for tablet 9541ba20e9a54ecc9113862db343c20f (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:04.583788  9146 tablet_service.cc:1511] Processing CreateTablet for tablet 9541ba20e9a54ecc9113862db343c20f (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:04.584290  9221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9541ba20e9a54ecc9113862db343c20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.585057  9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9541ba20e9a54ecc9113862db343c20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.587568  9220 tablet_service.cc:1511] Processing CreateTablet for tablet 7309aee806f04e2c8f5aa13f7f7c2b12 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:04.587792  9147 tablet_service.cc:1511] Processing CreateTablet for tablet 9223119a5d98444daf976419d90c6670 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:04.588886  9220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7309aee806f04e2c8f5aa13f7f7c2b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.588987  9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9223119a5d98444daf976419d90c6670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.591157  9148 tablet_service.cc:1511] Processing CreateTablet for tablet b329f33dd9274eac8826771258e523d0 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:04.592777  9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b329f33dd9274eac8826771258e523d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.597556  9145 tablet_service.cc:1511] Processing CreateTablet for tablet 7309aee806f04e2c8f5aa13f7f7c2b12 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:04.599023  9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7309aee806f04e2c8f5aa13f7f7c2b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.601877  9144 tablet_service.cc:1511] Processing CreateTablet for tablet 58e28affd5924541bad949653a73740b (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:04.603364  9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e28affd5924541bad949653a73740b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.606503  9219 tablet_service.cc:1511] Processing CreateTablet for tablet 58e28affd5924541bad949653a73740b (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:04.607878  9219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e28affd5924541bad949653a73740b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.613775  9143 tablet_service.cc:1511] Processing CreateTablet for tablet e5bf8bdbc6a945418a3e8aa01a4b977d (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:04.615336  9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bf8bdbc6a945418a3e8aa01a4b977d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.619706  9218 tablet_service.cc:1511] Processing CreateTablet for tablet e5bf8bdbc6a945418a3e8aa01a4b977d (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:04.621434  9218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bf8bdbc6a945418a3e8aa01a4b977d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.628788  9142 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7fb139d10643b5895afb2306ed6ca8 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:04.629344  9297 tablet_service.cc:1511] Processing CreateTablet for tablet b329f33dd9274eac8826771258e523d0 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:04.630195  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7fb139d10643b5895afb2306ed6ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.630712  9297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b329f33dd9274eac8826771258e523d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.632964  9296 tablet_service.cc:1511] Processing CreateTablet for tablet 9223119a5d98444daf976419d90c6670 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:04.635572  9296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9223119a5d98444daf976419d90c6670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.648764  9295 tablet_service.cc:1511] Processing CreateTablet for tablet 9541ba20e9a54ecc9113862db343c20f (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:04.650123  9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9541ba20e9a54ecc9113862db343c20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.656188  9217 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7fb139d10643b5895afb2306ed6ca8 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:04.657596  9217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7fb139d10643b5895afb2306ed6ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.665373  9294 tablet_service.cc:1511] Processing CreateTablet for tablet 7309aee806f04e2c8f5aa13f7f7c2b12 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:04.666744  9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7309aee806f04e2c8f5aa13f7f7c2b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.671885  9293 tablet_service.cc:1511] Processing CreateTablet for tablet 58e28affd5924541bad949653a73740b (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:04.673240  9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e28affd5924541bad949653a73740b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.679986  9292 tablet_service.cc:1511] Processing CreateTablet for tablet e5bf8bdbc6a945418a3e8aa01a4b977d (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:04.680493  9291 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7fb139d10643b5895afb2306ed6ca8 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:04.681411  9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bf8bdbc6a945418a3e8aa01a4b977d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.682045  9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7fb139d10643b5895afb2306ed6ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.690815  9141 tablet_service.cc:1511] Processing CreateTablet for tablet 12bfecaabf1443158e39e96e1157a7e2 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:04.692723  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bfecaabf1443158e39e96e1157a7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.694445  9216 tablet_service.cc:1511] Processing CreateTablet for tablet 12bfecaabf1443158e39e96e1157a7e2 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:04.696300  9216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bfecaabf1443158e39e96e1157a7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.711633  9290 tablet_service.cc:1511] Processing CreateTablet for tablet 12bfecaabf1443158e39e96e1157a7e2 (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:04.713035  9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bfecaabf1443158e39e96e1157a7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.735368  9215 tablet_service.cc:1511] Processing CreateTablet for tablet ebef3c776ccf4521a85ae47cbb63aaee (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:04.736806  9215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebef3c776ccf4521a85ae47cbb63aaee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.736629  9289 tablet_service.cc:1511] Processing CreateTablet for tablet ebef3c776ccf4521a85ae47cbb63aaee (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:04.737988  9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebef3c776ccf4521a85ae47cbb63aaee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.744637  9148 tablet_service.cc:1511] Processing CreateTablet for tablet ebef3c776ccf4521a85ae47cbb63aaee (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:04.746131  9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebef3c776ccf4521a85ae47cbb63aaee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.798393  9349 tablet_bootstrap.cc:492] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:04.799242  9347 tablet_bootstrap.cc:492] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:04.801541  9348 tablet_bootstrap.cc:492] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:04.806111  9349 tablet_bootstrap.cc:654] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.815472  9348 tablet_bootstrap.cc:654] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.818478  9347 tablet_bootstrap.cc:654] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.827116  9291 tablet_service.cc:1511] Processing CreateTablet for tablet d76aa97c166f48d98561f2e42738778d (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:04.828485  9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76aa97c166f48d98561f2e42738778d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.828863  9349 tablet_bootstrap.cc:492] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:04.829387  9349 ts_tablet_manager.cc:1403] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.016s
I20260709 13:03:04.829731  9141 tablet_service.cc:1511] Processing CreateTablet for tablet d76aa97c166f48d98561f2e42738778d (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:04.830963  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76aa97c166f48d98561f2e42738778d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.832409  9349 raft_consensus.cc:359] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.833160  9349 raft_consensus.cc:385] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.833449  9349 raft_consensus.cc:740] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.835044  9349 consensus_queue.cc:260] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.836290  9216 tablet_service.cc:1511] Processing CreateTablet for tablet d76aa97c166f48d98561f2e42738778d (DEFAULT_TABLE table=test-workload [id=8a4a1478184143f1a4f09b4af195afed]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:04.837512  9216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76aa97c166f48d98561f2e42738778d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.841984  9347 tablet_bootstrap.cc:492] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:04.842528  9347 ts_tablet_manager.cc:1403] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.044s	user 0.004s	sys 0.011s
I20260709 13:03:04.844074  9332 heartbeater.cc:499] Master 127.0.107.254:38735 was elected leader, sending a full tablet report...
I20260709 13:03:04.845358  9349 ts_tablet_manager.cc:1434] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.004s
I20260709 13:03:04.846421  9349 tablet_bootstrap.cc:492] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:04.852209  9348 tablet_bootstrap.cc:492] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:04.852610  9349 tablet_bootstrap.cc:654] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.852742  9348 ts_tablet_manager.cc:1403] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.004s
I20260709 13:03:04.856500  9348 raft_consensus.cc:359] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.857398  9348 raft_consensus.cc:385] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.857784  9348 raft_consensus.cc:740] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.858796  9348 consensus_queue.cc:260] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.860555  9347 raft_consensus.cc:359] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.861405  9347 raft_consensus.cc:385] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.861786  9347 raft_consensus.cc:740] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.862614  9347 consensus_queue.cc:260] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.866259  9258 heartbeater.cc:499] Master 127.0.107.254:38735 was elected leader, sending a full tablet report...
I20260709 13:03:04.867313  9348 ts_tablet_manager.cc:1434] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:03:04.868405  9348 tablet_bootstrap.cc:492] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:04.874750  9348 tablet_bootstrap.cc:654] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.881613  9348 tablet_bootstrap.cc:492] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:04.882122  9348 ts_tablet_manager.cc:1403] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.007s
I20260709 13:03:04.885087  9348 raft_consensus.cc:359] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.864207  9349 tablet_bootstrap.cc:492] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:04.885773  9348 raft_consensus.cc:385] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.886137  9348 raft_consensus.cc:740] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.886394  9349 ts_tablet_manager.cc:1403] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.000s
I20260709 13:03:04.887002  9348 consensus_queue.cc:260] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
W20260709 13:03:04.888919  9259 tablet.cc:2406] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:04.889134  9348 ts_tablet_manager.cc:1434] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:03:04.890203  9348 tablet_bootstrap.cc:492] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:04.890961  9347 ts_tablet_manager.cc:1434] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.048s	user 0.016s	sys 0.011s
I20260709 13:03:04.891571  9183 heartbeater.cc:499] Master 127.0.107.254:38735 was elected leader, sending a full tablet report...
I20260709 13:03:04.891973  9347 tablet_bootstrap.cc:492] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:04.896981  9348 tablet_bootstrap.cc:654] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.896636  9349 raft_consensus.cc:359] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.897560  9349 raft_consensus.cc:385] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.897921  9349 raft_consensus.cc:740] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.898134  9347 tablet_bootstrap.cc:654] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.898823  9349 consensus_queue.cc:260] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.901234  9349 ts_tablet_manager.cc:1434] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:03:04.902516  9349 tablet_bootstrap.cc:492] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:04.908424  9348 tablet_bootstrap.cc:492] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:04.908936  9348 ts_tablet_manager.cc:1403] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:03:04.910990  9349 tablet_bootstrap.cc:654] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.911887  9348 raft_consensus.cc:359] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.912670  9348 raft_consensus.cc:385] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.912966  9348 raft_consensus.cc:740] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.913930  9348 consensus_queue.cc:260] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.918226  9348 ts_tablet_manager.cc:1434] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:03:04.919219  9348 tablet_bootstrap.cc:492] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:04.925833  9348 tablet_bootstrap.cc:654] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.937309  9348 tablet_bootstrap.cc:492] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:04.937791  9348 ts_tablet_manager.cc:1403] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:03:04.940517  9348 raft_consensus.cc:359] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.941203  9348 raft_consensus.cc:385] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.941504  9348 raft_consensus.cc:740] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.942391  9348 consensus_queue.cc:260] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.946271  9347 tablet_bootstrap.cc:492] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:04.946852  9347 ts_tablet_manager.cc:1403] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.035s
I20260709 13:03:04.946919  9348 ts_tablet_manager.cc:1434] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:04.947011  9349 tablet_bootstrap.cc:492] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:04.947748  9349 ts_tablet_manager.cc:1403] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.046s	user 0.028s	sys 0.014s
I20260709 13:03:04.948000  9348 tablet_bootstrap.cc:492] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:04.949806  9347 raft_consensus.cc:359] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.950496  9347 raft_consensus.cc:385] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.950824  9347 raft_consensus.cc:740] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.951438  9356 raft_consensus.cc:493] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.951911  9356 raft_consensus.cc:515] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.951833  9347 consensus_queue.cc:260] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.954914  9348 tablet_bootstrap.cc:654] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.958602  9356 leader_election.cc:290] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:04.950856  9349 raft_consensus.cc:359] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.967540  9349 raft_consensus.cc:385] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.968514  9349 raft_consensus.cc:740] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.970520  9349 consensus_queue.cc:260] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.971549  9348 tablet_bootstrap.cc:492] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:04.975061  9348 ts_tablet_manager.cc:1403] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.010s
I20260709 13:03:04.975382  9355 raft_consensus.cc:493] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.976028  9355 raft_consensus.cc:515] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.980484  9353 raft_consensus.cc:493] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.981110  9353 raft_consensus.cc:515] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.984498  9353 leader_election.cc:290] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:04.985257  9367 raft_consensus.cc:493] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.985764  9367 raft_consensus.cc:515] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.982537  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:04.988581  9355 leader_election.cc:290] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:04.992264  9367 leader_election.cc:290] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:04.996570  9348 raft_consensus.cc:359] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:04.997571  9348 raft_consensus.cc:385] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.997963  9348 raft_consensus.cc:740] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.998932  9348 consensus_queue.cc:260] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.001781  9348 ts_tablet_manager.cc:1434] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.007s
W20260709 13:03:05.005040  9121 leader_election.cc:343] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.005568  9348 tablet_bootstrap.cc:492] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:05.014338  9348 tablet_bootstrap.cc:654] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.026852  9348 tablet_bootstrap.cc:492] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:05.027508  9348 ts_tablet_manager.cc:1403] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:03:05.031250  9348 raft_consensus.cc:359] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.032233  9348 raft_consensus.cc:385] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.032598  9348 raft_consensus.cc:740] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.034597  9348 consensus_queue.cc:260] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.037434  9349 ts_tablet_manager.cc:1434] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 13:03:05.037464  9348 ts_tablet_manager.cc:1434] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:05.039086  9348 tablet_bootstrap.cc:492] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:05.049317  9348 tablet_bootstrap.cc:654] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.059088  9348 tablet_bootstrap.cc:492] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:05.059752  9348 ts_tablet_manager.cc:1403] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:03:05.063580  9348 raft_consensus.cc:359] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.064530  9348 raft_consensus.cc:385] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.064909  9348 raft_consensus.cc:740] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.068226  9348 consensus_queue.cc:260] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.071419  9348 ts_tablet_manager.cc:1434] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:03:05.072801  9348 tablet_bootstrap.cc:492] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:05.089285  9349 tablet_bootstrap.cc:492] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:05.091868  9158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7fb139d10643b5895afb2306ed6ca8" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.092784  9348 tablet_bootstrap.cc:654] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.094058  9158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
W20260709 13:03:05.095745  9197 leader_election.cc:343] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:05.096647  9197 leader_election.cc:343] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.099740  9347 ts_tablet_manager.cc:1434] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.153s	user 0.042s	sys 0.081s
I20260709 13:03:05.101055  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.101912  9348 tablet_bootstrap.cc:492] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:05.102397  9348 ts_tablet_manager.cc:1403] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.004s
I20260709 13:03:05.102576  9347 tablet_bootstrap.cc:492] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
W20260709 13:03:05.102957  9123 leader_election.cc:343] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.103416  9123 leader_election.cc:304] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd; no voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:05.104074  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:05.104699  9233 raft_consensus.cc:2468] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 0.
I20260709 13:03:05.105014  9348 raft_consensus.cc:359] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.105705  9348 raft_consensus.cc:385] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.105963  9348 raft_consensus.cc:740] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.106398  9270 leader_election.cc:304] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.106758  9348 consensus_queue.cc:260] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.107440  9373 raft_consensus.cc:2804] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.107842  9373 raft_consensus.cc:493] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.108166  9373 raft_consensus.cc:3060] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.110550  9348 ts_tablet_manager.cc:1434] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:05.111516  9348 tablet_bootstrap.cc:492] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:05.115583  9373 raft_consensus.cc:515] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.118032  9347 tablet_bootstrap.cc:654] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.118069  9348 tablet_bootstrap.cc:654] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.118258  9362 raft_consensus.cc:2749] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.120149  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:05.120335  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7fb139d10643b5895afb2306ed6ca8" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.120767  9233 raft_consensus.cc:3060] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.123051  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.119130  9373 leader_election.cc:290] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
W20260709 13:03:05.124166  9198 leader_election.cc:343] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.124776  9198 leader_election.cc:304] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:05.126308  9367 raft_consensus.cc:2749] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:05.127811  9198 leader_election.cc:343] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.128417  9198 leader_election.cc:304] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:05.129374  9367 raft_consensus.cc:2749] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:05.129583  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:05.134178  9233 raft_consensus.cc:2468] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 1.
I20260709 13:03:05.137058  9158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.138713  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:05.140795  9348 tablet_bootstrap.cc:492] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:05.141258  9270 leader_election.cc:304] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.141269  9348 ts_tablet_manager.cc:1403] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 13:03:05.142181  9373 raft_consensus.cc:2804] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:03:05.142740  9271 leader_election.cc:343] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.142966  9373 raft_consensus.cc:697] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
W20260709 13:03:05.143711  9271 leader_election.cc:343] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.143850  9373 consensus_queue.cc:237] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.145052  9348 raft_consensus.cc:359] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.145720  9348 raft_consensus.cc:385] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.145809  9349 tablet_bootstrap.cc:654] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.146003  9348 raft_consensus.cc:740] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.146716  9348 consensus_queue.cc:260] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.148424  9347 tablet_bootstrap.cc:492] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:05.149103  9347 ts_tablet_manager.cc:1403] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.006s
I20260709 13:03:05.149268  9348 ts_tablet_manager.cc:1434] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:05.150544  9348 tablet_bootstrap.cc:492] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77: Bootstrap starting.
I20260709 13:03:05.152344  9347 raft_consensus.cc:359] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.153076  9347 raft_consensus.cc:385] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.153402  9347 raft_consensus.cc:740] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.154132  9347 consensus_queue.cc:260] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.156481  9347 ts_tablet_manager.cc:1434] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:05.157485  9347 tablet_bootstrap.cc:492] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:05.157595  9348 tablet_bootstrap.cc:654] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.164541  9347 tablet_bootstrap.cc:654] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.164520  9055 catalog_manager.cc:5697] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.179248  9349 tablet_bootstrap.cc:492] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:05.179912  9349 ts_tablet_manager.cc:1403] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.006s
I20260709 13:03:05.183467  9349 raft_consensus.cc:359] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.184180  9349 raft_consensus.cc:385] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.184461  9349 raft_consensus.cc:740] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.185225  9349 consensus_queue.cc:260] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.187171  9367 raft_consensus.cc:493] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.187880  9367 raft_consensus.cc:515] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.191339  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.191926  9367 leader_election.cc:290] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.192343  9347 tablet_bootstrap.cc:492] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:05.191851  9348 tablet_bootstrap.cc:492] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77: No bootstrap required, opened a new log
I20260709 13:03:05.192894  9349 ts_tablet_manager.cc:1434] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:03:05.192989  9347 ts_tablet_manager.cc:1403] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.016s
I20260709 13:03:05.193154  9348 ts_tablet_manager.cc:1403] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.016s
I20260709 13:03:05.191936  9157 raft_consensus.cc:2468] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 0.
I20260709 13:03:05.194289  9349 tablet_bootstrap.cc:492] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:05.194875  9197 leader_election.cc:304] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.192833  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.196401  9347 raft_consensus.cc:359] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
W20260709 13:03:05.196768  9198 leader_election.cc:343] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.197119  9347 raft_consensus.cc:385] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.196638  9348 raft_consensus.cc:359] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.197454  9347 raft_consensus.cc:740] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.197625  9348 raft_consensus.cc:385] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.197873  9367 raft_consensus.cc:2804] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.198331  9367 raft_consensus.cc:493] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.198954  9367 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.198298  9347 consensus_queue.cc:260] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.201193  9347 ts_tablet_manager.cc:1434] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:05.202617  9347 tablet_bootstrap.cc:492] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:05.198297  9348 raft_consensus.cc:740] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.201249  9349 tablet_bootstrap.cc:654] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.206041  9348 consensus_queue.cc:260] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.206513  9367 raft_consensus.cc:515] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.209343  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:05.209920  9157 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.212225  9348 ts_tablet_manager.cc:1434] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:03:05.216466  9347 tablet_bootstrap.cc:654] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.216956  9157 raft_consensus.cc:2468] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 1.
I20260709 13:03:05.218122  9197 leader_election.cc:304] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.219044  9355 raft_consensus.cc:2804] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.226881  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
W20260709 13:03:05.228384  9198 leader_election.cc:343] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.229473  9367 leader_election.cc:290] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.232774  9355 raft_consensus.cc:697] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:05.233758  9355 consensus_queue.cc:237] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.237737  9349 tablet_bootstrap.cc:492] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:05.238291  9349 ts_tablet_manager.cc:1403] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.005s
I20260709 13:03:05.238891  9347 tablet_bootstrap.cc:492] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:05.239420  9347 ts_tablet_manager.cc:1403] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.017s
I20260709 13:03:05.241308  9349 raft_consensus.cc:359] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.242045  9349 raft_consensus.cc:385] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.242357  9349 raft_consensus.cc:740] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.242236  9347 raft_consensus.cc:359] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.243115  9347 raft_consensus.cc:385] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.243433  9347 raft_consensus.cc:740] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.243264  9349 consensus_queue.cc:260] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.243443  9054 catalog_manager.cc:5697] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 0 to 1, leader changed from <none> to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.244305  9347 consensus_queue.cc:260] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.245620  9349 ts_tablet_manager.cc:1434] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:05.246860  9362 raft_consensus.cc:493] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.247349  9362 raft_consensus.cc:515] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.249141  9373 raft_consensus.cc:493] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.249608  9362 leader_election.cc:290] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.249858  9347 ts_tablet_manager.cc:1434] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:03:05.250931  9347 tablet_bootstrap.cc:492] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:05.251257  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329f33dd9274eac8826771258e523d0" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.251897  9307 raft_consensus.cc:2468] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 0.
I20260709 13:03:05.252978  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329f33dd9274eac8826771258e523d0" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:05.253095  9123 leader_election.cc:304] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:05.253664  9233 raft_consensus.cc:2468] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 0.
I20260709 13:03:05.249639  9373 raft_consensus.cc:515] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.256036  9362 raft_consensus.cc:2804] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.256480  9362 raft_consensus.cc:493] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.257620  9373 leader_election.cc:290] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:05.257087  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e28affd5924541bad949653a73740b" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:05.258375  9233 raft_consensus.cc:2468] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 0.
I20260709 13:03:05.257722  9349 tablet_bootstrap.cc:492] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:05.259565  9270 leader_election.cc:304] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.259826  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e28affd5924541bad949653a73740b" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.257664  9362 raft_consensus.cc:3060] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:05.261904  9271 leader_election.cc:343] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.264827  9349 tablet_bootstrap.cc:654] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.262913  9355 raft_consensus.cc:493] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.257162  9347 tablet_bootstrap.cc:654] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.266990  9355 raft_consensus.cc:515] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.268015  9362 raft_consensus.cc:515] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.269747  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.260722  9373 raft_consensus.cc:2804] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.270373  9373 raft_consensus.cc:493] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.270512  9157 raft_consensus.cc:2468] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 0.
I20260709 13:03:05.270769  9373 raft_consensus.cc:3060] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.271679  9197 leader_election.cc:304] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.272744  9388 raft_consensus.cc:2804] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.273123  9388 raft_consensus.cc:493] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.273454  9388 raft_consensus.cc:3060] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.275139  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329f33dd9274eac8826771258e523d0" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:05.275831  9233 raft_consensus.cc:3060] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.277690  9373 raft_consensus.cc:515] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.279626  9373 leader_election.cc:290] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:05.280530  9362 leader_election.cc:290] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 election: Requested vote from peers b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.281625  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e28affd5924541bad949653a73740b" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:05.281628  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.282253  9232 raft_consensus.cc:3060] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.282598  9307 raft_consensus.cc:2468] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 0.
I20260709 13:03:05.284406  9233 raft_consensus.cc:2468] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 1.
I20260709 13:03:05.285849  9121 leader_election.cc:304] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.286541  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329f33dd9274eac8826771258e523d0" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:05.287155  9307 raft_consensus.cc:3060] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.287189  9362 raft_consensus.cc:2804] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.287880  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e28affd5924541bad949653a73740b" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:05.288710  9232 raft_consensus.cc:2468] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 1.
W20260709 13:03:05.289143  9271 leader_election.cc:343] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.289014  9362 raft_consensus.cc:697] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 LEADER]: Becoming Leader. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Running, Role: LEADER
I20260709 13:03:05.290163  9270 leader_election.cc:304] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 7ca8b1e786984ac581ce2308f04f2efd
I20260709 13:03:05.290416  9362 consensus_queue.cc:237] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.291391  9373 raft_consensus.cc:2804] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.291960  9373 raft_consensus.cc:697] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:05.292815  9373 consensus_queue.cc:237] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.299860  9307 raft_consensus.cc:2468] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 1.
I20260709 13:03:05.301928  9355 leader_election.cc:290] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.304965  9388 raft_consensus.cc:515] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.308022  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:05.308558  9157 raft_consensus.cc:3060] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.309669  9056 catalog_manager.cc:5697] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.314479  9157 raft_consensus.cc:2468] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 1.
I20260709 13:03:05.315358  9388 leader_election.cc:290] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.316188  9197 leader_election.cc:304] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.317974  9388 raft_consensus.cc:2804] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.318259  9347 tablet_bootstrap.cc:492] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:05.319000  9347 ts_tablet_manager.cc:1403] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.023s
I20260709 13:03:05.318845  9388 raft_consensus.cc:697] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:05.320631  9388 consensus_queue.cc:237] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.322057  9347 raft_consensus.cc:359] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.322794  9347 raft_consensus.cc:385] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.323076  9347 raft_consensus.cc:740] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.323618  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:05.324313  9307 raft_consensus.cc:3060] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.325687  9349 tablet_bootstrap.cc:492] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:05.326205  9349 ts_tablet_manager.cc:1403] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.018s
I20260709 13:03:05.326967  9056 catalog_manager.cc:5697] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "7ca8b1e786984ac581ce2308f04f2efd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.328794  9347 consensus_queue.cc:260] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.330988  9388 raft_consensus.cc:493] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.331579  9388 raft_consensus.cc:515] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.332334  9349 raft_consensus.cc:359] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.332156  9053 catalog_manager.cc:5697] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 0 to 1, leader changed from <none> to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.334626  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.335155  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.335331  9157 raft_consensus.cc:2468] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 0.
I20260709 13:03:05.334000  9388 leader_election.cc:290] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
W20260709 13:03:05.336552  9198 leader_election.cc:343] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.333062  9349 raft_consensus.cc:385] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.337174  9349 raft_consensus.cc:740] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.337108  9197 leader_election.cc:304] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:05.338056  9349 consensus_queue.cc:260] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.331125  9347 ts_tablet_manager.cc:1434] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:03:05.339495  9347 tablet_bootstrap.cc:492] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:05.333364  9307 raft_consensus.cc:2468] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 1.
I20260709 13:03:05.341907  9388 raft_consensus.cc:2804] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.342319  9388 raft_consensus.cc:493] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.342710  9388 raft_consensus.cc:3060] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.346479  9347 tablet_bootstrap.cc:654] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.344096  9349 ts_tablet_manager.cc:1434] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:03:05.350378  9349 tablet_bootstrap.cc:492] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:05.351841  9347 tablet_bootstrap.cc:492] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:05.352388  9347 ts_tablet_manager.cc:1403] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:03:05.353981  9388 raft_consensus.cc:515] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.355319  9347 raft_consensus.cc:359] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.356003  9347 raft_consensus.cc:385] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.356276  9347 raft_consensus.cc:740] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.356482  9349 tablet_bootstrap.cc:654] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.356819  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:05.357401  9157 raft_consensus.cc:3060] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.357023  9347 consensus_queue.cc:260] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.359360  9347 ts_tablet_manager.cc:1434] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:05.360391  9347 tablet_bootstrap.cc:492] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:05.361524  9373 raft_consensus.cc:493] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.362156  9373 raft_consensus.cc:515] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.364514  9157 raft_consensus.cc:2468] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 1.
I20260709 13:03:05.365744  9197 leader_election.cc:304] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.366269  9347 tablet_bootstrap.cc:654] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.367190  9355 raft_consensus.cc:2804] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.367841  9355 raft_consensus.cc:697] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:05.368243  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:05.368932  9355 consensus_queue.cc:237] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
W20260709 13:03:05.369975  9198 leader_election.cc:343] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.370848  9388 leader_election.cc:290] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.371160  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:05.373924  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.375010  9157 raft_consensus.cc:2393] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6bcc62f665849f09a58081d7e222a3a in current term 1: Already voted for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in this term.
I20260709 13:03:05.375409  9373 leader_election.cc:290] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:05.376590  9271 leader_election.cc:304] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a; no voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:05.377761  9373 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.382042  9347 tablet_bootstrap.cc:492] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:05.382507  9347 ts_tablet_manager.cc:1403] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.010s
I20260709 13:03:05.383993  9349 tablet_bootstrap.cc:492] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:05.384529  9349 ts_tablet_manager.cc:1403] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.012s
I20260709 13:03:05.384487  9347 raft_consensus.cc:359] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.385332  9347 raft_consensus.cc:385] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.385625  9347 raft_consensus.cc:740] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.386278  9347 consensus_queue.cc:260] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.388226  9347 ts_tablet_manager.cc:1434] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:05.388137  9349 raft_consensus.cc:359] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.389063  9349 raft_consensus.cc:385] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.389240  9347 tablet_bootstrap.cc:492] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:05.389394  9349 raft_consensus.cc:740] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.390791  9355 raft_consensus.cc:493] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.390223  9349 consensus_queue.cc:260] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.391275  9355 raft_consensus.cc:515] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.392962  9349 ts_tablet_manager.cc:1434] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:05.393990  9349 tablet_bootstrap.cc:492] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:05.394074  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.395484  9347 tablet_bootstrap.cc:654] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:05.395509  9197 leader_election.cc:343] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.397127  9355 leader_election.cc:290] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.390265  9373 raft_consensus.cc:2749] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.397969  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
W20260709 13:03:05.399328  9198 leader_election.cc:343] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.399752  9198 leader_election.cc:304] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:05.400748  9355 raft_consensus.cc:2749] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.402284  9349 tablet_bootstrap.cc:654] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.407568  9053 catalog_manager.cc:5697] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 0 to 1, leader changed from <none> to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.409088  9347 tablet_bootstrap.cc:492] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:05.409687  9347 ts_tablet_manager.cc:1403] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:03:05.413331  9347 raft_consensus.cc:359] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.414186  9347 raft_consensus.cc:385] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.414510  9347 raft_consensus.cc:740] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.415226  9347 consensus_queue.cc:260] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.416734  9349 tablet_bootstrap.cc:492] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:05.417112  9347 ts_tablet_manager.cc:1434] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:05.417184  9349 ts_tablet_manager.cc:1403] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:03:05.419203  9347 tablet_bootstrap.cc:492] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:05.419862  9349 raft_consensus.cc:359] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.420450  9349 raft_consensus.cc:385] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.420655  9349 raft_consensus.cc:740] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.421206  9349 consensus_queue.cc:260] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.422879  9349 ts_tablet_manager.cc:1434] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:03:05.423825  9349 tablet_bootstrap.cc:492] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:05.425581  9347 tablet_bootstrap.cc:654] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.429214  9349 tablet_bootstrap.cc:654] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.433197  9347 tablet_bootstrap.cc:492] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: No bootstrap required, opened a new log
I20260709 13:03:05.433643  9347 ts_tablet_manager.cc:1403] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.015s	user 0.001s	sys 0.011s
I20260709 13:03:05.435608  9347 raft_consensus.cc:359] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.436060  9347 raft_consensus.cc:385] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.436220  9347 raft_consensus.cc:740] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.436818  9349 tablet_bootstrap.cc:492] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:05.436685  9347 consensus_queue.cc:260] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.437233  9349 ts_tablet_manager.cc:1403] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:03:05.438128  9347 ts_tablet_manager.cc:1434] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:03:05.439816  9349 raft_consensus.cc:359] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.440466  9349 raft_consensus.cc:385] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.440672  9349 raft_consensus.cc:740] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.441227  9349 consensus_queue.cc:260] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.442966  9349 ts_tablet_manager.cc:1434] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:03:05.443904  9349 tablet_bootstrap.cc:492] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a: Bootstrap starting.
I20260709 13:03:05.449101  9349 tablet_bootstrap.cc:654] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.453241  9349 tablet_bootstrap.cc:492] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a: No bootstrap required, opened a new log
I20260709 13:03:05.453616  9349 ts_tablet_manager.cc:1403] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:03:05.455518  9349 raft_consensus.cc:359] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.455977  9349 raft_consensus.cc:385] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.456187  9349 raft_consensus.cc:740] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.456738  9349 consensus_queue.cc:260] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.458149  9349 ts_tablet_manager.cc:1434] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:03:05.532297  9373 raft_consensus.cc:493] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.532929  9373 raft_consensus.cc:515] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.533991  9355 raft_consensus.cc:493] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.534602  9373 leader_election.cc:290] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:05.534463  9355 raft_consensus.cc:515] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.535364  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7fb139d10643b5895afb2306ed6ca8" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.535701  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7fb139d10643b5895afb2306ed6ca8" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:05.536055  9157 raft_consensus.cc:2468] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 0.
I20260709 13:03:05.536432  9232 raft_consensus.cc:2468] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 0.
I20260709 13:03:05.537307  9271 leader_election.cc:304] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:05.537830  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.538450  9373 raft_consensus.cc:2804] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.538463  9157 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 0.
I20260709 13:03:05.539041  9373 raft_consensus.cc:493] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.539405  9373 raft_consensus.cc:3060] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.539463  9362 raft_consensus.cc:493] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.539551  9355 leader_election.cc:290] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.540022  9362 raft_consensus.cc:515] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.540803  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.541200  9197 leader_election.cc:304] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.541451  9307 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 0.
I20260709 13:03:05.541998  9362 leader_election.cc:290] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.542109  9355 raft_consensus.cc:2804] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.542709  9355 raft_consensus.cc:493] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.543113  9355 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.543653  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:05.544332  9232 raft_consensus.cc:2468] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 0.
I20260709 13:03:05.544426  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.545100  9307 raft_consensus.cc:2468] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 0.
I20260709 13:03:05.545583  9121 leader_election.cc:304] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.546876  9362 raft_consensus.cc:2804] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.546806  9373 raft_consensus.cc:515] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.547340  9362 raft_consensus.cc:493] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.547773  9362 raft_consensus.cc:3060] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.549405  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7fb139d10643b5895afb2306ed6ca8" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:05.549726  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7fb139d10643b5895afb2306ed6ca8" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:05.550047  9157 raft_consensus.cc:3060] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.550307  9232 raft_consensus.cc:3060] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.550559  9355 raft_consensus.cc:515] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.553218  9158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:05.553786  9158 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.554416  9362 raft_consensus.cc:515] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.557737  9362 leader_election.cc:290] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 election: Requested vote from peers b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.556919  9232 raft_consensus.cc:2468] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 1.
I20260709 13:03:05.557096  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:05.558279  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:05.558794  9233 raft_consensus.cc:3060] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.558874  9307 raft_consensus.cc:3060] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.559854  9355 leader_election.cc:290] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.557739  9373 leader_election.cc:290] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:05.561347  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:05.561533  9270 leader_election.cc:304] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.561924  9306 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.562242  9158 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 1.
I20260709 13:03:05.563499  9197 leader_election.cc:304] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.564330  9355 raft_consensus.cc:2804] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.564812  9355 raft_consensus.cc:697] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:05.566140  9355 consensus_queue.cc:237] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.566808  9233 raft_consensus.cc:2468] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 1.
I20260709 13:03:05.566965  9362 raft_consensus.cc:493] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.556953  9157 raft_consensus.cc:2468] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 1.
I20260709 13:03:05.567533  9362 raft_consensus.cc:515] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.567795  9373 raft_consensus.cc:2804] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.566843  9307 raft_consensus.cc:2468] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 1.
I20260709 13:03:05.568181  9121 leader_election.cc:304] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.569193  9373 raft_consensus.cc:697] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:05.569476  9356 raft_consensus.cc:2804] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.570052  9373 consensus_queue.cc:237] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.570746  9362 leader_election.cc:290] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.572129  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:05.573093  9233 raft_consensus.cc:2393] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ca8b1e786984ac581ce2308f04f2efd in current term 1: Already voted for candidate a6bcc62f665849f09a58081d7e222a3a in this term.
I20260709 13:03:05.573365  9356 raft_consensus.cc:697] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 LEADER]: Becoming Leader. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Running, Role: LEADER
I20260709 13:03:05.574327  9356 consensus_queue.cc:237] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.574826  9158 raft_consensus.cc:3060] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.579221  9306 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 1.
I20260709 13:03:05.583109  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.585050  9123 leader_election.cc:304] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd; no voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:05.589892  9054 catalog_manager.cc:5697] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 0 to 1, leader changed from <none> to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.591800  9056 catalog_manager.cc:5697] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "7ca8b1e786984ac581ce2308f04f2efd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.593245  9356 raft_consensus.cc:2749] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.592738  9053 catalog_manager.cc:5697] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.595870  9373 consensus_queue.cc:1048] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.616618  9373 consensus_queue.cc:1048] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.676749  9356 consensus_queue.cc:1048] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.686638  9356 consensus_queue.cc:1048] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.710023  9373 consensus_queue.cc:1048] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.719004  9158 raft_consensus.cc:3060] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.727092  9353 consensus_queue.cc:1048] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.731825  9356 raft_consensus.cc:493] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.732298  9356 raft_consensus.cc:515] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.734366  9356 leader_election.cc:290] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.735103  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:05.735479  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:05.735831  9233 raft_consensus.cc:2468] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 0.
I20260709 13:03:05.736152  9307 raft_consensus.cc:2468] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 0.
I20260709 13:03:05.736896  9121 leader_election.cc:304] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.738104  9356 raft_consensus.cc:2804] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.738469  9356 raft_consensus.cc:493] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.738834  9356 raft_consensus.cc:3060] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.744190  9355 consensus_queue.cc:1048] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.745107  9356 raft_consensus.cc:515] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.746908  9356 leader_election.cc:290] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 election: Requested vote from peers b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:05.747618  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:05.748262  9233 raft_consensus.cc:3060] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.748461  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "7ca8b1e786984ac581ce2308f04f2efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:05.749264  9307 raft_consensus.cc:3060] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.754573  9233 raft_consensus.cc:2468] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 1.
I20260709 13:03:05.760727  9367 consensus_queue.cc:1048] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.755868  9121 leader_election.cc:304] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:05.763044  9307 raft_consensus.cc:2468] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca8b1e786984ac581ce2308f04f2efd in term 1.
I20260709 13:03:05.763461  9356 raft_consensus.cc:2804] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.764055  9356 raft_consensus.cc:697] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 LEADER]: Becoming Leader. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Running, Role: LEADER
I20260709 13:03:05.764791  9356 consensus_queue.cc:237] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.775277  9053 catalog_manager.cc:5697] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "7ca8b1e786984ac581ce2308f04f2efd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.784097  9367 consensus_queue.cc:1048] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.795132  9367 consensus_queue.cc:1048] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.934424  9306 raft_consensus.cc:3060] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.939851  9353 raft_consensus.cc:493] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.940335  9353 raft_consensus.cc:515] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.940685  9367 consensus_queue.cc:1048] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.943432  9353 leader_election.cc:290] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:05.944177  9158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd" is_pre_election: true
I20260709 13:03:05.944888  9158 raft_consensus.cc:2468] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 1.
I20260709 13:03:05.945065  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:05.946156  9271 leader_election.cc:304] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:05.947156  9353 raft_consensus.cc:2804] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:05.947511  9353 raft_consensus.cc:493] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b637e9d8b4d04fd4a015c2d0ba350b77)
I20260709 13:03:05.947817  9353 raft_consensus.cc:3060] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:05.954533  9355 consensus_queue.cc:1048] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:05.956367  9353 raft_consensus.cc:515] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.958185  9306 raft_consensus.cc:1240] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Rejecting Update request from peer b637e9d8b4d04fd4a015c2d0ba350b77 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:05.961462  9353 leader_election.cc:290] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:05.962391  9355 consensus_queue.cc:1059] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:05.963308  9355 raft_consensus.cc:3055] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:05.963734  9355 raft_consensus.cc:740] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:05.964953  9355 consensus_queue.cc:260] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.966080  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:05.966707  9355 raft_consensus.cc:3060] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:05.970211  9157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:05.975270   431 ts_manager.cc:295] Set tserver state for 7ca8b1e786984ac581ce2308f04f2efd to MAINTENANCE_MODE
I20260709 13:03:05.976110   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:05.979532  9233 raft_consensus.cc:2468] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 2.
I20260709 13:03:05.982195  9270 leader_election.cc:304] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 7ca8b1e786984ac581ce2308f04f2efd
I20260709 13:03:05.983371  9353 raft_consensus.cc:2804] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:05.983952  9353 raft_consensus.cc:697] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:05.984833  9353 consensus_queue.cc:237] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:05.996462  9053 catalog_manager.cc:5697] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 1 to 2, leader changed from b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:06.009631   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:06.010301   431 tablet_replica.cc:333] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.010944   431 raft_consensus.cc:2243] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.011555   431 pending_rounds.cc:70] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Trying to abort 1 pending ops.
I20260709 13:03:06.011775   431 pending_rounds.cc:77] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634552899829760 op_type: NO_OP noop_request { }
I20260709 13:03:06.012072   431 raft_consensus.cc:2889] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:06.012363   431 raft_consensus.cc:2272] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.014379   431 tablet_replica.cc:333] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.014999   431 raft_consensus.cc:2243] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.015389   431 raft_consensus.cc:2272] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.017127   431 tablet_replica.cc:333] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.017634   431 raft_consensus.cc:2243] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.017987   431 raft_consensus.cc:2272] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.019887   431 tablet_replica.cc:333] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.020469   431 raft_consensus.cc:2243] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.021021   431 pending_rounds.cc:70] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Trying to abort 1 pending ops.
I20260709 13:03:06.021231   431 pending_rounds.cc:77] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634552135200768 op_type: NO_OP noop_request { }
I20260709 13:03:06.021486   431 raft_consensus.cc:2889] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:06.021745   431 raft_consensus.cc:2272] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.023667   431 tablet_replica.cc:333] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.024240   431 raft_consensus.cc:2243] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.024698   431 raft_consensus.cc:2272] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.026863   431 tablet_replica.cc:333] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.027374   431 raft_consensus.cc:2243] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.027810   431 raft_consensus.cc:2272] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.030014   431 tablet_replica.cc:333] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.030522   431 raft_consensus.cc:2243] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.030908   431 raft_consensus.cc:2272] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.032832   431 tablet_replica.cc:333] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.033284   431 raft_consensus.cc:2243] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:06.033929   431 raft_consensus.cc:2272] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.035784   431 tablet_replica.cc:333] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.036208   431 raft_consensus.cc:2243] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.036518   431 raft_consensus.cc:2272] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.038619   431 tablet_replica.cc:333] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: stopping tablet replica
I20260709 13:03:06.039093   431 raft_consensus.cc:2243] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:06.039417   431 raft_consensus.cc:2272] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:06.067263   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:03:06.070655  9353 consensus_queue.cc:1048] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:06.077111  9355 consensus_queue.cc:1048] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:06.097296  9271 consensus_peers.cc:597] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.105211  9197 consensus_peers.cc:597] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.130786  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:06.178610  9271 consensus_peers.cc:597] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.212198  9197 consensus_peers.cc:597] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.228843  9197 consensus_peers.cc:597] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:06.324374  9271 consensus_peers.cc:597] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.452000  9233 raft_consensus.cc:1275] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:06.453219  9353 consensus_queue.cc:1048] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:06.465068  9271 consensus_peers.cc:597] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:07.131709  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:07.185873  9367 raft_consensus.cc:493] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ca8b1e786984ac581ce2308f04f2efd)
I20260709 13:03:07.186365  9367 raft_consensus.cc:515] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:07.187958  9367 leader_election.cc:290] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:07.189323  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329f33dd9274eac8826771258e523d0" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:07.190421  9306 raft_consensus.cc:2468] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 1.
I20260709 13:03:07.194397  9198 leader_election.cc:304] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:07.195204  9367 raft_consensus.cc:2804] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:07.195581  9367 raft_consensus.cc:493] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ca8b1e786984ac581ce2308f04f2efd)
I20260709 13:03:07.195945  9367 raft_consensus.cc:3060] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:07.196626  9197 leader_election.cc:336] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111)
I20260709 13:03:07.201056  9367 raft_consensus.cc:515] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:07.202739  9367 leader_election.cc:290] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:07.203711  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329f33dd9274eac8826771258e523d0" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:07.204227  9306 raft_consensus.cc:3060] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:07.206018  9197 leader_election.cc:336] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111)
I20260709 13:03:07.208873  9306 raft_consensus.cc:2468] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 2.
I20260709 13:03:07.209841  9198 leader_election.cc:304] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 7ca8b1e786984ac581ce2308f04f2efd
I20260709 13:03:07.210449  9367 raft_consensus.cc:2804] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:07.210837  9367 raft_consensus.cc:697] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:07.211458  9367 consensus_queue.cc:237] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:07.219043  9053 catalog_manager.cc:5697] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 1 to 2, leader changed from 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193) to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.257318  9367 raft_consensus.cc:493] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.257876  9367 raft_consensus.cc:515] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:07.259594  9367 leader_election.cc:290] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:07.260799  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a" is_pre_election: true
I20260709 13:03:07.261495  9306 raft_consensus.cc:2468] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 1.
I20260709 13:03:07.262482  9198 leader_election.cc:304] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:07.263218  9425 raft_consensus.cc:2804] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:07.263556  9425 raft_consensus.cc:493] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.263839  9425 raft_consensus.cc:3060] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:07.264357  9197 leader_election.cc:336] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111)
I20260709 13:03:07.268575  9425 raft_consensus.cc:515] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:07.270025  9425 leader_election.cc:290] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:07.271235  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:07.271435  9433 raft_consensus.cc:493] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.271865  9306 raft_consensus.cc:3060] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.271895  9433 raft_consensus.cc:515] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
W20260709 13:03:07.273696  9197 leader_election.cc:336] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111)
I20260709 13:03:07.274159  9433 leader_election.cc:290] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:07.275274  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" is_pre_election: true
I20260709 13:03:07.275813  9233 raft_consensus.cc:2468] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 1.
I20260709 13:03:07.277280  9270 leader_election.cc:304] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:07.278931  9433 raft_consensus.cc:2804] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:07.279456  9433 raft_consensus.cc:493] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.279956  9433 raft_consensus.cc:3060] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:07.280005  9271 leader_election.cc:336] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111)
I20260709 13:03:07.281047  9306 raft_consensus.cc:2468] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 2.
I20260709 13:03:07.282218  9198 leader_election.cc:304] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 7ca8b1e786984ac581ce2308f04f2efd
I20260709 13:03:07.282958  9425 raft_consensus.cc:2804] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:07.283430  9425 raft_consensus.cc:697] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:07.284274  9425 consensus_queue.cc:237] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:07.286803  9433 raft_consensus.cc:515] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:07.289381  9433 leader_election.cc:290] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:07.289743  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:07.290342  9233 raft_consensus.cc:3060] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.292189  9053 catalog_manager.cc:5697] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 1 to 2, leader changed from 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193) to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:07.292982  9271 leader_election.cc:336] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111)
I20260709 13:03:07.295775  9233 raft_consensus.cc:2468] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 2.
I20260709 13:03:07.296805  9270 leader_election.cc:304] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 7ca8b1e786984ac581ce2308f04f2efd
I20260709 13:03:07.297602  9433 raft_consensus.cc:2804] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:07.298058  9433 raft_consensus.cc:697] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:07.298818  9433 consensus_queue.cc:237] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:07.305460  9053 catalog_manager.cc:5697] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 1 to 2, leader changed from 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:07.587496  9271 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111) [suppressed 123 similar messages]
I20260709 13:03:07.598142  9306 raft_consensus.cc:1275] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.599364  9425 consensus_queue.cc:1048] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:07.616490  9197 consensus_peers.cc:597] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:07.674384  9087 debug-util.cc:398] Leaking SignalData structure 0x7b0800102a40 after lost signal to thread 434
W20260709 13:03:07.675370  9087 debug-util.cc:398] Leaking SignalData structure 0x7b08002459e0 after lost signal to thread 9090
W20260709 13:03:07.676581  9087 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2ec0 after lost signal to thread 9257
W20260709 13:03:07.677505  9087 debug-util.cc:398] Leaking SignalData structure 0x7b0800218fa0 after lost signal to thread 9331
I20260709 13:03:07.764277  9233 raft_consensus.cc:1275] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:07.765625  9433 consensus_queue.cc:1048] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:07.784677  9271 consensus_peers.cc:597] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:07.798856  9197 consensus_peers.cc:597] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:07.826918  9306 raft_consensus.cc:1275] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:07.828497  9445 consensus_queue.cc:1048] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:08.132509  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:08.677755  9271 consensus_peers.cc:597] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.708794  9197 consensus_peers.cc:597] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.716128  9271 consensus_peers.cc:597] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.803912  9197 consensus_peers.cc:597] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.863497  9197 consensus_peers.cc:597] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:08.868937  9271 consensus_peers.cc:597] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:09.126991  9271 consensus_peers.cc:597] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:09.133451  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:10.040570  9271 consensus_peers.cc:597] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:10.093508  9197 consensus_peers.cc:597] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:10.134328  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:10.717356  9197 consensus_peers.cc:597] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:10.765345  9271 consensus_peers.cc:597] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.117213   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:11.125314  9452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:11.125746  9453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:11.127588  9455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:11.131105   431 server_base.cc:1061] running on GCE node
I20260709 13:03:11.133314   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:11.133509   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:11.133646   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602191133635 us; error 0 us; skew 500 ppm
I20260709 13:03:11.134199   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:03:11.135546  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:11.137778   431 webserver.cc:533] Webserver started at http://127.0.107.193:42683/ using document root <none> and password file <none>
I20260709 13:03:11.138373   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:11.138566   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:03:11.142551   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:03:11.146565  9460 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:11.147379   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:11.147686   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "7ca8b1e786984ac581ce2308f04f2efd"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-szgt"
I20260709 13:03:11.148101   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:11.164054   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
W20260709 13:03:11.165174  9271 consensus_peers.cc:597] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.165674   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:11.167307   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:11.171989  9467 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:03:11.210366  9197 consensus_peers.cc:597] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.224963   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:03:11.225355   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.055s	user 0.004s	sys 0.000s
I20260709 13:03:11.225692   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:03:11.231303  9467 tablet_bootstrap.cc:492] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:11.247635  9467 tablet_bootstrap.cc:492] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:03:11.248426  9467 tablet_bootstrap.cc:492] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.249116  9467 ts_tablet_manager.cc:1403] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:03:11.251430  9467 raft_consensus.cc:359] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.252425  9467 raft_consensus.cc:740] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.253106  9467 consensus_queue.cc:260] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.255714  9467 ts_tablet_manager.cc:1434] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:11.256423  9467 tablet_bootstrap.cc:492] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:11.272413  9467 tablet_bootstrap.cc:492] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.273386  9467 tablet_bootstrap.cc:492] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.274039  9467 ts_tablet_manager.cc:1403] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260709 13:03:11.276090   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:03:11.276449   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.051s	user 0.049s	sys 0.000s
I20260709 13:03:11.276714  9467 raft_consensus.cc:359] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.277568  9467 raft_consensus.cc:740] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.278381  9467 consensus_queue.cc:260] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.280620  9467 ts_tablet_manager.cc:1434] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:11.281484  9467 tablet_bootstrap.cc:492] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:11.307016  9467 tablet_bootstrap.cc:492] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.308049  9467 tablet_bootstrap.cc:492] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.308763  9467 ts_tablet_manager.cc:1403] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.001s
W20260709 13:03:11.311077  9197 consensus_peers.cc:597] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.311825  9467 raft_consensus.cc:359] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.312669  9467 raft_consensus.cc:740] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.313402  9467 consensus_queue.cc:260] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.315124  9467 ts_tablet_manager.cc:1434] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:11.315934  9467 tablet_bootstrap.cc:492] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
W20260709 13:03:11.327845  9271 consensus_peers.cc:597] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:11.335119  9467 tablet_bootstrap.cc:492] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.336365  9467 tablet_bootstrap.cc:492] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.337107  9467 ts_tablet_manager.cc:1403] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:03:11.340492  9467 raft_consensus.cc:359] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.341300  9467 raft_consensus.cc:740] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.342218  9467 consensus_queue.cc:260] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.344573  9467 ts_tablet_manager.cc:1434] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:11.345423  9467 tablet_bootstrap.cc:492] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:11.357892   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42813
I20260709 13:03:11.357965  9528 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42813 every 8 connection(s)
I20260709 13:03:11.361284  9467 tablet_bootstrap.cc:492] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.362404  9467 tablet_bootstrap.cc:492] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.363791  9467 ts_tablet_manager.cc:1403] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:03:11.364789   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.366994  9467 raft_consensus.cc:359] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.367938  9467 raft_consensus.cc:740] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.368773  9467 consensus_queue.cc:260] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.371028  9467 ts_tablet_manager.cc:1434] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:11.372020  9467 tablet_bootstrap.cc:492] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:11.389935  9530 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38735
I20260709 13:03:11.390455  9530 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:11.390458  9467 tablet_bootstrap.cc:492] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.391637  9467 tablet_bootstrap.cc:492] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.391606  9530 heartbeater.cc:507] Master 127.0.107.254:38735 requested a full tablet report, sending...
I20260709 13:03:11.392491  9467 ts_tablet_manager.cc:1403] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:03:11.392695  9233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
mode: GRACEFUL
new_leader_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:59320
I20260709 13:03:11.393527  9233 raft_consensus.cc:606] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Received request to transfer leadership to TS a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:11.394881  9467 raft_consensus.cc:359] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.395617  9467 raft_consensus.cc:740] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.396394  9467 consensus_queue.cc:260] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.399724  9056 ts_manager.cc:194] Re-registered known tserver with Master: 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813)
I20260709 13:03:11.399904  9467 ts_tablet_manager.cc:1434] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:11.400933  9467 tablet_bootstrap.cc:492] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:11.408066  9306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
mode: GRACEFUL
new_leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:03:11.408831  9306 raft_consensus.cc:606] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Received request to transfer leadership to TS b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:11.412079  9056 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32826
I20260709 13:03:11.413239  9233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
mode: GRACEFUL
new_leader_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:59320
I20260709 13:03:11.413951  9233 raft_consensus.cc:606] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Received request to transfer leadership to TS a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:11.416030   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:11.416169  9530 heartbeater.cc:499] Master 127.0.107.254:38735 was elected leader, sending a full tablet report...
I20260709 13:03:11.416893   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:11.417826   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.425156  9467 tablet_bootstrap.cc:492] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:03:11.426178  9467 tablet_bootstrap.cc:492] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.426844  9467 ts_tablet_manager.cc:1403] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:03:11.429421  9467 raft_consensus.cc:359] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.430240  9467 raft_consensus.cc:740] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.430946  9467 consensus_queue.cc:260] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.432925  9467 ts_tablet_manager.cc:1434] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:03:11.433688  9467 tablet_bootstrap.cc:492] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:11.447345  9467 tablet_bootstrap.cc:492] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.447983  9541 raft_consensus.cc:993] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a: : Instructing follower b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:11.448276  9467 tablet_bootstrap.cc:492] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.448644  9449 raft_consensus.cc:1081] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Signalling peer b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:11.449074  9467 ts_tablet_manager.cc:1403] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:03:11.450356  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:59310
I20260709 13:03:11.450978  9233 raft_consensus.cc:493] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.451309  9233 raft_consensus.cc:3060] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.451607  9467 raft_consensus.cc:359] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.452126  9467 raft_consensus.cc:740] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.452701  9467 consensus_queue.cc:260] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.454501  9467 ts_tablet_manager.cc:1434] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:03:11.455291  9467 tablet_bootstrap.cc:492] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:11.459163  9233 raft_consensus.cc:515] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.461382  9233 leader_election.cc:290] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:11.464200  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:11.464859  9306 raft_consensus.cc:3055] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.465193  9306 raft_consensus.cc:740] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:11.466189  9306 consensus_queue.cc:260] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.467833  9306 raft_consensus.cc:3060] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.471400  9467 tablet_bootstrap.cc:492] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.472256  9467 tablet_bootstrap.cc:492] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.472872  9467 ts_tablet_manager.cc:1403] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.007s
I20260709 13:03:11.472712  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309aee806f04e2c8f5aa13f7f7c2b12" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:11.473379  9503 raft_consensus.cc:3060] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.476512  9306 raft_consensus.cc:2468] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 2.
I20260709 13:03:11.476603  9467 raft_consensus.cc:359] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.477559  9467 raft_consensus.cc:740] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.478338  9467 consensus_queue.cc:260] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.480927  9467 ts_tablet_manager.cc:1434] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:11.481928  9467 tablet_bootstrap.cc:492] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap starting.
I20260709 13:03:11.483893  9198 leader_election.cc:304] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:11.485031  9443 raft_consensus.cc:2804] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.491335  9503 raft_consensus.cc:2468] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 2.
I20260709 13:03:11.499356  9443 raft_consensus.cc:697] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:11.500797  9443 consensus_queue.cc:237] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.512197  9467 tablet_bootstrap.cc:492] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.513125  9467 tablet_bootstrap.cc:492] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: Bootstrap complete.
I20260709 13:03:11.513710  9467 ts_tablet_manager.cc:1403] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: Time spent bootstrapping tablet: real 0.032s	user 0.027s	sys 0.000s
I20260709 13:03:11.515637  9467 raft_consensus.cc:359] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.515245  9056 catalog_manager.cc:5697] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 1 to 2, leader changed from a6bcc62f665849f09a58081d7e222a3a (127.0.107.195) to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.516323  9467 raft_consensus.cc:740] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca8b1e786984ac581ce2308f04f2efd, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.517014  9467 consensus_queue.cc:260] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.518472  9467 ts_tablet_manager.cc:1434] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:11.521085  9503 raft_consensus.cc:3060] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.681666  9503 raft_consensus.cc:3060] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.687134  9503 pending_rounds.cc:85] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Aborting all ops after (but not including) 0
I20260709 13:03:11.687326  9503 pending_rounds.cc:107] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:03:11.687508  9503 raft_consensus.cc:2889] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:11.773535  9443 raft_consensus.cc:993] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77: : Instructing follower a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:11.774152  9545 raft_consensus.cc:1081] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Signalling peer a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:11.776281  9307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:11.776886  9307 raft_consensus.cc:493] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.777261  9307 raft_consensus.cc:3060] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.777846  9545 raft_consensus.cc:993] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77: : Instructing follower a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:11.778401  9443 raft_consensus.cc:1081] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Signalling peer a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:11.780172  9306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:11.780696  9306 raft_consensus.cc:493] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.781100  9306 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.784327  9307 raft_consensus.cc:515] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.786080  9307 leader_election.cc:290] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 3 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:11.786827  9306 raft_consensus.cc:515] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.787192  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:11.787753  9233 raft_consensus.cc:3055] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:11.787659  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bf8bdbc6a945418a3e8aa01a4b977d" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:11.788260  9233 raft_consensus.cc:740] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:11.788473  9503 raft_consensus.cc:3060] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.789232  9233 consensus_queue.cc:260] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.789813  9306 leader_election.cc:290] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:11.789793  9504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:11.790694  9504 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.791215  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:11.791740  9232 raft_consensus.cc:3055] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.791953  9232 raft_consensus.cc:740] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:11.792678  9232 consensus_queue.cc:260] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.793506  9232 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.790539  9233 raft_consensus.cc:3060] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.795897  9503 raft_consensus.cc:2468] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 3.
I20260709 13:03:11.796964  9271 leader_election.cc:304] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:11.797791  9449 raft_consensus.cc:2804] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:11.798254  9449 raft_consensus.cc:697] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 3 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:11.799237  9504 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 2.
I20260709 13:03:11.799237  9449 consensus_queue.cc:237] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.800678  9232 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 2.
I20260709 13:03:11.801999  9270 leader_election.cc:304] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6bcc62f665849f09a58081d7e222a3a, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:11.802481  9233 raft_consensus.cc:2468] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 3.
I20260709 13:03:11.803143  9541 raft_consensus.cc:2804] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.804805  9541 raft_consensus.cc:697] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:11.806205  9541 consensus_queue.cc:237] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:11.810124  9056 catalog_manager.cc:5697] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 2 to 3, leader changed from b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.821171  9056 catalog_manager.cc:5697] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 1 to 2, leader changed from b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.860071  9504 raft_consensus.cc:3060] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.015712  9504 raft_consensus.cc:3060] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.022282  9504 pending_rounds.cc:85] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Aborting all ops after (but not including) 0
I20260709 13:03:12.022531  9504 pending_rounds.cc:107] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:03:12.022778  9504 raft_consensus.cc:2889] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:12.049228  9504 raft_consensus.cc:1275] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.050375  9561 consensus_queue.cc:1048] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.059402  9306 raft_consensus.cc:1275] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.061033  9545 consensus_queue.cc:1048] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:12.136538  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:12.182955  9504 raft_consensus.cc:1275] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:12.184438  9449 consensus_queue.cc:1048] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.191788  9233 raft_consensus.cc:1275] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:12.193498  9568 consensus_queue.cc:1048] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:12.209193  9233 raft_consensus.cc:1275] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.210605  9568 consensus_queue.cc:1048] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.221042  9504 raft_consensus.cc:1275] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.222541  9568 consensus_queue.cc:1048] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.428293   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:12.436578  9306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58e28affd5924541bad949653a73740b"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
mode: GRACEFUL
new_leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:03:12.437106  9306 raft_consensus.cc:606] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Received request to transfer leadership to TS b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:12.439347  9233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
mode: GRACEFUL
new_leader_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:59320
I20260709 13:03:12.439793  9233 raft_consensus.cc:606] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Received request to transfer leadership to TS a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:12.441905  9306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
mode: GRACEFUL
new_leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:03:12.442361  9306 raft_consensus.cc:606] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Received request to transfer leadership to TS b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:12.443336   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:12.443778   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:12.444293   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:12.546093  9557 raft_consensus.cc:993] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a: : Instructing follower b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:12.546579  9568 raft_consensus.cc:1081] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Signalling peer b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:12.547834  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:59310
I20260709 13:03:12.548277  9233 raft_consensus.cc:493] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.548592  9233 raft_consensus.cc:3060] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:12.552975  9233 raft_consensus.cc:515] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:12.554481  9233 leader_election.cc:290] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 3 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:12.555169  9504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:12.555428  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef3c776ccf4521a85ae47cbb63aaee" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:12.555724  9504 raft_consensus.cc:3060] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:12.556020  9306 raft_consensus.cc:3055] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:12.556325  9306 raft_consensus.cc:740] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:12.557060  9306 consensus_queue.cc:260] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:12.557914  9306 raft_consensus.cc:3060] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:12.560567  9504 raft_consensus.cc:2468] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 3.
I20260709 13:03:12.561712  9197 leader_election.cc:304] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:12.562458  9545 raft_consensus.cc:2804] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:12.562779  9306 raft_consensus.cc:2468] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 3.
I20260709 13:03:12.562937  9545 raft_consensus.cc:697] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:12.563933  9545 consensus_queue.cc:237] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:12.570801  9056 catalog_manager.cc:5697] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 2 to 3, leader changed from a6bcc62f665849f09a58081d7e222a3a (127.0.107.195) to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.634841  9565 raft_consensus.cc:993] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77: : Instructing follower a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:12.635309  9545 raft_consensus.cc:1081] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Signalling peer a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:12.636663  9306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:12.637024  9306 raft_consensus.cc:493] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.637259  9306 raft_consensus.cc:3060] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.642580  9306 raft_consensus.cc:515] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:12.644171  9306 leader_election.cc:290] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:12.644788  9504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:12.645346  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9541ba20e9a54ecc9113862db343c20f" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:12.645358  9504 raft_consensus.cc:3060] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.645855  9233 raft_consensus.cc:3055] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:12.646073  9233 raft_consensus.cc:740] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:12.646623  9233 consensus_queue.cc:260] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:12.647485  9233 raft_consensus.cc:3060] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.650090  9504 raft_consensus.cc:2468] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 2.
I20260709 13:03:12.651062  9271 leader_election.cc:304] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:12.651749  9568 raft_consensus.cc:2804] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.652187  9568 raft_consensus.cc:697] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:12.652264  9233 raft_consensus.cc:2468] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 2.
I20260709 13:03:12.653152  9568 consensus_queue.cc:237] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:12.659809  9056 catalog_manager.cc:5697] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 1 to 2, leader changed from b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:12.738072  9449 raft_consensus.cc:993] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a: : Instructing follower b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:12.738511  9568 raft_consensus.cc:1081] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Signalling peer b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:12.739871  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58e28affd5924541bad949653a73740b"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:59310
I20260709 13:03:12.740300  9233 raft_consensus.cc:493] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.740579  9233 raft_consensus.cc:3060] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.744863  9233 raft_consensus.cc:515] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:12.746124  9233 leader_election.cc:290] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:12.746979  9504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e28affd5924541bad949653a73740b" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:12.747174  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e28affd5924541bad949653a73740b" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:12.747589  9504 raft_consensus.cc:3060] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.747676  9306 raft_consensus.cc:3055] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:12.748050  9306 raft_consensus.cc:740] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:12.748819  9306 consensus_queue.cc:260] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:12.750082  9306 raft_consensus.cc:3060] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.754236  9504 raft_consensus.cc:2468] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 2.
I20260709 13:03:12.755265  9197 leader_election.cc:304] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:12.755944  9545 raft_consensus.cc:2804] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.756343  9545 raft_consensus.cc:697] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:12.756444  9306 raft_consensus.cc:2468] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 2.
I20260709 13:03:12.757182  9545 consensus_queue.cc:237] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:12.763631  9056 catalog_manager.cc:5697] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 1 to 2, leader changed from a6bcc62f665849f09a58081d7e222a3a (127.0.107.195) to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.059160  9233 raft_consensus.cc:1275] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:13.060227  9568 consensus_queue.cc:1048] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:13.069451  9504 raft_consensus.cc:1275] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:13.072463  9568 consensus_queue.cc:1048] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:13.083796  9306 raft_consensus.cc:1275] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:13.085116  9545 consensus_queue.cc:1048] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:13.095041  9504 raft_consensus.cc:1275] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:13.096323  9545 consensus_queue.cc:1048] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:13.137465  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:13.219069  9306 raft_consensus.cc:1275] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:13.220412  9565 consensus_queue.cc:1048] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:13.229058  9504 raft_consensus.cc:1275] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:13.231127  9561 consensus_queue.cc:1048] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:13.450383   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:13.459182  9306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
mode: GRACEFUL
new_leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:03:13.459789  9306 raft_consensus.cc:606] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Received request to transfer leadership to TS b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:13.462278  9233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58e28affd5924541bad949653a73740b"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
mode: GRACEFUL
new_leader_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:59320
I20260709 13:03:13.462765  9233 raft_consensus.cc:606] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Received request to transfer leadership to TS a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:13.464891  9233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9223119a5d98444daf976419d90c6670"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
mode: GRACEFUL
new_leader_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:59320
I20260709 13:03:13.465322  9233 raft_consensus.cc:606] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Received request to transfer leadership to TS a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:13.466228   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:13.466750   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:13.467350   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:13.614034  9561 raft_consensus.cc:993] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77: : Instructing follower a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:13.614506  9545 raft_consensus.cc:1081] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Signalling peer a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:13.615845  9307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58e28affd5924541bad949653a73740b"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:13.616339  9307 raft_consensus.cc:493] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.616648  9307 raft_consensus.cc:3060] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.621099  9561 raft_consensus.cc:993] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77: : Instructing follower a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:13.621649  9545 raft_consensus.cc:1081] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Signalling peer a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:13.623464  9306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9223119a5d98444daf976419d90c6670"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:13.623425  9307 raft_consensus.cc:515] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:13.624279  9306 raft_consensus.cc:493] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.624656  9306 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.625854  9307 leader_election.cc:290] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 3 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:13.627092  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e28affd5924541bad949653a73740b" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:13.627774  9504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e28affd5924541bad949653a73740b" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:13.628546  9504 raft_consensus.cc:3060] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.627722  9233 raft_consensus.cc:3055] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:13.629817  9233 raft_consensus.cc:740] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:13.630612  9233 consensus_queue.cc:260] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:13.631661  9233 raft_consensus.cc:3060] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.631938  9306 raft_consensus.cc:515] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:13.633916  9306 leader_election.cc:290] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:13.634688  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:13.635341  9503 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.637146  9233 raft_consensus.cc:2468] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 3.
I20260709 13:03:13.637554  9504 raft_consensus.cc:2468] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 3.
I20260709 13:03:13.639014  9271 leader_election.cc:304] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:13.639326  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:13.639972  9233 raft_consensus.cc:3055] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:13.639961  9449 raft_consensus.cc:2804] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:13.640426  9233 raft_consensus.cc:740] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:13.640722  9449 raft_consensus.cc:697] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 3 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:13.641320  9233 consensus_queue.cc:260] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:13.641619  9449 consensus_queue.cc:237] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:13.642475  9503 raft_consensus.cc:2468] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 2.
I20260709 13:03:13.642688  9233 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.647518  9271 leader_election.cc:304] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:13.648895  9568 raft_consensus.cc:2804] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:13.649243  9233 raft_consensus.cc:2468] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 2.
I20260709 13:03:13.649405  9568 raft_consensus.cc:697] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:13.650516  9568 consensus_queue.cc:237] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:13.651304  9056 catalog_manager.cc:5697] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 2 to 3, leader changed from b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.665239  9056 catalog_manager.cc:5697] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 1 to 2, leader changed from b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.830844  9449 raft_consensus.cc:993] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a: : Instructing follower b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:13.831342  9568 raft_consensus.cc:1081] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Signalling peer b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:13.832854  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:59310
I20260709 13:03:13.833248  9233 raft_consensus.cc:493] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.833518  9233 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.838020  9233 raft_consensus.cc:515] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:13.839407  9233 leader_election.cc:290] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 3 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:13.840366  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:13.840248  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:13.841077  9306 raft_consensus.cc:3055] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:13.841179  9503 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.841439  9306 raft_consensus.cc:740] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:13.842273  9306 consensus_queue.cc:260] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:13.843485  9306 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.848212  9503 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 3.
I20260709 13:03:13.849362  9197 leader_election.cc:304] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:13.849834  9306 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 3.
I20260709 13:03:13.850080  9545 raft_consensus.cc:2804] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:13.850593  9545 raft_consensus.cc:697] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:13.851327  9545 consensus_queue.cc:237] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:13.857705  9056 catalog_manager.cc:5697] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 2 to 3, leader changed from a6bcc62f665849f09a58081d7e222a3a (127.0.107.195) to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:14.090539  9233 raft_consensus.cc:1275] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.091818  9568 consensus_queue.cc:1048] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:14.102546  9503 raft_consensus.cc:1275] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.104018  9568 consensus_queue.cc:1048] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:03:14.138584  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:14.148209  9233 raft_consensus.cc:1275] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:14.149564  9568 consensus_queue.cc:1048] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:14.157088  9503 raft_consensus.cc:1275] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:14.158277  9568 consensus_queue.cc:1048] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:14.376246  9306 raft_consensus.cc:1275] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:14.377434  9545 consensus_queue.cc:1048] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:14.385660  9503 raft_consensus.cc:1275] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:14.387271  9600 consensus_queue.cc:1048] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:14.474373   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:14.481395  9233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
mode: GRACEFUL
new_leader_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:59320
I20260709 13:03:14.481916  9233 raft_consensus.cc:606] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Received request to transfer leadership to TS a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:14.484297  9306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9223119a5d98444daf976419d90c6670"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
mode: GRACEFUL
new_leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:03:14.484751  9306 raft_consensus.cc:606] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Received request to transfer leadership to TS b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:14.487113  9306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
mode: GRACEFUL
new_leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:03:14.487572  9306 raft_consensus.cc:606] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Received request to transfer leadership to TS b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:14.488634   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:14.488687  9449 raft_consensus.cc:993] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a: : Instructing follower b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:14.489194   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:14.489275  9568 raft_consensus.cc:1081] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Signalling peer b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:14.489846   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:14.490847  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:59310
I20260709 13:03:14.491323  9233 raft_consensus.cc:493] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:14.491716  9233 raft_consensus.cc:3060] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.496191  9233 raft_consensus.cc:515] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:14.497593  9233 leader_election.cc:290] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 3 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:14.498476  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:14.498570  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76aa97c166f48d98561f2e42738778d" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:14.499199  9503 raft_consensus.cc:3060] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.499271  9306 raft_consensus.cc:3055] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:14.499708  9306 raft_consensus.cc:740] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:14.500325  9306 consensus_queue.cc:260] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:14.501150  9306 raft_consensus.cc:3060] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.504169  9503 raft_consensus.cc:2468] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 3.
I20260709 13:03:14.505210  9197 leader_election.cc:304] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:14.505610  9306 raft_consensus.cc:2468] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 3.
I20260709 13:03:14.506033  9600 raft_consensus.cc:2804] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:14.506548  9600 raft_consensus.cc:697] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:14.507319  9600 consensus_queue.cc:237] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:14.514266  9053 catalog_manager.cc:5697] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 2 to 3, leader changed from a6bcc62f665849f09a58081d7e222a3a (127.0.107.195) to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:14.669903  9449 raft_consensus.cc:993] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a: : Instructing follower b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:14.670405  9449 raft_consensus.cc:1081] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Signalling peer b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:14.671993  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9223119a5d98444daf976419d90c6670"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:59310
I20260709 13:03:14.672595  9233 raft_consensus.cc:493] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:14.672948  9233 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.678015  9233 raft_consensus.cc:515] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:14.680284  9233 leader_election.cc:290] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 3 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:14.680457  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:14.681097  9503 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.681247  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:14.681854  9306 raft_consensus.cc:3055] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:14.682123  9306 raft_consensus.cc:740] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:14.682804  9306 consensus_queue.cc:260] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:14.683985  9306 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.687899  9503 raft_consensus.cc:2468] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 3.
I20260709 13:03:14.689090  9197 leader_election.cc:304] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:14.689929  9600 raft_consensus.cc:2804] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:14.690393  9600 raft_consensus.cc:697] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:14.690455  9306 raft_consensus.cc:2468] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 3.
I20260709 13:03:14.691309  9600 consensus_queue.cc:237] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:14.697540  9053 catalog_manager.cc:5697] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 2 to 3, leader changed from a6bcc62f665849f09a58081d7e222a3a (127.0.107.195) to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:14.806037  9561 raft_consensus.cc:993] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77: : Instructing follower a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:14.806699  9545 raft_consensus.cc:1081] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Signalling peer a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:14.808369  9306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:14.808904  9306 raft_consensus.cc:493] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:14.809211  9306 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:14.813753  9306 raft_consensus.cc:515] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:14.815776  9306 leader_election.cc:290] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 4 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:14.816782  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:14.817535  9503 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:14.817392  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:14.818326  9233 raft_consensus.cc:3055] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:14.818645  9233 raft_consensus.cc:740] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:14.819377  9233 consensus_queue.cc:260] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:14.820571  9233 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:14.825130  9503 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 4.
I20260709 13:03:14.826330  9271 leader_election.cc:304] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:14.827092  9233 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 4.
I20260709 13:03:14.827153  9568 raft_consensus.cc:2804] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:14.828171  9568 raft_consensus.cc:697] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 4 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:14.829191  9568 consensus_queue.cc:237] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:14.835110  9053 catalog_manager.cc:5697] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 3 to 4, leader changed from b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 4 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.029127  9503 raft_consensus.cc:1275] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:15.030511  9545 consensus_queue.cc:1048] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:15.040218  9306 raft_consensus.cc:1275] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:15.041513  9561 consensus_queue.cc:1048] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:15.139642  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:15.156672  9503 raft_consensus.cc:1275] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:15.158054  9561 consensus_queue.cc:1048] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:15.167922  9306 raft_consensus.cc:1275] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:15.169368  9561 consensus_queue.cc:1048] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:15.406638  9503 raft_consensus.cc:1275] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 4 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:15.407965  9568 consensus_queue.cc:1048] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:15.424755  9233 raft_consensus.cc:1275] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 4 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:15.426201  9614 consensus_queue.cc:1048] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:15.496635   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:15.503695  9306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
mode: GRACEFUL
new_leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:46390
I20260709 13:03:15.504144  9306 raft_consensus.cc:606] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 4 LEADER]: Received request to transfer leadership to TS b637e9d8b4d04fd4a015c2d0ba350b77
I20260709 13:03:15.506466  9233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9223119a5d98444daf976419d90c6670"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
mode: GRACEFUL
new_leader_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:59320
I20260709 13:03:15.507030  9233 raft_consensus.cc:606] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Received request to transfer leadership to TS a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:15.509697  9233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b329f33dd9274eac8826771258e523d0"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
mode: GRACEFUL
new_leader_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:59320
I20260709 13:03:15.510258  9233 raft_consensus.cc:606] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Received request to transfer leadership to TS a6bcc62f665849f09a58081d7e222a3a
I20260709 13:03:15.511409   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:15.512136   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:15.512872   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:15.732542  9600 raft_consensus.cc:993] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77: : Instructing follower a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:15.733021  9561 raft_consensus.cc:1081] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Signalling peer a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:15.734323  9306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b329f33dd9274eac8826771258e523d0"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:15.734799  9306 raft_consensus.cc:493] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.735085  9306 raft_consensus.cc:3060] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:15.739389  9306 raft_consensus.cc:515] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:15.740778  9306 leader_election.cc:290] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 3 election: Requested vote from peers b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647), 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813)
I20260709 13:03:15.741557  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329f33dd9274eac8826771258e523d0" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:15.741751  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b329f33dd9274eac8826771258e523d0" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:15.742197  9233 raft_consensus.cc:3055] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:15.742290  9503 raft_consensus.cc:3060] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:15.742579  9233 raft_consensus.cc:740] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:15.743422  9233 consensus_queue.cc:260] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:15.744624  9233 raft_consensus.cc:3060] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:15.749354  9503 raft_consensus.cc:2468] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 3.
I20260709 13:03:15.750609  9271 leader_election.cc:304] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:15.751169  9233 raft_consensus.cc:2468] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 3.
I20260709 13:03:15.751423  9614 raft_consensus.cc:2804] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:15.751999  9614 raft_consensus.cc:697] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 3 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:15.752815  9614 consensus_queue.cc:237] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:15.759725  9053 catalog_manager.cc:5697] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 2 to 3, leader changed from b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.784885  9545 raft_consensus.cc:993] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77: : Instructing follower a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:15.785395  9561 raft_consensus.cc:1081] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Signalling peer a6bcc62f665849f09a58081d7e222a3a to start an election
I20260709 13:03:15.786897  9306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9223119a5d98444daf976419d90c6670"
dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:15.787348  9306 raft_consensus.cc:493] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.787655  9306 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:15.792586  9306 raft_consensus.cc:515] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:15.794092  9306 leader_election.cc:290] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 4 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647)
I20260709 13:03:15.794734  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:15.795090  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9223119a5d98444daf976419d90c6670" candidate_uuid: "a6bcc62f665849f09a58081d7e222a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
I20260709 13:03:15.795269  9503 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:15.795703  9233 raft_consensus.cc:3055] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:15.795957  9233 raft_consensus.cc:740] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:15.796700  9233 consensus_queue.cc:260] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:15.797740  9233 raft_consensus.cc:3060] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:15.800998  9503 raft_consensus.cc:2468] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 4.
I20260709 13:03:15.801963  9271 leader_election.cc:304] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, a6bcc62f665849f09a58081d7e222a3a; no voters: 
I20260709 13:03:15.802649  9614 raft_consensus.cc:2804] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:15.803035  9233 raft_consensus.cc:2468] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6bcc62f665849f09a58081d7e222a3a in term 4.
I20260709 13:03:15.803114  9614 raft_consensus.cc:697] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 4 LEADER]: Becoming Leader. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:15.804119  9614 consensus_queue.cc:237] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:15.809824  9053 catalog_manager.cc:5697] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a reported cstate change: term changed from 3 to 4, leader changed from b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194) to a6bcc62f665849f09a58081d7e222a3a (127.0.107.195). New cstate: current_term: 4 leader_uuid: "a6bcc62f665849f09a58081d7e222a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.866003  9616 raft_consensus.cc:993] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a: : Instructing follower b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:15.866561  9614 raft_consensus.cc:1081] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 4 LEADER]: Signalling peer b637e9d8b4d04fd4a015c2d0ba350b77 to start an election
I20260709 13:03:15.868105  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2"
dest_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77"
 from {username='slave'} at 127.0.0.1:59310
I20260709 13:03:15.868580  9233 raft_consensus.cc:493] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.868889  9233 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:15.873229  9233 raft_consensus.cc:515] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:15.874825  9233 leader_election.cc:290] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 5 election: Requested vote from peers 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813), a6bcc62f665849f09a58081d7e222a3a (127.0.107.195:36001)
I20260709 13:03:15.875573  9503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7ca8b1e786984ac581ce2308f04f2efd"
I20260709 13:03:15.875833  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bfecaabf1443158e39e96e1157a7e2" candidate_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a6bcc62f665849f09a58081d7e222a3a"
I20260709 13:03:15.876201  9503 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:15.876336  9306 raft_consensus.cc:3055] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:15.876721  9306 raft_consensus.cc:740] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a6bcc62f665849f09a58081d7e222a3a, State: Running, Role: LEADER
I20260709 13:03:15.877449  9306 consensus_queue.cc:260] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:15.878592  9306 raft_consensus.cc:3060] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:15.882612  9503 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 5.
I20260709 13:03:15.883725  9197 leader_election.cc:304] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca8b1e786984ac581ce2308f04f2efd, b637e9d8b4d04fd4a015c2d0ba350b77; no voters: 
I20260709 13:03:15.884356  9561 raft_consensus.cc:2804] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:15.884680  9306 raft_consensus.cc:2468] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b637e9d8b4d04fd4a015c2d0ba350b77 in term 5.
I20260709 13:03:15.884850  9561 raft_consensus.cc:697] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 5 LEADER]: Becoming Leader. State: Replica: b637e9d8b4d04fd4a015c2d0ba350b77, State: Running, Role: LEADER
I20260709 13:03:15.885694  9561 consensus_queue.cc:237] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } }
I20260709 13:03:15.891549  9053 catalog_manager.cc:5697] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 reported cstate change: term changed from 4 to 5, leader changed from a6bcc62f665849f09a58081d7e222a3a (127.0.107.195) to b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:16.140627  9104 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:16.241475  9233 raft_consensus.cc:1275] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:16.242806  9614 consensus_queue.cc:1048] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:16.252074  9503 raft_consensus.cc:1275] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:16.253786  9614 consensus_queue.cc:1048] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:16.339504  9503 raft_consensus.cc:1275] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 5 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:16.340600  9561 consensus_queue.cc:1048] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:16.348974  9306 raft_consensus.cc:1275] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 5 FOLLOWER]: Refusing update from remote peer b637e9d8b4d04fd4a015c2d0ba350b77: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:16.351058  9561 consensus_queue.cc:1048] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bcc62f665849f09a58081d7e222a3a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:16.355094  9233 raft_consensus.cc:1275] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 4 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:16.356276  9614 consensus_queue.cc:1048] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b637e9d8b4d04fd4a015c2d0ba350b77" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:16.365382  9503 raft_consensus.cc:1275] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 4 FOLLOWER]: Refusing update from remote peer a6bcc62f665849f09a58081d7e222a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:16.366771  9614 consensus_queue.cc:1048] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca8b1e786984ac581ce2308f04f2efd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:16.520972   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:16.548228   431 tablet_server.cc:179] TabletServer@127.0.107.193:42813 shutting down...
I20260709 13:03:16.565985   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:16.566738   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:16.567335   431 raft_consensus.cc:2243] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.567827   431 raft_consensus.cc:2272] T 1c7fb139d10643b5895afb2306ed6ca8 P 7ca8b1e786984ac581ce2308f04f2efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.569768   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:16.570312   431 raft_consensus.cc:2243] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.570778   431 raft_consensus.cc:2272] T d76aa97c166f48d98561f2e42738778d P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.572456   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:16.572966   431 raft_consensus.cc:2243] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.573354   431 raft_consensus.cc:2272] T 9541ba20e9a54ecc9113862db343c20f P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.575105   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:16.575598   431 raft_consensus.cc:2243] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.576018   431 raft_consensus.cc:2272] T 12bfecaabf1443158e39e96e1157a7e2 P 7ca8b1e786984ac581ce2308f04f2efd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.578073   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:16.578586   431 raft_consensus.cc:2243] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.579032   431 raft_consensus.cc:2272] T 7309aee806f04e2c8f5aa13f7f7c2b12 P 7ca8b1e786984ac581ce2308f04f2efd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.580856   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:16.581346   431 raft_consensus.cc:2243] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.581765   431 raft_consensus.cc:2272] T ebef3c776ccf4521a85ae47cbb63aaee P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.583560   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:16.584035   431 raft_consensus.cc:2243] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.584417   431 raft_consensus.cc:2272] T 9223119a5d98444daf976419d90c6670 P 7ca8b1e786984ac581ce2308f04f2efd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.587054   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:16.587318  9271 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 78 similar messages]
I20260709 13:03:16.587682   431 raft_consensus.cc:2243] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.588177   431 raft_consensus.cc:2272] T b329f33dd9274eac8826771258e523d0 P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.590237  9271 consensus_peers.cc:597] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.590710   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:16.591392   431 raft_consensus.cc:2243] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.591799   431 raft_consensus.cc:2272] T 58e28affd5924541bad949653a73740b P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.593672   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:16.594143   431 raft_consensus.cc:2243] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.594532   431 raft_consensus.cc:2272] T e5bf8bdbc6a945418a3e8aa01a4b977d P 7ca8b1e786984ac581ce2308f04f2efd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.622574   431 tablet_server.cc:196] TabletServer@127.0.107.193:42813 shutdown complete.
I20260709 13:03:16.641917   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:16.648507  9270 consensus_peers.cc:597] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a -> Peer b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647): Couldn't send request to peer b637e9d8b4d04fd4a015c2d0ba350b77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.667904   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:16.668974   431 tablet_replica.cc:333] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.669939   431 raft_consensus.cc:2243] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.670960   431 raft_consensus.cc:2272] T d76aa97c166f48d98561f2e42738778d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.673599   431 tablet_replica.cc:333] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.674301   431 raft_consensus.cc:2243] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.675271   431 raft_consensus.cc:2272] T 12bfecaabf1443158e39e96e1157a7e2 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.680038   431 tablet_replica.cc:333] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.680704   431 raft_consensus.cc:2243] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.681145   431 raft_consensus.cc:2272] T 9541ba20e9a54ecc9113862db343c20f P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.683236   431 tablet_replica.cc:333] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.683800   431 raft_consensus.cc:2243] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.684525   431 raft_consensus.cc:2272] T 7309aee806f04e2c8f5aa13f7f7c2b12 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.686509   431 tablet_replica.cc:333] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.687032   431 raft_consensus.cc:2243] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.687441   431 raft_consensus.cc:2272] T 9223119a5d98444daf976419d90c6670 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.690547   431 tablet_replica.cc:333] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.691254   431 raft_consensus.cc:2243] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.691737   431 raft_consensus.cc:2272] T 58e28affd5924541bad949653a73740b P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.693773   431 tablet_replica.cc:333] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.694296   431 raft_consensus.cc:2243] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.694756   431 raft_consensus.cc:2272] T b329f33dd9274eac8826771258e523d0 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.697067   431 tablet_replica.cc:333] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.697608   431 raft_consensus.cc:2243] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.698351   431 raft_consensus.cc:2272] T ebef3c776ccf4521a85ae47cbb63aaee P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.701056   431 tablet_replica.cc:333] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.701809   431 raft_consensus.cc:2243] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.702358   431 raft_consensus.cc:2272] T e5bf8bdbc6a945418a3e8aa01a4b977d P b637e9d8b4d04fd4a015c2d0ba350b77 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:16.703048  9270 consensus_peers.cc:597] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a -> Peer b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647): Couldn't send request to peer b637e9d8b4d04fd4a015c2d0ba350b77. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.704658   431 tablet_replica.cc:333] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77: stopping tablet replica
I20260709 13:03:16.705235   431 raft_consensus.cc:2243] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.705693   431 raft_consensus.cc:2272] T 1c7fb139d10643b5895afb2306ed6ca8 P b637e9d8b4d04fd4a015c2d0ba350b77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.737447   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:16.762400  9271 consensus_peers.cc:597] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a -> Peer 7ca8b1e786984ac581ce2308f04f2efd (127.0.107.193:42813): Couldn't send request to peer 7ca8b1e786984ac581ce2308f04f2efd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.763484   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:16.769883  9270 consensus_peers.cc:597] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a -> Peer b637e9d8b4d04fd4a015c2d0ba350b77 (127.0.107.194:42647): Couldn't send request to peer b637e9d8b4d04fd4a015c2d0ba350b77. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:42647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.795864   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:16.796624   431 tablet_replica.cc:333] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.797237   431 raft_consensus.cc:2243] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.797683   431 raft_consensus.cc:2272] T d76aa97c166f48d98561f2e42738778d P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.799746   431 tablet_replica.cc:333] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.800339   431 raft_consensus.cc:2243] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.801143   431 raft_consensus.cc:2272] T 1c7fb139d10643b5895afb2306ed6ca8 P a6bcc62f665849f09a58081d7e222a3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.803342   431 tablet_replica.cc:333] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.803884   431 raft_consensus.cc:2243] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.804620   431 raft_consensus.cc:2272] T e5bf8bdbc6a945418a3e8aa01a4b977d P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.806613   431 tablet_replica.cc:333] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.807219   431 raft_consensus.cc:2243] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.807626   431 raft_consensus.cc:2272] T 12bfecaabf1443158e39e96e1157a7e2 P a6bcc62f665849f09a58081d7e222a3a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.810005   431 tablet_replica.cc:333] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.810559   431 raft_consensus.cc:2243] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.811044   431 raft_consensus.cc:2272] T ebef3c776ccf4521a85ae47cbb63aaee P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.812979   431 tablet_replica.cc:333] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.813494   431 raft_consensus.cc:2243] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.814273   431 raft_consensus.cc:2272] T b329f33dd9274eac8826771258e523d0 P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.817047   431 tablet_replica.cc:333] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.817574   431 raft_consensus.cc:2243] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.818346   431 raft_consensus.cc:2272] T 58e28affd5924541bad949653a73740b P a6bcc62f665849f09a58081d7e222a3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.820420   431 tablet_replica.cc:333] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.820906   431 raft_consensus.cc:2243] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.821645   431 raft_consensus.cc:2272] T 9223119a5d98444daf976419d90c6670 P a6bcc62f665849f09a58081d7e222a3a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.823935   431 tablet_replica.cc:333] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.824499   431 raft_consensus.cc:2243] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.825212   431 raft_consensus.cc:2272] T 9541ba20e9a54ecc9113862db343c20f P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.827121   431 tablet_replica.cc:333] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a: stopping tablet replica
I20260709 13:03:16.827554   431 raft_consensus.cc:2243] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.827947   431 raft_consensus.cc:2272] T 7309aee806f04e2c8f5aa13f7f7c2b12 P a6bcc62f665849f09a58081d7e222a3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.857677   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:16.879866   431 master.cc:562] Master@127.0.107.254:38735 shutting down...
I20260709 13:03:16.908664   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.909253   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.909608   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P faf01ea9d5b24cfb99fccd8a21ddef89: stopping tablet replica
I20260709 13:03:16.947855   431 master.cc:584] Master@127.0.107.254:38735 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12997 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:03:16.991991   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41999
I20260709 13:03:16.993161   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:16.998845  9638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:16.999346  9637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:16.999588  9640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.000447   431 server_base.cc:1061] running on GCE node
I20260709 13:03:17.001324   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:17.001524   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:17.001727   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602197001706 us; error 0 us; skew 500 ppm
I20260709 13:03:17.002308   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:17.004500   431 webserver.cc:533] Webserver started at http://127.0.107.254:41291/ using document root <none> and password file <none>
I20260709 13:03:17.004977   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:17.005174   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:17.005458   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:17.006559   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/master-0-root/instance:
uuid: "ed04aabc30e84c6ab225e409ce456636"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-szgt"
I20260709 13:03:17.010896   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:03:17.014045  9645 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.014932   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:03:17.015166   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/master-0-root
uuid: "ed04aabc30e84c6ab225e409ce456636"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-szgt"
I20260709 13:03:17.015407   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:17.027040   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:17.028124   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:17.065450   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41999
I20260709 13:03:17.065536  9696 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41999 every 8 connection(s)
I20260709 13:03:17.069504  9697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.080130  9697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636: Bootstrap starting.
I20260709 13:03:17.084960  9697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.088886  9697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636: No bootstrap required, opened a new log
I20260709 13:03:17.090981  9697 raft_consensus.cc:359] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed04aabc30e84c6ab225e409ce456636" member_type: VOTER }
I20260709 13:03:17.091356  9697 raft_consensus.cc:385] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.091533  9697 raft_consensus.cc:740] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed04aabc30e84c6ab225e409ce456636, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.092612  9697 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed04aabc30e84c6ab225e409ce456636" member_type: VOTER }
I20260709 13:03:17.093128  9700 raft_consensus.cc:493] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.093611  9700 raft_consensus.cc:515] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed04aabc30e84c6ab225e409ce456636" member_type: VOTER }
I20260709 13:03:17.093102  9697 raft_consensus.cc:399] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:17.094152  9700 leader_election.cc:304] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed04aabc30e84c6ab225e409ce456636; no voters: 
I20260709 13:03:17.094347  9697 raft_consensus.cc:493] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:17.094722  9697 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.095638  9700 leader_election.cc:290] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 
I20260709 13:03:17.099910  9697 raft_consensus.cc:515] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed04aabc30e84c6ab225e409ce456636" member_type: VOTER }
I20260709 13:03:17.100592  9701 raft_consensus.cc:2764] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:03:17.100562  9697 leader_election.cc:304] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed04aabc30e84c6ab225e409ce456636; no voters: 
I20260709 13:03:17.101388  9697 leader_election.cc:290] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:17.101524  9700 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.103801  9700 raft_consensus.cc:697] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 1 LEADER]: Becoming Leader. State: Replica: ed04aabc30e84c6ab225e409ce456636, State: Running, Role: LEADER
I20260709 13:03:17.104435  9697 sys_catalog.cc:565] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:17.104473  9700 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed04aabc30e84c6ab225e409ce456636" member_type: VOTER }
I20260709 13:03:17.109267  9701 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed04aabc30e84c6ab225e409ce456636" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed04aabc30e84c6ab225e409ce456636" member_type: VOTER } }
I20260709 13:03:17.109907  9701 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:17.109632  9702 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed04aabc30e84c6ab225e409ce456636. Latest consensus state: current_term: 1 leader_uuid: "ed04aabc30e84c6ab225e409ce456636" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed04aabc30e84c6ab225e409ce456636" member_type: VOTER } }
I20260709 13:03:17.110572  9702 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:17.117070  9708 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:17.122216  9708 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:17.123447   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:17.130801  9708 catalog_manager.cc:1383] Generated new cluster ID: 28c18248ab62467cb631227e7229c1f4
I20260709 13:03:17.131119  9708 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:17.145056  9708 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:17.146390  9708 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:17.170730  9708 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636: Generated new TSK 0
I20260709 13:03:17.171341  9708 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:17.189854   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:17.195912  9719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.197016  9720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.204481   431 server_base.cc:1061] running on GCE node
W20260709 13:03:17.204427  9722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.205766   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:17.205962   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:17.206213   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602197206171 us; error 0 us; skew 500 ppm
I20260709 13:03:17.206933   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:17.209194   431 webserver.cc:533] Webserver started at http://127.0.107.193:39665/ using document root <none> and password file <none>
I20260709 13:03:17.209685   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:17.209895   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:17.210180   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:17.211310   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-0-root/instance:
uuid: "e3ccd3774ec344df9569671c7b7143c4"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-szgt"
I20260709 13:03:17.215731   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:17.218974  9727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.219693   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:17.219992   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "e3ccd3774ec344df9569671c7b7143c4"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-szgt"
I20260709 13:03:17.220274   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:17.234853   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:17.236045   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:17.237502   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:17.239807   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:17.240037   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.240293   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:17.240489   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.279922   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37757
I20260709 13:03:17.280026  9789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37757 every 8 connection(s)
I20260709 13:03:17.285421   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:17.292974  9794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.294034  9795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.297624  9798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.299937  9790 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41999
I20260709 13:03:17.300292   431 server_base.cc:1061] running on GCE node
I20260709 13:03:17.300369  9790 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:17.301530  9790 heartbeater.cc:507] Master 127.0.107.254:41999 requested a full tablet report, sending...
I20260709 13:03:17.301750   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:17.302047   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:17.302330   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602197302225 us; error 0 us; skew 500 ppm
I20260709 13:03:17.303233   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:17.303916  9662 ts_manager.cc:194] Registered new tserver with Master: e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757)
I20260709 13:03:17.305724   431 webserver.cc:533] Webserver started at http://127.0.107.194:43213/ using document root <none> and password file <none>
I20260709 13:03:17.306137  9662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48850
I20260709 13:03:17.306466   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:17.306808   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:17.307096   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:17.308501   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-1-root/instance:
uuid: "14cbc4991201465b8bb4557b18ed08ea"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-szgt"
I20260709 13:03:17.312723   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:17.316045  9802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.316932   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:03:17.317224   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-1-root
uuid: "14cbc4991201465b8bb4557b18ed08ea"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-szgt"
I20260709 13:03:17.317482   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:17.332859   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:17.334029   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:17.335520   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:17.337839   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:17.338058   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.338299   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:17.338475   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.377681   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33387
I20260709 13:03:17.377786  9864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33387 every 8 connection(s)
I20260709 13:03:17.382543   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:17.389743  9869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.389794  9868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.397367  9871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.397944  9865 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41999
I20260709 13:03:17.398409  9865 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:17.398923   431 server_base.cc:1061] running on GCE node
I20260709 13:03:17.399370  9865 heartbeater.cc:507] Master 127.0.107.254:41999 requested a full tablet report, sending...
I20260709 13:03:17.399900   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:17.400208   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:17.400429   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602197400410 us; error 0 us; skew 500 ppm
I20260709 13:03:17.401158   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:17.401543  9662 ts_manager.cc:194] Registered new tserver with Master: 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387)
I20260709 13:03:17.403203  9662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48854
I20260709 13:03:17.403774   431 webserver.cc:533] Webserver started at http://127.0.107.195:34571/ using document root <none> and password file <none>
I20260709 13:03:17.404448   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:17.404721   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:17.405030   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:17.406155   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-2-root/instance:
uuid: "9b9d0c370a19404ca5628b8058cac3ef"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-szgt"
I20260709 13:03:17.410377   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:03:17.413540  9876 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.414338   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:17.414649   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-2-root
uuid: "9b9d0c370a19404ca5628b8058cac3ef"
format_stamp: "Formatted at 2026-07-09 13:03:17 on dist-test-slave-szgt"
I20260709 13:03:17.415019   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601902018772-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:17.425462   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:17.426595   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:17.428054   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:17.430246   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:17.430477   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.430786   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:17.430967   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.470088   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43171
I20260709 13:03:17.470175  9938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43171 every 8 connection(s)
I20260709 13:03:17.483538  9939 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41999
I20260709 13:03:17.483911  9939 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:17.484573  9939 heartbeater.cc:507] Master 127.0.107.254:41999 requested a full tablet report, sending...
I20260709 13:03:17.486500  9662 ts_manager.cc:194] Registered new tserver with Master: 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171)
I20260709 13:03:17.486692   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01364923s
I20260709 13:03:17.488348  9662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48862
I20260709 13:03:17.512329  9662 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48864:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:17.514580  9662 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:17.570596  9903 tablet_service.cc:1511] Processing CreateTablet for tablet b5625fe828064451b925a293a59000b2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb9d88dade7e45e2851ff2c64b493384]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:17.570469  9904 tablet_service.cc:1511] Processing CreateTablet for tablet 24ecda968d974a489fb65e30f2b6c2e5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb9d88dade7e45e2851ff2c64b493384]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:17.572154  9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ecda968d974a489fb65e30f2b6c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.572891  9903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5625fe828064451b925a293a59000b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.578289  9755 tablet_service.cc:1511] Processing CreateTablet for tablet 24ecda968d974a489fb65e30f2b6c2e5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb9d88dade7e45e2851ff2c64b493384]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:17.579713  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ecda968d974a489fb65e30f2b6c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.585294  9830 tablet_service.cc:1511] Processing CreateTablet for tablet 24ecda968d974a489fb65e30f2b6c2e5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb9d88dade7e45e2851ff2c64b493384]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:17.586742  9830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ecda968d974a489fb65e30f2b6c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.588550  9754 tablet_service.cc:1511] Processing CreateTablet for tablet b5625fe828064451b925a293a59000b2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb9d88dade7e45e2851ff2c64b493384]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:17.589884  9754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5625fe828064451b925a293a59000b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.591954  9829 tablet_service.cc:1511] Processing CreateTablet for tablet b5625fe828064451b925a293a59000b2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb9d88dade7e45e2851ff2c64b493384]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:17.593292  9829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5625fe828064451b925a293a59000b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.603439  9955 tablet_bootstrap.cc:492] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef: Bootstrap starting.
I20260709 13:03:17.612486  9955 tablet_bootstrap.cc:654] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.616080  9954 tablet_bootstrap.cc:492] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4: Bootstrap starting.
I20260709 13:03:17.621989  9955 tablet_bootstrap.cc:492] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef: No bootstrap required, opened a new log
I20260709 13:03:17.622613  9955 ts_tablet_manager.cc:1403] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:03:17.627445  9957 tablet_bootstrap.cc:492] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea: Bootstrap starting.
I20260709 13:03:17.627487  9954 tablet_bootstrap.cc:654] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.628041  9955 raft_consensus.cc:359] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.628649  9955 raft_consensus.cc:385] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.628885  9955 raft_consensus.cc:740] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b9d0c370a19404ca5628b8058cac3ef, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.629567  9955 consensus_queue.cc:260] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.631950  9939 heartbeater.cc:499] Master 127.0.107.254:41999 was elected leader, sending a full tablet report...
I20260709 13:03:17.633015  9954 tablet_bootstrap.cc:492] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4: No bootstrap required, opened a new log
I20260709 13:03:17.633538  9954 ts_tablet_manager.cc:1403] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.006s
I20260709 13:03:17.634295  9955 ts_tablet_manager.cc:1434] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:03:17.634634  9957 tablet_bootstrap.cc:654] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.635402  9955 tablet_bootstrap.cc:492] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef: Bootstrap starting.
I20260709 13:03:17.636690  9954 raft_consensus.cc:359] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.637465  9954 raft_consensus.cc:385] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.637754  9954 raft_consensus.cc:740] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ccd3774ec344df9569671c7b7143c4, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.638799  9954 consensus_queue.cc:260] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.643381  9955 tablet_bootstrap.cc:654] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.652832  9790 heartbeater.cc:499] Master 127.0.107.254:41999 was elected leader, sending a full tablet report...
I20260709 13:03:17.653401  9954 ts_tablet_manager.cc:1434] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:03:17.653985  9957 tablet_bootstrap.cc:492] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea: No bootstrap required, opened a new log
I20260709 13:03:17.654487  9954 tablet_bootstrap.cc:492] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4: Bootstrap starting.
I20260709 13:03:17.654522  9957 ts_tablet_manager.cc:1403] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 13:03:17.655123  9955 tablet_bootstrap.cc:492] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef: No bootstrap required, opened a new log
I20260709 13:03:17.655673  9955 ts_tablet_manager.cc:1403] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.004s
I20260709 13:03:17.657886  9957 raft_consensus.cc:359] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.658751  9957 raft_consensus.cc:385] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.658558  9955 raft_consensus.cc:359] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.659197  9957 raft_consensus.cc:740] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14cbc4991201465b8bb4557b18ed08ea, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.659482  9955 raft_consensus.cc:385] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.659909  9955 raft_consensus.cc:740] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b9d0c370a19404ca5628b8058cac3ef, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.660181  9957 consensus_queue.cc:260] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.660703  9955 consensus_queue.cc:260] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.662199  9954 tablet_bootstrap.cc:654] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.663026  9955 ts_tablet_manager.cc:1434] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:17.664793  9961 raft_consensus.cc:493] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.665230  9961 raft_consensus.cc:515] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.667763  9961 leader_election.cc:290] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171), 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387)
I20260709 13:03:17.679888  9959 raft_consensus.cc:493] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.680437  9959 raft_consensus.cc:515] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.684340  9959 leader_election.cc:290] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757), 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387)
I20260709 13:03:17.702311  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5625fe828064451b925a293a59000b2" candidate_uuid: "9b9d0c370a19404ca5628b8058cac3ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ccd3774ec344df9569671c7b7143c4" is_pre_election: true
W20260709 13:03:17.704741  9880 leader_election.cc:343] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:17.707574  9865 heartbeater.cc:499] Master 127.0.107.254:41999 was elected leader, sending a full tablet report...
I20260709 13:03:17.708150  9957 ts_tablet_manager.cc:1434] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea: Time spent starting tablet: real 0.053s	user 0.027s	sys 0.023s
I20260709 13:03:17.710139  9957 tablet_bootstrap.cc:492] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea: Bootstrap starting.
I20260709 13:03:17.710024  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ecda968d974a489fb65e30f2b6c2e5" candidate_uuid: "e3ccd3774ec344df9569671c7b7143c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef" is_pre_election: true
I20260709 13:03:17.710839  9914 raft_consensus.cc:2468] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ccd3774ec344df9569671c7b7143c4 in term 0.
I20260709 13:03:17.711730  9954 tablet_bootstrap.cc:492] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4: No bootstrap required, opened a new log
I20260709 13:03:17.712066  9840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ecda968d974a489fb65e30f2b6c2e5" candidate_uuid: "e3ccd3774ec344df9569671c7b7143c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14cbc4991201465b8bb4557b18ed08ea" is_pre_election: true
W20260709 13:03:17.714370  9729 leader_election.cc:343] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:17.715230  9729 leader_election.cc:304] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b9d0c370a19404ca5628b8058cac3ef, e3ccd3774ec344df9569671c7b7143c4; no voters: 14cbc4991201465b8bb4557b18ed08ea
I20260709 13:03:17.716130  9961 raft_consensus.cc:2804] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.716490  9961 raft_consensus.cc:493] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.716817  9961 raft_consensus.cc:3060] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.717690  9957 tablet_bootstrap.cc:654] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.724077  9840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5625fe828064451b925a293a59000b2" candidate_uuid: "9b9d0c370a19404ca5628b8058cac3ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14cbc4991201465b8bb4557b18ed08ea" is_pre_election: true
I20260709 13:03:17.724761  9840 raft_consensus.cc:2468] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b9d0c370a19404ca5628b8058cac3ef in term 0.
I20260709 13:03:17.726126  9878 leader_election.cc:304] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14cbc4991201465b8bb4557b18ed08ea, 9b9d0c370a19404ca5628b8058cac3ef; no voters: e3ccd3774ec344df9569671c7b7143c4
I20260709 13:03:17.727057  9959 raft_consensus.cc:2804] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.727422  9959 raft_consensus.cc:493] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.727770  9959 raft_consensus.cc:3060] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.727972  9961 raft_consensus.cc:515] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.730811  9961 leader_election.cc:290] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171), 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387)
I20260709 13:03:17.712270  9954 ts_tablet_manager.cc:1403] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.000s
I20260709 13:03:17.731396  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ecda968d974a489fb65e30f2b6c2e5" candidate_uuid: "e3ccd3774ec344df9569671c7b7143c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef"
I20260709 13:03:17.732046  9914 raft_consensus.cc:3060] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.734905  9959 raft_consensus.cc:515] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.735289  9954 raft_consensus.cc:359] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.736642  9954 raft_consensus.cc:385] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.737123  9954 raft_consensus.cc:740] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ccd3774ec344df9569671c7b7143c4, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.737807  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5625fe828064451b925a293a59000b2" candidate_uuid: "9b9d0c370a19404ca5628b8058cac3ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ccd3774ec344df9569671c7b7143c4"
I20260709 13:03:17.739935  9954 consensus_queue.cc:260] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.740774  9914 raft_consensus.cc:2468] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ccd3774ec344df9569671c7b7143c4 in term 1.
I20260709 13:03:17.741411  9765 raft_consensus.cc:3060] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.742116  9959 leader_election.cc:290] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [CANDIDATE]: Term 1 election: Requested vote from peers e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757), 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387)
I20260709 13:03:17.742888  9840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ecda968d974a489fb65e30f2b6c2e5" candidate_uuid: "e3ccd3774ec344df9569671c7b7143c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14cbc4991201465b8bb4557b18ed08ea"
I20260709 13:03:17.744720  9729 leader_election.cc:304] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b9d0c370a19404ca5628b8058cac3ef, e3ccd3774ec344df9569671c7b7143c4; no voters: 
I20260709 13:03:17.745142  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5625fe828064451b925a293a59000b2" candidate_uuid: "9b9d0c370a19404ca5628b8058cac3ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14cbc4991201465b8bb4557b18ed08ea"
W20260709 13:03:17.745647  9729 leader_election.cc:343] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:17.745841  9839 raft_consensus.cc:3060] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.746924  9961 raft_consensus.cc:2804] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.748413  9957 tablet_bootstrap.cc:492] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea: No bootstrap required, opened a new log
I20260709 13:03:17.749676  9765 raft_consensus.cc:2468] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b9d0c370a19404ca5628b8058cac3ef in term 1.
I20260709 13:03:17.750833  9957 ts_tablet_manager.cc:1403] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.012s
I20260709 13:03:17.753935  9880 leader_election.cc:304] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b9d0c370a19404ca5628b8058cac3ef, e3ccd3774ec344df9569671c7b7143c4; no voters: 
I20260709 13:03:17.754046  9957 raft_consensus.cc:359] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.754813  9957 raft_consensus.cc:385] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.754703  9839 raft_consensus.cc:2468] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b9d0c370a19404ca5628b8058cac3ef in term 1.
I20260709 13:03:17.755394  9957 raft_consensus.cc:740] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14cbc4991201465b8bb4557b18ed08ea, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.756240  9957 consensus_queue.cc:260] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.754942  9959 raft_consensus.cc:2804] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.758564  9957 ts_tablet_manager.cc:1434] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:17.762346  9961 raft_consensus.cc:697] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 1 LEADER]: Becoming Leader. State: Replica: e3ccd3774ec344df9569671c7b7143c4, State: Running, Role: LEADER
I20260709 13:03:17.763535  9961 consensus_queue.cc:237] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.768687  9959 raft_consensus.cc:697] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 LEADER]: Becoming Leader. State: Replica: 9b9d0c370a19404ca5628b8058cac3ef, State: Running, Role: LEADER
I20260709 13:03:17.769409  9954 ts_tablet_manager.cc:1434] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4: Time spent starting tablet: real 0.038s	user 0.013s	sys 0.007s
I20260709 13:03:17.770179  9959 consensus_queue.cc:237] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.777922  9662 catalog_manager.cc:5697] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3ccd3774ec344df9569671c7b7143c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.779302  9660 catalog_manager.cc:5697] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9b9d0c370a19404ca5628b8058cac3ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.800591  9963 raft_consensus.cc:493] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.801146  9963 raft_consensus.cc:515] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } }
I20260709 13:03:17.803329  9963 leader_election.cc:290] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171), e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757)
I20260709 13:03:17.813066  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ecda968d974a489fb65e30f2b6c2e5" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef" is_pre_election: true
I20260709 13:03:17.813792  9914 raft_consensus.cc:2393] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14cbc4991201465b8bb4557b18ed08ea in current term 1: Already voted for candidate e3ccd3774ec344df9569671c7b7143c4 in this term.
I20260709 13:03:17.813905  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ecda968d974a489fb65e30f2b6c2e5" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ccd3774ec344df9569671c7b7143c4" is_pre_election: true
I20260709 13:03:17.815284  9806 leader_election.cc:304] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14cbc4991201465b8bb4557b18ed08ea; no voters: 9b9d0c370a19404ca5628b8058cac3ef, e3ccd3774ec344df9569671c7b7143c4
I20260709 13:03:17.815999  9963 raft_consensus.cc:3060] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.821162  9963 raft_consensus.cc:2749] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:17.850656  9660 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48876:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:17.852674  9660 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:17.874068  9754 tablet_service.cc:1511] Processing CreateTablet for tablet 249c4847c03241d7be933163f38ffadc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da734b881dd54d63a951c6d5a2fc13b6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:17.875367  9754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 249c4847c03241d7be933163f38ffadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.875378  9829 tablet_service.cc:1511] Processing CreateTablet for tablet 249c4847c03241d7be933163f38ffadc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da734b881dd54d63a951c6d5a2fc13b6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:17.876787  9829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 249c4847c03241d7be933163f38ffadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.877554  9903 tablet_service.cc:1511] Processing CreateTablet for tablet 249c4847c03241d7be933163f38ffadc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da734b881dd54d63a951c6d5a2fc13b6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:17.878803  9903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 249c4847c03241d7be933163f38ffadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.878368  9755 tablet_service.cc:1511] Processing CreateTablet for tablet 97375fce1515418bbf6ffd81280c8fda (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da734b881dd54d63a951c6d5a2fc13b6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:17.879741  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97375fce1515418bbf6ffd81280c8fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.891868  9954 tablet_bootstrap.cc:492] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4: Bootstrap starting.
I20260709 13:03:17.892159  9957 tablet_bootstrap.cc:492] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea: Bootstrap starting.
I20260709 13:03:17.897981  9904 tablet_service.cc:1511] Processing CreateTablet for tablet 97375fce1515418bbf6ffd81280c8fda (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da734b881dd54d63a951c6d5a2fc13b6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:17.899331  9904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97375fce1515418bbf6ffd81280c8fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.899578  9830 tablet_service.cc:1511] Processing CreateTablet for tablet 97375fce1515418bbf6ffd81280c8fda (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da734b881dd54d63a951c6d5a2fc13b6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:17.900784  9830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97375fce1515418bbf6ffd81280c8fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.903767  9955 tablet_bootstrap.cc:492] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef: Bootstrap starting.
I20260709 13:03:17.905012  9957 tablet_bootstrap.cc:654] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.898386  9954 tablet_bootstrap.cc:654] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.915803  9955 tablet_bootstrap.cc:654] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.916888  9957 tablet_bootstrap.cc:492] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea: No bootstrap required, opened a new log
I20260709 13:03:17.917425  9957 ts_tablet_manager.cc:1403] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.006s
I20260709 13:03:17.920385  9957 raft_consensus.cc:359] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.921097  9957 raft_consensus.cc:385] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.921397  9957 raft_consensus.cc:740] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14cbc4991201465b8bb4557b18ed08ea, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.922488  9957 consensus_queue.cc:260] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.924796  9957 ts_tablet_manager.cc:1434] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:03:17.925400  9955 tablet_bootstrap.cc:492] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef: No bootstrap required, opened a new log
I20260709 13:03:17.925422  9954 tablet_bootstrap.cc:492] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4: No bootstrap required, opened a new log
I20260709 13:03:17.925822  9957 tablet_bootstrap.cc:492] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea: Bootstrap starting.
I20260709 13:03:17.926097  9955 ts_tablet_manager.cc:1403] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 13:03:17.926270  9954 ts_tablet_manager.cc:1403] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.005s
I20260709 13:03:17.929170  9955 raft_consensus.cc:359] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.929412  9954 raft_consensus.cc:359] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.929922  9955 raft_consensus.cc:385] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.930361  9954 raft_consensus.cc:385] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.930361  9955 raft_consensus.cc:740] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b9d0c370a19404ca5628b8058cac3ef, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.930830  9954 raft_consensus.cc:740] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ccd3774ec344df9569671c7b7143c4, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.931473  9955 consensus_queue.cc:260] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.931746  9954 consensus_queue.cc:260] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.932705  9957 tablet_bootstrap.cc:654] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.934412  9954 ts_tablet_manager.cc:1434] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:03:17.936043  9954 tablet_bootstrap.cc:492] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4: Bootstrap starting.
I20260709 13:03:17.937628  9955 ts_tablet_manager.cc:1434] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:03:17.938655  9955 tablet_bootstrap.cc:492] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef: Bootstrap starting.
I20260709 13:03:17.947767  9954 tablet_bootstrap.cc:654] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.952598  9955 tablet_bootstrap.cc:654] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.958269  9954 tablet_bootstrap.cc:492] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4: No bootstrap required, opened a new log
I20260709 13:03:17.958420  9957 tablet_bootstrap.cc:492] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea: No bootstrap required, opened a new log
I20260709 13:03:17.958786  9954 ts_tablet_manager.cc:1403] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:03:17.959244  9957 ts_tablet_manager.cc:1403] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.019s
I20260709 13:03:17.961280  9954 raft_consensus.cc:359] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.961885  9954 raft_consensus.cc:385] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.962121  9954 raft_consensus.cc:740] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ccd3774ec344df9569671c7b7143c4, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.962805  9954 consensus_queue.cc:260] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.963394  9957 raft_consensus.cc:359] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.964392  9957 raft_consensus.cc:385] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.964813  9954 ts_tablet_manager.cc:1434] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:17.964762  9957 raft_consensus.cc:740] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14cbc4991201465b8bb4557b18ed08ea, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.966022  9957 consensus_queue.cc:260] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.968330  9957 ts_tablet_manager.cc:1434] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:03:17.968780  9955 tablet_bootstrap.cc:492] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef: No bootstrap required, opened a new log
I20260709 13:03:17.969278  9955 ts_tablet_manager.cc:1403] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.004s
I20260709 13:03:17.972160  9955 raft_consensus.cc:359] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.972815  9955 raft_consensus.cc:385] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.973130  9955 raft_consensus.cc:740] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b9d0c370a19404ca5628b8058cac3ef, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.973809  9955 consensus_queue.cc:260] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:17.975497  9955 ts_tablet_manager.cc:1434] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:18.035104  9963 raft_consensus.cc:493] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.035656  9963 raft_consensus.cc:515] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.037218  9963 leader_election.cc:290] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757), 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171)
I20260709 13:03:18.038024  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97375fce1515418bbf6ffd81280c8fda" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ccd3774ec344df9569671c7b7143c4" is_pre_election: true
I20260709 13:03:18.038213  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97375fce1515418bbf6ffd81280c8fda" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef" is_pre_election: true
I20260709 13:03:18.038614  9765 raft_consensus.cc:2468] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14cbc4991201465b8bb4557b18ed08ea in term 0.
I20260709 13:03:18.038918  9914 raft_consensus.cc:2468] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14cbc4991201465b8bb4557b18ed08ea in term 0.
I20260709 13:03:18.039644  9806 leader_election.cc:304] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14cbc4991201465b8bb4557b18ed08ea, e3ccd3774ec344df9569671c7b7143c4; no voters: 
I20260709 13:03:18.040411  9963 raft_consensus.cc:2804] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.040721  9963 raft_consensus.cc:493] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.040990  9963 raft_consensus.cc:3060] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.045490  9963 raft_consensus.cc:515] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.047071  9963 leader_election.cc:290] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757), 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171)
I20260709 13:03:18.047663  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97375fce1515418bbf6ffd81280c8fda" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ccd3774ec344df9569671c7b7143c4"
I20260709 13:03:18.047904  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97375fce1515418bbf6ffd81280c8fda" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef"
I20260709 13:03:18.048180  9765 raft_consensus.cc:3060] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.048453  9914 raft_consensus.cc:3060] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.053071  9765 raft_consensus.cc:2468] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14cbc4991201465b8bb4557b18ed08ea in term 1.
I20260709 13:03:18.053803  9914 raft_consensus.cc:2468] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14cbc4991201465b8bb4557b18ed08ea in term 1.
I20260709 13:03:18.054092  9806 leader_election.cc:304] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14cbc4991201465b8bb4557b18ed08ea, e3ccd3774ec344df9569671c7b7143c4; no voters: 
I20260709 13:03:18.054930  9963 raft_consensus.cc:2804] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.055939  9963 raft_consensus.cc:697] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Becoming Leader. State: Replica: 14cbc4991201465b8bb4557b18ed08ea, State: Running, Role: LEADER
I20260709 13:03:18.056746  9963 consensus_queue.cc:237] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.063107  9660 catalog_manager.cc:5697] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194). New cstate: current_term: 1 leader_uuid: "14cbc4991201465b8bb4557b18ed08ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.073839  9963 raft_consensus.cc:493] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.074245  9963 raft_consensus.cc:515] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.075928  9963 leader_election.cc:290] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757), 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171)
I20260709 13:03:18.076491  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249c4847c03241d7be933163f38ffadc" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ccd3774ec344df9569671c7b7143c4" is_pre_election: true
I20260709 13:03:18.076869  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249c4847c03241d7be933163f38ffadc" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef" is_pre_election: true
I20260709 13:03:18.077055  9765 raft_consensus.cc:2468] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14cbc4991201465b8bb4557b18ed08ea in term 0.
I20260709 13:03:18.077459  9914 raft_consensus.cc:2468] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14cbc4991201465b8bb4557b18ed08ea in term 0.
I20260709 13:03:18.078032  9806 leader_election.cc:304] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14cbc4991201465b8bb4557b18ed08ea, e3ccd3774ec344df9569671c7b7143c4; no voters: 
I20260709 13:03:18.078715  9963 raft_consensus.cc:2804] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.079030  9963 raft_consensus.cc:493] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.079241  9963 raft_consensus.cc:3060] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.083835  9963 raft_consensus.cc:515] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.085701  9963 leader_election.cc:290] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757), 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171)
I20260709 13:03:18.086282  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249c4847c03241d7be933163f38ffadc" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ccd3774ec344df9569671c7b7143c4"
I20260709 13:03:18.086710  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249c4847c03241d7be933163f38ffadc" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef"
I20260709 13:03:18.086915  9765 raft_consensus.cc:3060] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.087289  9914 raft_consensus.cc:3060] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.093735  9914 raft_consensus.cc:2468] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14cbc4991201465b8bb4557b18ed08ea in term 1.
I20260709 13:03:18.093735  9765 raft_consensus.cc:2468] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14cbc4991201465b8bb4557b18ed08ea in term 1.
I20260709 13:03:18.095012  9804 leader_election.cc:304] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14cbc4991201465b8bb4557b18ed08ea, 9b9d0c370a19404ca5628b8058cac3ef; no voters: 
I20260709 13:03:18.095659  9963 raft_consensus.cc:2804] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.096045  9963 raft_consensus.cc:697] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Becoming Leader. State: Replica: 14cbc4991201465b8bb4557b18ed08ea, State: Running, Role: LEADER
I20260709 13:03:18.096836  9963 consensus_queue.cc:237] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.102612  9660 catalog_manager.cc:5697] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194). New cstate: current_term: 1 leader_uuid: "14cbc4991201465b8bb4557b18ed08ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.153594  9914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5625fe828064451b925a293a59000b2"
dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef"
mode: GRACEFUL
new_leader_uuid: "14cbc4991201465b8bb4557b18ed08ea"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:03:18.154162  9914 raft_consensus.cc:606] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 LEADER]: Received request to transfer leadership to TS 14cbc4991201465b8bb4557b18ed08ea
I20260709 13:03:18.166222  9839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "249c4847c03241d7be933163f38ffadc"
dest_uuid: "14cbc4991201465b8bb4557b18ed08ea"
mode: GRACEFUL
new_leader_uuid: "e3ccd3774ec344df9569671c7b7143c4"
 from {username='slave'} at 127.0.0.1:57532
I20260709 13:03:18.166778  9839 raft_consensus.cc:606] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Received request to transfer leadership to TS e3ccd3774ec344df9569671c7b7143c4
I20260709 13:03:18.168085  9959 consensus_queue.cc:1048] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.172854  9840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97375fce1515418bbf6ffd81280c8fda"
dest_uuid: "14cbc4991201465b8bb4557b18ed08ea"
mode: GRACEFUL
new_leader_uuid: "e3ccd3774ec344df9569671c7b7143c4"
 from {username='slave'} at 127.0.0.1:57532
I20260709 13:03:18.173470  9840 raft_consensus.cc:606] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Received request to transfer leadership to TS e3ccd3774ec344df9569671c7b7143c4
I20260709 13:03:18.175084  9970 raft_consensus.cc:993] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef: : Instructing follower 14cbc4991201465b8bb4557b18ed08ea to start an election
I20260709 13:03:18.175781  9959 raft_consensus.cc:1081] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 LEADER]: Signalling peer 14cbc4991201465b8bb4557b18ed08ea to start an election
I20260709 13:03:18.178366  9839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5625fe828064451b925a293a59000b2"
dest_uuid: "14cbc4991201465b8bb4557b18ed08ea"
 from {username='slave'} at 127.0.0.1:57520
I20260709 13:03:18.185115  9839 raft_consensus.cc:493] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:18.185546  9839 raft_consensus.cc:3060] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.190305  9970 consensus_queue.cc:1048] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:18.192809  9839 raft_consensus.cc:515] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.198561  9839 leader_election.cc:290] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757), 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171)
I20260709 13:03:18.199402  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5625fe828064451b925a293a59000b2" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ccd3774ec344df9569671c7b7143c4"
I20260709 13:03:18.199970  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5625fe828064451b925a293a59000b2" candidate_uuid: "14cbc4991201465b8bb4557b18ed08ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef"
I20260709 13:03:18.200738  9914 raft_consensus.cc:3055] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.201143  9914 raft_consensus.cc:740] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b9d0c370a19404ca5628b8058cac3ef, State: Running, Role: LEADER
I20260709 13:03:18.202243  9914 consensus_queue.cc:260] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.203320  9914 raft_consensus.cc:3060] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.213275  9914 raft_consensus.cc:2468] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14cbc4991201465b8bb4557b18ed08ea in term 2.
I20260709 13:03:18.215214  9804 leader_election.cc:304] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14cbc4991201465b8bb4557b18ed08ea, 9b9d0c370a19404ca5628b8058cac3ef; no voters: e3ccd3774ec344df9569671c7b7143c4
I20260709 13:03:18.216365  9963 raft_consensus.cc:2804] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.216879  9963 raft_consensus.cc:697] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 2 LEADER]: Becoming Leader. State: Replica: 14cbc4991201465b8bb4557b18ed08ea, State: Running, Role: LEADER
I20260709 13:03:18.217696  9963 consensus_queue.cc:237] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.226982  9661 catalog_manager.cc:5697] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea reported cstate change: term changed from 1 to 2, leader changed from 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195) to 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194). New cstate: current_term: 2 leader_uuid: "14cbc4991201465b8bb4557b18ed08ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.312176  9961 consensus_queue.cc:1048] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:18.320760  9997 consensus_queue.cc:1048] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:18.501933  9963 consensus_queue.cc:1048] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.509514 10001 consensus_queue.cc:1048] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.516094  9963 consensus_queue.cc:1048] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.525345  9963 raft_consensus.cc:993] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea: : Instructing follower e3ccd3774ec344df9569671c7b7143c4 to start an election
I20260709 13:03:18.525851 10002 raft_consensus.cc:1081] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Signalling peer e3ccd3774ec344df9569671c7b7143c4 to start an election
I20260709 13:03:18.528987  9764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "249c4847c03241d7be933163f38ffadc"
dest_uuid: "e3ccd3774ec344df9569671c7b7143c4"
 from {username='slave'} at 127.0.0.1:59728
I20260709 13:03:18.529613  9764 raft_consensus.cc:493] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:18.530073  9764 raft_consensus.cc:3060] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.533990 10002 consensus_queue.cc:1048] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.538321  9764 raft_consensus.cc:515] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.539598  9763 raft_consensus.cc:1240] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Rejecting Update request from peer 14cbc4991201465b8bb4557b18ed08ea for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:18.541065  9764 leader_election.cc:290] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 2 election: Requested vote from peers 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387), 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171)
I20260709 13:03:18.541666  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249c4847c03241d7be933163f38ffadc" candidate_uuid: "e3ccd3774ec344df9569671c7b7143c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14cbc4991201465b8bb4557b18ed08ea"
I20260709 13:03:18.542305  9839 raft_consensus.cc:3055] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.542623  9839 raft_consensus.cc:740] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14cbc4991201465b8bb4557b18ed08ea, State: Running, Role: LEADER
I20260709 13:03:18.544025  9839 consensus_queue.cc:260] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.545181  9839 raft_consensus.cc:3060] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.547175 10002 raft_consensus.cc:993] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea: : Instructing follower e3ccd3774ec344df9569671c7b7143c4 to start an election
I20260709 13:03:18.547857  9986 raft_consensus.cc:1081] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Signalling peer e3ccd3774ec344df9569671c7b7143c4 to start an election
I20260709 13:03:18.549588  9765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97375fce1515418bbf6ffd81280c8fda"
dest_uuid: "e3ccd3774ec344df9569671c7b7143c4"
 from {username='slave'} at 127.0.0.1:59728
I20260709 13:03:18.550140  9765 raft_consensus.cc:493] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:18.550534  9765 raft_consensus.cc:3060] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.551019  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249c4847c03241d7be933163f38ffadc" candidate_uuid: "e3ccd3774ec344df9569671c7b7143c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef"
I20260709 13:03:18.551641  9914 raft_consensus.cc:3060] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.555064  9839 raft_consensus.cc:2468] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ccd3774ec344df9569671c7b7143c4 in term 2.
I20260709 13:03:18.556246  9729 leader_election.cc:304] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14cbc4991201465b8bb4557b18ed08ea, e3ccd3774ec344df9569671c7b7143c4; no voters: 
I20260709 13:03:18.556927  9914 raft_consensus.cc:2468] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ccd3774ec344df9569671c7b7143c4 in term 2.
I20260709 13:03:18.557201  9998 raft_consensus.cc:2804] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.557724  9998 raft_consensus.cc:697] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 2 LEADER]: Becoming Leader. State: Replica: e3ccd3774ec344df9569671c7b7143c4, State: Running, Role: LEADER
I20260709 13:03:18.558492  9998 consensus_queue.cc:237] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.560390  9765 raft_consensus.cc:515] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.562328  9765 leader_election.cc:290] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 2 election: Requested vote from peers 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387), 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195:43171)
I20260709 13:03:18.563480  9914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97375fce1515418bbf6ffd81280c8fda" candidate_uuid: "e3ccd3774ec344df9569671c7b7143c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef"
I20260709 13:03:18.564049  9914 raft_consensus.cc:3060] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.564216  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97375fce1515418bbf6ffd81280c8fda" candidate_uuid: "e3ccd3774ec344df9569671c7b7143c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14cbc4991201465b8bb4557b18ed08ea"
I20260709 13:03:18.564934  9839 raft_consensus.cc:3055] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:18.565264  9839 raft_consensus.cc:740] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14cbc4991201465b8bb4557b18ed08ea, State: Running, Role: LEADER
I20260709 13:03:18.566222  9839 consensus_queue.cc:260] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.566407  9661 catalog_manager.cc:5697] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 reported cstate change: term changed from 1 to 2, leader changed from 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194) to e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e3ccd3774ec344df9569671c7b7143c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.567536  9839 raft_consensus.cc:3060] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.569859  9914 raft_consensus.cc:2468] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ccd3774ec344df9569671c7b7143c4 in term 2.
I20260709 13:03:18.571020  9729 leader_election.cc:304] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b9d0c370a19404ca5628b8058cac3ef, e3ccd3774ec344df9569671c7b7143c4; no voters: 
I20260709 13:03:18.571987  9998 raft_consensus.cc:2804] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.572428  9998 raft_consensus.cc:697] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 2 LEADER]: Becoming Leader. State: Replica: e3ccd3774ec344df9569671c7b7143c4, State: Running, Role: LEADER
I20260709 13:03:18.573406  9839 raft_consensus.cc:2468] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ccd3774ec344df9569671c7b7143c4 in term 2.
I20260709 13:03:18.573251  9998 consensus_queue.cc:237] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:18.580219  9661 catalog_manager.cc:5697] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 reported cstate change: term changed from 1 to 2, leader changed from 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194) to e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e3ccd3774ec344df9569671c7b7143c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.631206   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:03:18.632747   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:03:18.633175   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:03:18.644984  9765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "249c4847c03241d7be933163f38ffadc"
dest_uuid: "e3ccd3774ec344df9569671c7b7143c4"
mode: GRACEFUL
new_leader_uuid: "9b9d0c370a19404ca5628b8058cac3ef"
 from {username='slave'} at 127.0.0.1:59736
I20260709 13:03:18.645452  9765 raft_consensus.cc:606] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 2 LEADER]: Received request to transfer leadership to TS 9b9d0c370a19404ca5628b8058cac3ef
I20260709 13:03:18.646435   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:03:18.706985  9914 raft_consensus.cc:1275] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Refusing update from remote peer 14cbc4991201465b8bb4557b18ed08ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.708308 10003 consensus_queue.cc:1048] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:18.715245  9765 raft_consensus.cc:3060] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.721886  9765 raft_consensus.cc:1275] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Refusing update from remote peer 14cbc4991201465b8bb4557b18ed08ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.723232 10003 consensus_queue.cc:1048] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:18.985469  9839 raft_consensus.cc:1275] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Refusing update from remote peer e3ccd3774ec344df9569671c7b7143c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.986814 10009 consensus_queue.cc:1048] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:18.987502  9839 raft_consensus.cc:1275] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Refusing update from remote peer e3ccd3774ec344df9569671c7b7143c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.988862 10009 consensus_queue.cc:1048] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:18.995769  9914 raft_consensus.cc:1275] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Refusing update from remote peer e3ccd3774ec344df9569671c7b7143c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.999294  9914 raft_consensus.cc:1275] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Refusing update from remote peer e3ccd3774ec344df9569671c7b7143c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.999864  9997 consensus_queue.cc:1048] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:19.000774  9998 consensus_queue.cc:1048] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:19.014925  9997 raft_consensus.cc:993] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4: : Instructing follower 9b9d0c370a19404ca5628b8058cac3ef to start an election
I20260709 13:03:19.015413  9998 raft_consensus.cc:1081] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 2 LEADER]: Signalling peer 9b9d0c370a19404ca5628b8058cac3ef to start an election
I20260709 13:03:19.017021  9913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "249c4847c03241d7be933163f38ffadc"
dest_uuid: "9b9d0c370a19404ca5628b8058cac3ef"
 from {username='slave'} at 127.0.0.1:53476
I20260709 13:03:19.017576  9913 raft_consensus.cc:493] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.017935  9913 raft_consensus.cc:3060] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.024053  9913 raft_consensus.cc:515] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:19.026288  9913 leader_election.cc:290] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [CANDIDATE]: Term 3 election: Requested vote from peers e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193:37757), 14cbc4991201465b8bb4557b18ed08ea (127.0.107.194:33387)
I20260709 13:03:19.026415  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249c4847c03241d7be933163f38ffadc" candidate_uuid: "9b9d0c370a19404ca5628b8058cac3ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3ccd3774ec344df9569671c7b7143c4"
I20260709 13:03:19.026906  9840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249c4847c03241d7be933163f38ffadc" candidate_uuid: "9b9d0c370a19404ca5628b8058cac3ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "14cbc4991201465b8bb4557b18ed08ea"
I20260709 13:03:19.027118  9765 raft_consensus.cc:3055] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:19.027464  9765 raft_consensus.cc:740] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ccd3774ec344df9569671c7b7143c4, State: Running, Role: LEADER
I20260709 13:03:19.027496  9840 raft_consensus.cc:3060] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.028365  9765 consensus_queue.cc:260] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:19.029328  9765 raft_consensus.cc:3060] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.033537  9840 raft_consensus.cc:2468] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b9d0c370a19404ca5628b8058cac3ef in term 3.
I20260709 13:03:19.034518  9765 raft_consensus.cc:2468] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b9d0c370a19404ca5628b8058cac3ef in term 3.
I20260709 13:03:19.034585  9878 leader_election.cc:304] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14cbc4991201465b8bb4557b18ed08ea, 9b9d0c370a19404ca5628b8058cac3ef; no voters: 
I20260709 13:03:19.035641 10012 raft_consensus.cc:2804] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:19.036077 10012 raft_consensus.cc:697] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 3 LEADER]: Becoming Leader. State: Replica: 9b9d0c370a19404ca5628b8058cac3ef, State: Running, Role: LEADER
I20260709 13:03:19.036854 10012 consensus_queue.cc:237] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } }
I20260709 13:03:19.042428  9661 catalog_manager.cc:5697] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef reported cstate change: term changed from 2 to 3, leader changed from e3ccd3774ec344df9569671c7b7143c4 (127.0.107.193) to 9b9d0c370a19404ca5628b8058cac3ef (127.0.107.195). New cstate: current_term: 3 leader_uuid: "9b9d0c370a19404ca5628b8058cac3ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ccd3774ec344df9569671c7b7143c4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14cbc4991201465b8bb4557b18ed08ea" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b9d0c370a19404ca5628b8058cac3ef" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43171 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.255483   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:19.274060   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:19.274752   431 tablet_replica.cc:333] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4: stopping tablet replica
I20260709 13:03:19.275368   431 raft_consensus.cc:2243] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:19.276172   431 raft_consensus.cc:2272] T 97375fce1515418bbf6ffd81280c8fda P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.278296   431 tablet_replica.cc:333] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4: stopping tablet replica
I20260709 13:03:19.278913   431 raft_consensus.cc:2243] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:19.279327   431 raft_consensus.cc:2272] T 249c4847c03241d7be933163f38ffadc P e3ccd3774ec344df9569671c7b7143c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.281767   431 tablet_replica.cc:333] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4: stopping tablet replica
I20260709 13:03:19.282253   431 raft_consensus.cc:2243] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:19.282721   431 raft_consensus.cc:2272] T b5625fe828064451b925a293a59000b2 P e3ccd3774ec344df9569671c7b7143c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.284701   431 tablet_replica.cc:333] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4: stopping tablet replica
I20260709 13:03:19.285189   431 raft_consensus.cc:2243] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:19.286007   431 raft_consensus.cc:2272] T 24ecda968d974a489fb65e30f2b6c2e5 P e3ccd3774ec344df9569671c7b7143c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.307914   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:03:19.319422   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:03:19.337127   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:19.337741   431 tablet_replica.cc:333] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea: stopping tablet replica
I20260709 13:03:19.338287   431 raft_consensus.cc:2243] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:19.338799   431 raft_consensus.cc:2272] T 97375fce1515418bbf6ffd81280c8fda P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.341142   431 tablet_replica.cc:333] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea: stopping tablet replica
I20260709 13:03:19.341667   431 raft_consensus.cc:2243] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:19.342085   431 raft_consensus.cc:2272] T 249c4847c03241d7be933163f38ffadc P 14cbc4991201465b8bb4557b18ed08ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.344236   431 tablet_replica.cc:333] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea: stopping tablet replica
I20260709 13:03:19.344740   431 raft_consensus.cc:2243] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:19.345156   431 raft_consensus.cc:2272] T 24ecda968d974a489fb65e30f2b6c2e5 P 14cbc4991201465b8bb4557b18ed08ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.346939   431 tablet_replica.cc:333] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea: stopping tablet replica
I20260709 13:03:19.347492   431 raft_consensus.cc:2243] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:19.348351   431 raft_consensus.cc:2272] T b5625fe828064451b925a293a59000b2 P 14cbc4991201465b8bb4557b18ed08ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.371237   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:19.382470   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:19.399138   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:19.399828   431 tablet_replica.cc:333] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef: stopping tablet replica
I20260709 13:03:19.400331   431 raft_consensus.cc:2243] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:19.400731   431 raft_consensus.cc:2272] T 97375fce1515418bbf6ffd81280c8fda P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.402917   431 tablet_replica.cc:333] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef: stopping tablet replica
I20260709 13:03:19.403358   431 raft_consensus.cc:2243] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:19.403870   431 pending_rounds.cc:70] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef: Trying to abort 1 pending ops.
I20260709 13:03:19.404012   431 pending_rounds.cc:77] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634607261650944 op_type: NO_OP noop_request { }
I20260709 13:03:19.404233   431 raft_consensus.cc:2889] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:19.404438   431 raft_consensus.cc:2272] T 249c4847c03241d7be933163f38ffadc P 9b9d0c370a19404ca5628b8058cac3ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.406517   431 tablet_replica.cc:333] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef: stopping tablet replica
I20260709 13:03:19.407075   431 raft_consensus.cc:2243] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:19.407457   431 raft_consensus.cc:2272] T 24ecda968d974a489fb65e30f2b6c2e5 P 9b9d0c370a19404ca5628b8058cac3ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.409063   431 tablet_replica.cc:333] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef: stopping tablet replica
I20260709 13:03:19.409456   431 raft_consensus.cc:2243] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:19.409833   431 raft_consensus.cc:2272] T b5625fe828064451b925a293a59000b2 P 9b9d0c370a19404ca5628b8058cac3ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.421437   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:19.432909   431 master.cc:562] Master@127.0.107.254:41999 shutting down...
I20260709 13:03:19.447481   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:19.447945   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.448199   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P ed04aabc30e84c6ab225e409ce456636: stopping tablet replica
I20260709 13:03:19.466360   431 master.cc:584] Master@127.0.107.254:41999 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2501 ms)
[----------] 6 tests from LeaderRebalancerTest (297317 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:03:19.493121   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43545
I20260709 13:03:19.494318   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:19.499343 10013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.499558 10014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.500733 10016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:19.501950   431 server_base.cc:1061] running on GCE node
I20260709 13:03:19.502779   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:19.502959   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:19.503157   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602199503115 us; error 0 us; skew 500 ppm
I20260709 13:03:19.503688   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:19.505924   431 webserver.cc:533] Webserver started at http://127.0.107.254:44079/ using document root <none> and password file <none>
I20260709 13:03:19.506405   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:19.506601   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:19.506963   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:19.507982   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/master-0-root/instance:
uuid: "8cef729add4f456cb0da53efd2266e96"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-szgt"
I20260709 13:03:19.512115   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:19.515107 10021 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.515754   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:03:19.516038   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/master-0-root
uuid: "8cef729add4f456cb0da53efd2266e96"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-szgt"
I20260709 13:03:19.516292   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:19.527927   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:19.528882   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:19.564314   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43545
I20260709 13:03:19.564414 10072 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43545 every 8 connection(s)
I20260709 13:03:19.568068 10073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:19.578083 10073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96: Bootstrap starting.
I20260709 13:03:19.582505 10073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:19.586511 10073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96: No bootstrap required, opened a new log
I20260709 13:03:19.588526 10073 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cef729add4f456cb0da53efd2266e96" member_type: VOTER }
I20260709 13:03:19.588923 10073 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:19.589161 10073 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cef729add4f456cb0da53efd2266e96, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.589798 10073 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cef729add4f456cb0da53efd2266e96" member_type: VOTER }
I20260709 13:03:19.590294 10073 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:19.590528 10073 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:19.590823 10073 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.595235 10073 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cef729add4f456cb0da53efd2266e96" member_type: VOTER }
I20260709 13:03:19.595731 10073 leader_election.cc:304] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cef729add4f456cb0da53efd2266e96; no voters: 
I20260709 13:03:19.596815 10073 leader_election.cc:290] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:19.597141 10076 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:19.598469 10076 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 1 LEADER]: Becoming Leader. State: Replica: 8cef729add4f456cb0da53efd2266e96, State: Running, Role: LEADER
I20260709 13:03:19.599123 10076 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cef729add4f456cb0da53efd2266e96" member_type: VOTER }
I20260709 13:03:19.599786 10073 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:19.603494 10078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cef729add4f456cb0da53efd2266e96. Latest consensus state: current_term: 1 leader_uuid: "8cef729add4f456cb0da53efd2266e96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cef729add4f456cb0da53efd2266e96" member_type: VOTER } }
I20260709 13:03:19.604251 10078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:19.605298 10077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cef729add4f456cb0da53efd2266e96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cef729add4f456cb0da53efd2266e96" member_type: VOTER } }
I20260709 13:03:19.605973 10077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:19.606362 10083 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:19.614069 10083 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:19.615092   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:19.622655 10083 catalog_manager.cc:1383] Generated new cluster ID: a543d411b4554418be4828468e2a8c73
I20260709 13:03:19.622967 10083 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:19.635454 10083 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:19.636663 10083 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:19.653630 10083 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96: Generated new TSK 0
I20260709 13:03:19.654192 10083 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:19.681916   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:19.687729 10094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.688478 10095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:19.690954   431 server_base.cc:1061] running on GCE node
W20260709 13:03:19.690896 10097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:19.692087   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:19.692307   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:19.692487   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602199692470 us; error 0 us; skew 500 ppm
I20260709 13:03:19.693012   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:19.695271   431 webserver.cc:533] Webserver started at http://127.0.107.193:38339/ using document root <none> and password file <none>
I20260709 13:03:19.695751   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:19.695959   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:19.696237   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:19.697278   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-0-root/instance:
uuid: "e23799a9ec6848db8869919122abde42"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-szgt"
I20260709 13:03:19.701766   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:19.705107 10102 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.705850   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:19.706139   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "e23799a9ec6848db8869919122abde42"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-szgt"
I20260709 13:03:19.706426   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:19.734225   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:19.735455   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:19.736883   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:19.739190   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:19.739409   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.739662   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:19.739836   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.776885   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42291
I20260709 13:03:19.776979 10164 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42291 every 8 connection(s)
I20260709 13:03:19.781752   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:19.789110 10169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.790910 10170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.792670 10172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:19.794440   431 server_base.cc:1061] running on GCE node
I20260709 13:03:19.794435 10165 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43545
I20260709 13:03:19.795161 10165 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:19.795873 10165 heartbeater.cc:507] Master 127.0.107.254:43545 requested a full tablet report, sending...
I20260709 13:03:19.796218   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:19.796509   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:19.796716   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602199796700 us; error 0 us; skew 500 ppm
I20260709 13:03:19.797452   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:19.798398 10038 ts_manager.cc:194] Registered new tserver with Master: e23799a9ec6848db8869919122abde42 (127.0.107.193:42291)
I20260709 13:03:19.800000   431 webserver.cc:533] Webserver started at http://127.0.107.194:46605/ using document root <none> and password file <none>
I20260709 13:03:19.800437 10038 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52208
I20260709 13:03:19.800624   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:19.801016   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:19.801340   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:19.802793   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-1-root/instance:
uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-szgt"
I20260709 13:03:19.807132   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:19.810374 10177 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.811230   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:03:19.811466   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-1-root
uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-szgt"
I20260709 13:03:19.811697   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:19.826632   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:19.827718   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:19.828986   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:19.831223   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:19.831391   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.831691   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:19.831851   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.868721   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:41995
I20260709 13:03:19.868824 10239 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:41995 every 8 connection(s)
I20260709 13:03:19.873921   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:19.880461 10243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.881842 10244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.884939 10246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:19.885049 10240 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43545
I20260709 13:03:19.885718 10240 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:19.886848 10240 heartbeater.cc:507] Master 127.0.107.254:43545 requested a full tablet report, sending...
I20260709 13:03:19.889452 10038 ts_manager.cc:194] Registered new tserver with Master: dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:19.891328   431 server_base.cc:1061] running on GCE node
I20260709 13:03:19.891372 10038 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52214
I20260709 13:03:19.892329   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:19.892642   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:19.892904   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602199892883 us; error 0 us; skew 500 ppm
I20260709 13:03:19.893493   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:19.895826   431 webserver.cc:533] Webserver started at http://127.0.107.195:35065/ using document root <none> and password file <none>
I20260709 13:03:19.896332   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:19.896550   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:19.896823   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:19.897858   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-2-root/instance:
uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-szgt"
I20260709 13:03:19.902184   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:03:19.905097 10251 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.905877   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:19.906193   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-2-root
uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-szgt"
I20260709 13:03:19.906548   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601902018772-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:19.926756   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:19.927769   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:19.929112   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:19.931342   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:19.931573   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.931819   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:19.931998   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.968647   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:40691
I20260709 13:03:19.968744 10313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:40691 every 8 connection(s)
I20260709 13:03:19.981864 10314 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43545
I20260709 13:03:19.982272 10314 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:19.983088 10314 heartbeater.cc:507] Master 127.0.107.254:43545 requested a full tablet report, sending...
I20260709 13:03:19.984966 10038 ts_manager.cc:194] Registered new tserver with Master: d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:19.985450   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013576495s
I20260709 13:03:19.986703 10038 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52226
I20260709 13:03:20.009250 10038 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52230:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:20.011831 10038 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:20.078375 10205 tablet_service.cc:1511] Processing CreateTablet for tablet 1df83beac2984ad6806b47d864405481 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:20.080714 10205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df83beac2984ad6806b47d864405481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.086963 10204 tablet_service.cc:1511] Processing CreateTablet for tablet 353f0591a3d84639bed4b8625d66e1dd (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:20.088649 10204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353f0591a3d84639bed4b8625d66e1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.089318 10203 tablet_service.cc:1511] Processing CreateTablet for tablet 47f5d94334ce4648ba5bbd70e77f412f (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:20.090847 10203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f5d94334ce4648ba5bbd70e77f412f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.099717 10279 tablet_service.cc:1511] Processing CreateTablet for tablet 1df83beac2984ad6806b47d864405481 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:20.101328 10279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df83beac2984ad6806b47d864405481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.108706 10278 tablet_service.cc:1511] Processing CreateTablet for tablet 353f0591a3d84639bed4b8625d66e1dd (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:20.110266 10278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353f0591a3d84639bed4b8625d66e1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.110375 10329 tablet_bootstrap.cc:492] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:20.112792 10129 tablet_service.cc:1511] Processing CreateTablet for tablet 353f0591a3d84639bed4b8625d66e1dd (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:20.114228 10129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353f0591a3d84639bed4b8625d66e1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.115754 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 47f5d94334ce4648ba5bbd70e77f412f (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:20.117013 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f5d94334ce4648ba5bbd70e77f412f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.117348 10205 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa611a8fd5d4a6fa1478a1aa374166f (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:20.118700 10205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa611a8fd5d4a6fa1478a1aa374166f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.119724 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa611a8fd5d4a6fa1478a1aa374166f (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:20.121017 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa611a8fd5d4a6fa1478a1aa374166f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.123672 10126 tablet_service.cc:1511] Processing CreateTablet for tablet 2c24bf92377c400982f46c56a1b2756c (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:20.123989 10203 tablet_service.cc:1511] Processing CreateTablet for tablet 2c24bf92377c400982f46c56a1b2756c (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:20.124989 10126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c24bf92377c400982f46c56a1b2756c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.125630 10203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c24bf92377c400982f46c56a1b2756c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.111732 10130 tablet_service.cc:1511] Processing CreateTablet for tablet 1df83beac2984ad6806b47d864405481 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:20.129164 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df83beac2984ad6806b47d864405481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.134410 10125 tablet_service.cc:1511] Processing CreateTablet for tablet c4ac5d0a485a44a48e57a0c62d4d29ac (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:20.135828 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ac5d0a485a44a48e57a0c62d4d29ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.137007 10277 tablet_service.cc:1511] Processing CreateTablet for tablet 47f5d94334ce4648ba5bbd70e77f412f (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:20.138391 10277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f5d94334ce4648ba5bbd70e77f412f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.139757 10276 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa611a8fd5d4a6fa1478a1aa374166f (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:20.141294 10204 tablet_service.cc:1511] Processing CreateTablet for tablet c4ac5d0a485a44a48e57a0c62d4d29ac (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:20.141913 10275 tablet_service.cc:1511] Processing CreateTablet for tablet 2c24bf92377c400982f46c56a1b2756c (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:20.143134 10204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ac5d0a485a44a48e57a0c62d4d29ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.144567 10329 tablet_bootstrap.cc:654] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.145978 10276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa611a8fd5d4a6fa1478a1aa374166f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.147042 10275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c24bf92377c400982f46c56a1b2756c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.163820 10274 tablet_service.cc:1511] Processing CreateTablet for tablet c4ac5d0a485a44a48e57a0c62d4d29ac (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:20.164901 10329 tablet_bootstrap.cc:492] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:20.165239 10274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ac5d0a485a44a48e57a0c62d4d29ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.165444 10329 ts_tablet_manager.cc:1403] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:03:20.167356 10124 tablet_service.cc:1511] Processing CreateTablet for tablet e057094087fc4a17b1bf35eec9526373 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:20.168673 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e057094087fc4a17b1bf35eec9526373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.168399 10329 raft_consensus.cc:359] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.169152 10329 raft_consensus.cc:385] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.169450 10329 raft_consensus.cc:740] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.170503 10329 consensus_queue.cc:260] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.172716 10205 tablet_service.cc:1511] Processing CreateTablet for tablet e057094087fc4a17b1bf35eec9526373 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:20.173979 10205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e057094087fc4a17b1bf35eec9526373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.201619 10273 tablet_service.cc:1511] Processing CreateTablet for tablet e057094087fc4a17b1bf35eec9526373 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:20.213568 10332 tablet_bootstrap.cc:492] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:20.236804 10205 tablet_service.cc:1511] Processing CreateTablet for tablet 96cbfd73a4d44a70b799f689a31a66f0 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:20.238194 10205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96cbfd73a4d44a70b799f689a31a66f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.237162 10123 tablet_service.cc:1511] Processing CreateTablet for tablet 96cbfd73a4d44a70b799f689a31a66f0 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:20.243098 10273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e057094087fc4a17b1bf35eec9526373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.243212 10123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96cbfd73a4d44a70b799f689a31a66f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.275542 10332 tablet_bootstrap.cc:654] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.281829 10279 tablet_service.cc:1511] Processing CreateTablet for tablet 96cbfd73a4d44a70b799f689a31a66f0 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:20.286790 10279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96cbfd73a4d44a70b799f689a31a66f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.292837 10127 tablet_service.cc:1511] Processing CreateTablet for tablet e97633190bbb4792821e9b0d837d5b89 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:20.294163 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97633190bbb4792821e9b0d837d5b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.296916 10274 tablet_service.cc:1511] Processing CreateTablet for tablet e97633190bbb4792821e9b0d837d5b89 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:20.298635 10274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97633190bbb4792821e9b0d837d5b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.319479 10330 tablet_bootstrap.cc:492] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:20.331329 10330 tablet_bootstrap.cc:654] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.333199 10240 heartbeater.cc:499] Master 127.0.107.254:43545 was elected leader, sending a full tablet report...
I20260709 13:03:20.334713 10205 tablet_service.cc:1511] Processing CreateTablet for tablet e97633190bbb4792821e9b0d837d5b89 (DEFAULT_TABLE table=test-workload [id=5c1a5c56ec1d4711b7ec55d259088737]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:20.333297 10329 ts_tablet_manager.cc:1434] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.168s	user 0.019s	sys 0.108s
I20260709 13:03:20.336308 10205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97633190bbb4792821e9b0d837d5b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.337471 10329 tablet_bootstrap.cc:492] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:20.343394 10329 tablet_bootstrap.cc:654] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.352767 10330 tablet_bootstrap.cc:492] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:20.353307 10330 ts_tablet_manager.cc:1403] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 13:03:20.355060 10332 tablet_bootstrap.cc:492] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:20.355772 10332 ts_tablet_manager.cc:1403] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.007s
I20260709 13:03:20.356405 10330 raft_consensus.cc:359] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.357259 10330 raft_consensus.cc:385] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.357558 10330 raft_consensus.cc:740] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.358335 10330 consensus_queue.cc:260] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.359027 10332 raft_consensus.cc:359] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.359995 10332 raft_consensus.cc:385] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.360447 10332 raft_consensus.cc:740] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.362424 10332 consensus_queue.cc:260] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.364586 10329 tablet_bootstrap.cc:492] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:20.365147 10329 ts_tablet_manager.cc:1403] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.008s
I20260709 13:03:20.367830 10329 raft_consensus.cc:359] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.368721 10329 raft_consensus.cc:385] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.369102 10329 raft_consensus.cc:740] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.370174 10329 consensus_queue.cc:260] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.372634 10330 ts_tablet_manager.cc:1434] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.009s
I20260709 13:03:20.373057 10314 heartbeater.cc:499] Master 127.0.107.254:43545 was elected leader, sending a full tablet report...
I20260709 13:03:20.373754 10330 tablet_bootstrap.cc:492] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:20.372917 10329 ts_tablet_manager.cc:1434] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:03:20.375092 10329 tablet_bootstrap.cc:492] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:20.379899 10330 tablet_bootstrap.cc:654] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.381904 10329 tablet_bootstrap.cc:654] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.391225 10330 tablet_bootstrap.cc:492] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:20.391739 10330 ts_tablet_manager.cc:1403] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:03:20.394572 10330 raft_consensus.cc:359] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.395320 10330 raft_consensus.cc:385] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.395610 10330 raft_consensus.cc:740] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.397889 10165 heartbeater.cc:499] Master 127.0.107.254:43545 was elected leader, sending a full tablet report...
I20260709 13:03:20.397729 10330 consensus_queue.cc:260] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.398528 10332 ts_tablet_manager.cc:1434] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.042s	user 0.019s	sys 0.011s
I20260709 13:03:20.399434 10329 tablet_bootstrap.cc:492] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:20.399981 10330 ts_tablet_manager.cc:1434] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:03:20.399909 10329 ts_tablet_manager.cc:1403] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:03:20.401271 10330 tablet_bootstrap.cc:492] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:20.403366 10329 raft_consensus.cc:359] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.404110 10329 raft_consensus.cc:385] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.404402 10329 raft_consensus.cc:740] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.399891 10332 tablet_bootstrap.cc:492] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:20.405527 10329 consensus_queue.cc:260] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.407895 10329 ts_tablet_manager.cc:1434] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:03:20.408136 10330 tablet_bootstrap.cc:654] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.409279 10329 tablet_bootstrap.cc:492] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:20.410800 10337 raft_consensus.cc:493] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.411307 10337 raft_consensus.cc:515] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.413942 10337 leader_election.cc:290] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), e23799a9ec6848db8869919122abde42 (127.0.107.193:42291)
I20260709 13:03:20.414767 10332 tablet_bootstrap.cc:654] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.432247 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df83beac2984ad6806b47d864405481" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:20.433097 10215 raft_consensus.cc:2468] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:20.434268 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df83beac2984ad6806b47d864405481" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:20.434785 10332 tablet_bootstrap.cc:492] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:20.435320 10332 ts_tablet_manager.cc:1403] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.007s
I20260709 13:03:20.435793 10329 tablet_bootstrap.cc:654] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.436205 10255 leader_election.cc:304] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
W20260709 13:03:20.437237 10255 leader_election.cc:343] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.438138 10337 raft_consensus.cc:2804] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.438601 10337 raft_consensus.cc:493] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.438269 10332 raft_consensus.cc:359] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.438989 10337 raft_consensus.cc:3060] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.439065 10332 raft_consensus.cc:385] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.439436 10332 raft_consensus.cc:740] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.440322 10332 consensus_queue.cc:260] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.442476 10333 raft_consensus.cc:493] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.442757 10332 ts_tablet_manager.cc:1434] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:20.443199 10333 raft_consensus.cc:515] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.443861 10332 tablet_bootstrap.cc:492] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:20.446720 10337 raft_consensus.cc:515] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.449699 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df83beac2984ad6806b47d864405481" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:20.450274 10215 raft_consensus.cc:3060] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.450786 10332 tablet_bootstrap.cc:654] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.452205 10333 leader_election.cc:290] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.459703 10215 raft_consensus.cc:2468] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:20.460798 10329 tablet_bootstrap.cc:492] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:20.461429 10255 leader_election.cc:304] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:20.461493 10329 ts_tablet_manager.cc:1403] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.002s
I20260709 13:03:20.465744 10329 raft_consensus.cc:359] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.466531 10329 raft_consensus.cc:385] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.471704 10348 raft_consensus.cc:2804] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:20.472084 10329 raft_consensus.cc:740] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.474327 10329 consensus_queue.cc:260] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.475030 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
W20260709 13:03:20.478529 10181 leader_election.cc:343] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.479025 10329 ts_tablet_manager.cc:1434] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:03:20.479084 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df83beac2984ad6806b47d864405481" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:20.480283 10329 tablet_bootstrap.cc:492] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
W20260709 13:03:20.480742 10255 leader_election.cc:343] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.481562 10337 leader_election.cc:290] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), e23799a9ec6848db8869919122abde42 (127.0.107.193:42291)
I20260709 13:03:20.488780 10332 tablet_bootstrap.cc:492] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:20.488721 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:20.489445 10332 ts_tablet_manager.cc:1403] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.020s
I20260709 13:03:20.490697 10330 tablet_bootstrap.cc:492] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:20.491230 10338 raft_consensus.cc:493] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.491806 10338 raft_consensus.cc:515] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.492627 10332 raft_consensus.cc:359] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.493400 10332 raft_consensus.cc:385] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.493697 10332 raft_consensus.cc:740] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
W20260709 13:03:20.495942 10180 leader_election.cc:343] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.496447 10180 leader_election.cc:304] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42
I20260709 13:03:20.497241 10329 tablet_bootstrap.cc:654] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.497634 10333 raft_consensus.cc:2749] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:20.494606 10338 leader_election.cc:290] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.491250 10330 ts_tablet_manager.cc:1403] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.026s
I20260709 13:03:20.487262 10348 raft_consensus.cc:697] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:20.502655 10332 consensus_queue.cc:260] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.503041 10348 consensus_queue.cc:237] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.506364 10330 raft_consensus.cc:359] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.507387 10330 raft_consensus.cc:385] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.507763 10330 raft_consensus.cc:740] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.508765 10330 consensus_queue.cc:260] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.510993 10330 ts_tablet_manager.cc:1434] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:03:20.511996 10330 tablet_bootstrap.cc:492] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:20.507710 10332 ts_tablet_manager.cc:1434] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:03:20.518466 10332 tablet_bootstrap.cc:492] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:20.522531 10037 catalog_manager.cc:5697] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.524690 10332 tablet_bootstrap.cc:654] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.531167 10330 tablet_bootstrap.cc:654] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.535750 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c24bf92377c400982f46c56a1b2756c" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
W20260709 13:03:20.537777 10105 leader_election.cc:343] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.541373 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c24bf92377c400982f46c56a1b2756c" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
W20260709 13:03:20.542835 10106 leader_election.cc:343] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.543033 10330 tablet_bootstrap.cc:492] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:20.543298 10106 leader_election.cc:304] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e23799a9ec6848db8869919122abde42; no voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:20.543542 10330 ts_tablet_manager.cc:1403] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.009s
I20260709 13:03:20.544260 10329 tablet_bootstrap.cc:492] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:20.544490 10338 raft_consensus.cc:2749] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:20.544833 10329 ts_tablet_manager.cc:1403] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.023s
I20260709 13:03:20.546540 10330 raft_consensus.cc:359] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.547454 10330 raft_consensus.cc:385] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.547504 10329 raft_consensus.cc:359] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.547986 10330 raft_consensus.cc:740] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.548295 10329 raft_consensus.cc:385] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.548688 10329 raft_consensus.cc:740] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.548841 10330 consensus_queue.cc:260] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.549415 10329 consensus_queue.cc:260] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.549937 10332 tablet_bootstrap.cc:492] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:20.550487 10332 ts_tablet_manager.cc:1403] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.004s
I20260709 13:03:20.551149 10330 ts_tablet_manager.cc:1434] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:03:20.553525 10329 ts_tablet_manager.cc:1434] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:20.553364 10332 raft_consensus.cc:359] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.552117 10330 tablet_bootstrap.cc:492] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:20.554170 10332 raft_consensus.cc:385] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.554595 10332 raft_consensus.cc:740] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.555745 10329 tablet_bootstrap.cc:492] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:20.555366 10332 consensus_queue.cc:260] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.560096 10332 ts_tablet_manager.cc:1434] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:20.561100 10332 tablet_bootstrap.cc:492] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:20.562780 10329 tablet_bootstrap.cc:654] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.567884 10332 tablet_bootstrap.cc:654] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.573323 10332 tablet_bootstrap.cc:492] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:20.573798 10332 ts_tablet_manager.cc:1403] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.013s	user 0.000s	sys 0.011s
I20260709 13:03:20.574158 10330 tablet_bootstrap.cc:654] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.574591 10329 tablet_bootstrap.cc:492] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:20.575130 10329 ts_tablet_manager.cc:1403] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:03:20.576675 10332 raft_consensus.cc:359] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.577468 10332 raft_consensus.cc:385] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.577768 10332 raft_consensus.cc:740] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.578522 10332 consensus_queue.cc:260] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.578600 10329 raft_consensus.cc:359] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.579681 10329 raft_consensus.cc:385] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.580065 10329 raft_consensus.cc:740] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.580832 10332 ts_tablet_manager.cc:1434] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:03:20.581892 10332 tablet_bootstrap.cc:492] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:20.581290 10329 consensus_queue.cc:260] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.588549 10332 tablet_bootstrap.cc:654] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.588909 10329 ts_tablet_manager.cc:1434] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 13:03:20.590564 10329 tablet_bootstrap.cc:492] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:20.599978 10329 tablet_bootstrap.cc:654] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.601670 10330 tablet_bootstrap.cc:492] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:20.602272 10330 ts_tablet_manager.cc:1403] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.019s
I20260709 13:03:20.606686 10330 raft_consensus.cc:359] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.607678 10330 raft_consensus.cc:385] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.608186 10330 raft_consensus.cc:740] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.609166 10332 tablet_bootstrap.cc:492] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:20.609005 10330 consensus_queue.cc:260] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.609652 10332 ts_tablet_manager.cc:1403] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.011s
W20260709 13:03:20.611044 10086 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:20.611780 10330 ts_tablet_manager.cc:1434] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:20.611779 10333 raft_consensus.cc:493] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.612490 10333 raft_consensus.cc:515] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.613071 10330 tablet_bootstrap.cc:492] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:20.612608 10332 raft_consensus.cc:359] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.613469 10332 raft_consensus.cc:385] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.613864 10332 raft_consensus.cc:740] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.615374 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:20.616024 10140 raft_consensus.cc:2468] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:20.618391 10338 raft_consensus.cc:493] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.618911 10338 raft_consensus.cc:515] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.622197 10348 raft_consensus.cc:493] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.622848 10348 raft_consensus.cc:515] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.633000 10348 leader_election.cc:290] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:20.633518 10181 leader_election.cc:304] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.633780 10139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:20.634567 10139 raft_consensus.cc:2468] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:20.636477 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:20.637176 10215 raft_consensus.cc:2468] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:20.637832 10255 leader_election.cc:304] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.637176 10330 tablet_bootstrap.cc:654] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.638725 10348 raft_consensus.cc:2804] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.639077 10348 raft_consensus.cc:493] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.639179 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5d94334ce4648ba5bbd70e77f412f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:20.639498 10348 raft_consensus.cc:3060] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.639844 10215 raft_consensus.cc:2468] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 0.
I20260709 13:03:20.641126 10106 leader_election.cc:304] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.643338 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:20.644336 10333 leader_election.cc:290] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.645170 10333 raft_consensus.cc:2804] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.645676 10333 raft_consensus.cc:493] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.646512 10333 raft_consensus.cc:3060] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.648888 10348 raft_consensus.cc:515] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.650851 10338 leader_election.cc:290] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.650712 10288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5d94334ce4648ba5bbd70e77f412f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:20.651430 10338 raft_consensus.cc:2804] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.651503 10288 raft_consensus.cc:2468] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 0.
I20260709 13:03:20.651846 10338 raft_consensus.cc:493] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.652218 10338 raft_consensus.cc:3060] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.653641 10289 raft_consensus.cc:2393] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in current term 1: Already voted for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in this term.
I20260709 13:03:20.658517 10329 tablet_bootstrap.cc:492] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:20.654036 10332 consensus_queue.cc:260] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.655961 10349 raft_consensus.cc:493] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.660082 10349 raft_consensus.cc:515] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.659453 10329 ts_tablet_manager.cc:1403] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.000s
I20260709 13:03:20.660916 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:20.662197 10349 leader_election.cc:290] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:20.655917 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:20.662956 10139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:20.661634 10348 leader_election.cc:290] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:20.664796 10332 ts_tablet_manager.cc:1434] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:03:20.665967 10332 tablet_bootstrap.cc:492] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:20.672123 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:20.672935 10139 raft_consensus.cc:2468] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:20.674281 10255 leader_election.cc:304] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.674635 10332 tablet_bootstrap.cc:654] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.677095 10338 raft_consensus.cc:515] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
W20260709 13:03:20.677608 10255 leader_election.cc:343] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.681274 10361 raft_consensus.cc:493] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.682284 10329 raft_consensus.cc:359] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.684821 10329 raft_consensus.cc:385] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.685281 10329 raft_consensus.cc:740] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.684844 10361 raft_consensus.cc:515] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.685528 10333 raft_consensus.cc:515] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.686529 10332 tablet_bootstrap.cc:492] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:20.686108 10329 consensus_queue.cc:260] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.687093 10332 ts_tablet_manager.cc:1403] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.005s
I20260709 13:03:20.675123 10348 raft_consensus.cc:2804] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.687551 10348 raft_consensus.cc:493] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.687909 10348 raft_consensus.cc:3060] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.688002 10139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e057094087fc4a17b1bf35eec9526373" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:20.688683 10139 raft_consensus.cc:2468] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:20.688905 10330 tablet_bootstrap.cc:492] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:20.689415 10330 ts_tablet_manager.cc:1403] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.029s
I20260709 13:03:20.686748 10215 raft_consensus.cc:2393] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in current term 1: Already voted for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in this term.
I20260709 13:03:20.689879 10181 leader_election.cc:304] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.690318 10332 raft_consensus.cc:359] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.691098 10332 raft_consensus.cc:385] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.691381 10332 raft_consensus.cc:740] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.692211 10332 consensus_queue.cc:260] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.692423 10330 raft_consensus.cc:359] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.693125 10330 raft_consensus.cc:385] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.693440 10330 raft_consensus.cc:740] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.694173 10330 consensus_queue.cc:260] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.696020 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e057094087fc4a17b1bf35eec9526373" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:20.696762 10289 raft_consensus.cc:2468] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:20.698287 10333 leader_election.cc:290] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.700065 10332 ts_tablet_manager.cc:1434] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:03:20.700894 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:20.662953 10140 raft_consensus.cc:3060] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.696436 10330 ts_tablet_manager.cc:1434] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:20.709055 10289 raft_consensus.cc:2393] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in current term 1: Already voted for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in this term.
I20260709 13:03:20.710315 10332 tablet_bootstrap.cc:492] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:20.701965 10361 leader_election.cc:290] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.712090 10330 tablet_bootstrap.cc:492] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:20.703780 10333 raft_consensus.cc:2804] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.717597 10333 raft_consensus.cc:493] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.717995 10333 raft_consensus.cc:3060] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.719581 10329 ts_tablet_manager.cc:1434] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 13:03:20.720762 10329 tablet_bootstrap.cc:492] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:20.721167 10330 tablet_bootstrap.cc:654] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.724316 10139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:20.724937 10333 raft_consensus.cc:515] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.726014 10181 leader_election.cc:304] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42
I20260709 13:03:20.712704 10338 leader_election.cc:290] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.712809 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5d94334ce4648ba5bbd70e77f412f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:20.726963 10215 raft_consensus.cc:3060] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.727833 10365 raft_consensus.cc:2749] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:20.728107 10139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e057094087fc4a17b1bf35eec9526373" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:20.728785 10139 raft_consensus.cc:3060] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.702018 10348 raft_consensus.cc:515] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.732175 10348 leader_election.cc:290] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:20.734153 10138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:20.734835 10138 raft_consensus.cc:3060] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.738746 10140 raft_consensus.cc:2468] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:20.739099 10139 raft_consensus.cc:2468] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 1.
I20260709 13:03:20.739728 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:20.743803 10214 raft_consensus.cc:3060] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.744308 10181 leader_election.cc:304] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.744995 10365 raft_consensus.cc:2804] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:20.745450 10365 raft_consensus.cc:697] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Becoming Leader. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:20.713790 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5d94334ce4648ba5bbd70e77f412f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:20.746285 10365 consensus_queue.cc:237] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.743181 10329 tablet_bootstrap.cc:654] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.747133 10289 raft_consensus.cc:3060] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.746381 10138 raft_consensus.cc:2468] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:20.742537 10330 tablet_bootstrap.cc:492] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:20.750021 10330 ts_tablet_manager.cc:1403] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.012s
I20260709 13:03:20.750309 10255 leader_election.cc:304] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:20.751588 10255 leader_election.cc:304] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.752406 10349 raft_consensus.cc:2804] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:20.752902 10349 raft_consensus.cc:697] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:20.752986 10330 raft_consensus.cc:359] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.753712 10330 raft_consensus.cc:385] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.753898 10337 raft_consensus.cc:2804] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:20.754014 10330 raft_consensus.cc:740] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.753733 10349 consensus_queue.cc:237] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.756573 10330 consensus_queue.cc:260] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.757305 10289 raft_consensus.cc:2468] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 1.
I20260709 13:03:20.758615 10333 leader_election.cc:290] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.758878 10105 leader_election.cc:304] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.759964 10338 raft_consensus.cc:2804] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:20.760413 10338 raft_consensus.cc:697] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:20.761193 10338 consensus_queue.cc:237] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.761458 10337 raft_consensus.cc:697] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:20.762710 10337 consensus_queue.cc:237] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.764143 10037 catalog_manager.cc:5697] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:20.773654 10214 raft_consensus.cc:2468] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:20.741565 10332 tablet_bootstrap.cc:654] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.777309 10348 raft_consensus.cc:493] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.780117 10348 raft_consensus.cc:515] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.743322 10215 raft_consensus.cc:2468] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 1.
I20260709 13:03:20.785357 10329 tablet_bootstrap.cc:492] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:20.785844 10329 ts_tablet_manager.cc:1403] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 13:03:20.785933 10348 leader_election.cc:290] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:20.787494 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e057094087fc4a17b1bf35eec9526373" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:20.788138 10289 raft_consensus.cc:3060] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.791280 10138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:20.793159 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:20.793843 10215 raft_consensus.cc:2468] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:20.795033 10255 leader_election.cc:304] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:20.795248 10037 catalog_manager.cc:5697] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.796631 10329 raft_consensus.cc:359] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.796384 10036 catalog_manager.cc:5697] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 0 to 1, leader changed from <none> to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:20.797587 10329 raft_consensus.cc:385] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.797211 10037 catalog_manager.cc:5697] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.797966 10329 raft_consensus.cc:740] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.798974 10348 raft_consensus.cc:2804] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.798738 10329 consensus_queue.cc:260] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.799343 10348 raft_consensus.cc:493] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.799698 10348 raft_consensus.cc:3060] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.800858 10329 ts_tablet_manager.cc:1434] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:03:20.803085 10289 raft_consensus.cc:2468] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 1.
W20260709 13:03:20.798681 10255 leader_election.cc:343] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.804437 10329 tablet_bootstrap.cc:492] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:20.812079 10329 tablet_bootstrap.cc:654] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.816754 10330 ts_tablet_manager.cc:1434] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.066s	user 0.016s	sys 0.016s
I20260709 13:03:20.822196 10348 raft_consensus.cc:515] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.824318 10365 raft_consensus.cc:493] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.824868 10348 leader_election.cc:290] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:20.825028 10365 raft_consensus.cc:515] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.825984 10330 tablet_bootstrap.cc:492] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:20.826361 10138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:20.827543 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:20.828135 10215 raft_consensus.cc:3060] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.831984 10330 tablet_bootstrap.cc:654] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.832981 10138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c24bf92377c400982f46c56a1b2756c" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:20.833824 10138 raft_consensus.cc:2468] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:20.835528 10181 leader_election.cc:304] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
W20260709 13:03:20.835711 10255 leader_election.cc:343] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.836740 10333 raft_consensus.cc:2804] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.837255 10333 raft_consensus.cc:493] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.837540 10215 raft_consensus.cc:2468] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:20.837687 10333 raft_consensus.cc:3060] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.840430 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c24bf92377c400982f46c56a1b2756c" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:20.841007 10365 leader_election.cc:290] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
W20260709 13:03:20.841854 10180 leader_election.cc:343] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.847473 10255 leader_election.cc:304] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: e23799a9ec6848db8869919122abde42
I20260709 13:03:20.846634 10333 raft_consensus.cc:515] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.848222 10348 raft_consensus.cc:2804] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:20.848510 10349 raft_consensus.cc:493] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.848659 10348 raft_consensus.cc:697] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:20.849313 10333 leader_election.cc:290] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.847119 10329 tablet_bootstrap.cc:492] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:20.849552 10348 consensus_queue.cc:237] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.850288 10329 ts_tablet_manager.cc:1403] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.023s
I20260709 13:03:20.850345 10138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c24bf92377c400982f46c56a1b2756c" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:20.848999 10349 raft_consensus.cc:515] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.851218 10138 raft_consensus.cc:3060] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.852563 10349 leader_election.cc:290] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:20.853236 10329 raft_consensus.cc:359] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.854000 10329 raft_consensus.cc:385] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.854260 10329 raft_consensus.cc:740] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.854970 10329 consensus_queue.cc:260] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.855384 10332 tablet_bootstrap.cc:492] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:20.855844 10332 ts_tablet_manager.cc:1403] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.146s	user 0.025s	sys 0.010s
I20260709 13:03:20.856855 10329 ts_tablet_manager.cc:1434] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:20.857662 10139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97633190bbb4792821e9b0d837d5b89" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:20.858289 10139 raft_consensus.cc:2468] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:20.860262 10330 tablet_bootstrap.cc:492] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:20.850344 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c24bf92377c400982f46c56a1b2756c" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:20.860674 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97633190bbb4792821e9b0d837d5b89" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:20.861023 10330 ts_tablet_manager.cc:1403] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.010s
I20260709 13:03:20.861330 10215 raft_consensus.cc:2468] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:20.860860 10037 catalog_manager.cc:5697] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:20.861999 10180 leader_election.cc:343] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.858412 10332 raft_consensus.cc:359] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.863169 10332 raft_consensus.cc:385] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.863517 10332 raft_consensus.cc:740] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.863277 10255 leader_election.cc:304] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:20.863731 10330 raft_consensus.cc:359] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.864415 10330 raft_consensus.cc:385] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.864717 10330 raft_consensus.cc:740] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.864259 10332 consensus_queue.cc:260] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.864959 10348 raft_consensus.cc:2804] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.865379 10348 raft_consensus.cc:493] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.865772 10348 raft_consensus.cc:3060] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.865437 10330 consensus_queue.cc:260] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.866338 10332 ts_tablet_manager.cc:1434] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:03:20.867252 10332 tablet_bootstrap.cc:492] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:20.867830 10330 ts_tablet_manager.cc:1434] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:03:20.868708 10330 tablet_bootstrap.cc:492] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:20.872138 10332 tablet_bootstrap.cc:654] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.873610 10330 tablet_bootstrap.cc:654] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.883553 10138 raft_consensus.cc:2468] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 1.
I20260709 13:03:20.884932 10181 leader_election.cc:304] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: d0cbad478c6d47d19d9d3c2bec9ecb1c
I20260709 13:03:20.886085 10333 raft_consensus.cc:2804] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:20.886534 10333 raft_consensus.cc:697] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Becoming Leader. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:20.887036 10330 tablet_bootstrap.cc:492] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:20.887665 10330 ts_tablet_manager.cc:1403] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 13:03:20.887329 10333 consensus_queue.cc:237] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.892434 10348 raft_consensus.cc:515] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.895941 10138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97633190bbb4792821e9b0d837d5b89" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:20.897691 10138 raft_consensus.cc:3060] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.897572 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97633190bbb4792821e9b0d837d5b89" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:20.891582 10330 raft_consensus.cc:359] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.898612 10330 raft_consensus.cc:385] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.899061 10330 raft_consensus.cc:740] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.899657 10348 leader_election.cc:290] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:20.899762 10215 raft_consensus.cc:3060] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.900964 10330 consensus_queue.cc:260] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.903260 10330 ts_tablet_manager.cc:1434] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:03:20.907023 10037 catalog_manager.cc:5697] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:20.911091 10138 raft_consensus.cc:2468] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:20.912334 10255 leader_election.cc:304] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.913000 10332 tablet_bootstrap.cc:492] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:20.913527 10332 ts_tablet_manager.cc:1403] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.028s
I20260709 13:03:20.913512 10215 raft_consensus.cc:2468] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:20.916394 10332 raft_consensus.cc:359] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.916914 10332 raft_consensus.cc:385] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:20.917155 10332 raft_consensus.cc:740] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.917809 10332 consensus_queue.cc:260] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.919914 10332 ts_tablet_manager.cc:1434] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:20.913434 10348 raft_consensus.cc:2804] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:20.920435 10348 raft_consensus.cc:697] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:20.921305 10348 consensus_queue.cc:237] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.929085 10035 catalog_manager.cc:5697] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.940074 10338 raft_consensus.cc:493] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.940570 10338 raft_consensus.cc:515] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.942159 10338 leader_election.cc:290] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.942895 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cbfd73a4d44a70b799f689a31a66f0" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:20.943140 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cbfd73a4d44a70b799f689a31a66f0" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:20.943516 10215 raft_consensus.cc:2468] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 0.
I20260709 13:03:20.943744 10289 raft_consensus.cc:2468] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 0.
I20260709 13:03:20.944526 10106 leader_election.cc:304] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.945227 10338 raft_consensus.cc:2804] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:20.945535 10338 raft_consensus.cc:493] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.945807 10338 raft_consensus.cc:3060] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.950417 10338 raft_consensus.cc:515] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.952008 10338 leader_election.cc:290] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:20.952618 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cbfd73a4d44a70b799f689a31a66f0" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:20.952891 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cbfd73a4d44a70b799f689a31a66f0" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:20.953132 10215 raft_consensus.cc:3060] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.953474 10289 raft_consensus.cc:3060] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.957731 10215 raft_consensus.cc:2468] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 1.
I20260709 13:03:20.958755 10289 raft_consensus.cc:2468] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 1.
I20260709 13:03:20.958783 10106 leader_election.cc:304] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:20.959842 10338 raft_consensus.cc:2804] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:20.960342 10338 raft_consensus.cc:697] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:20.961046 10338 consensus_queue.cc:237] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:20.967559 10035 catalog_manager.cc:5697] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 0 to 1, leader changed from <none> to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:20.969937 10138 raft_consensus.cc:3060] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:20.975895 10348 consensus_queue.cc:1048] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:20.978531 10348 consensus_queue.cc:1048] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:21.095104 10289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1df83beac2984ad6806b47d864405481"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
mode: GRACEFUL
new_leader_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:58834
I20260709 13:03:21.095732 10289 raft_consensus.cc:606] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Received request to transfer leadership to TS e23799a9ec6848db8869919122abde42
I20260709 13:03:21.100772 10289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
mode: GRACEFUL
new_leader_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:58834
I20260709 13:03:21.101284 10289 raft_consensus.cc:606] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Received request to transfer leadership to TS e23799a9ec6848db8869919122abde42
I20260709 13:03:21.108629 10289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
mode: GRACEFUL
new_leader_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:58834
I20260709 13:03:21.109140 10289 raft_consensus.cc:606] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Received request to transfer leadership to TS e23799a9ec6848db8869919122abde42
I20260709 13:03:21.161659 10371 consensus_queue.cc:1048] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.162612 10289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
mode: GRACEFUL
new_leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
 from {username='slave'} at 127.0.0.1:58834
I20260709 13:03:21.164275 10289 raft_consensus.cc:606] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Received request to transfer leadership to TS dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:21.164587 10333 consensus_queue.cc:1048] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.172817 10371 raft_consensus.cc:493] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.173856 10371 raft_consensus.cc:515] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.176822 10371 leader_election.cc:290] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:21.179219 10139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c24bf92377c400982f46c56a1b2756c" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:21.180689 10139 raft_consensus.cc:2393] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in current term 1: Already voted for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in this term.
I20260709 13:03:21.182628 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c24bf92377c400982f46c56a1b2756c" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:21.190809 10348 consensus_queue.cc:1048] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.194766 10374 consensus_queue.cc:1048] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.197131 10255 leader_election.cc:304] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c; no voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42
I20260709 13:03:21.198860 10361 consensus_queue.cc:1048] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.202981 10349 raft_consensus.cc:3060] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:21.208300 10139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96cbfd73a4d44a70b799f689a31a66f0"
dest_uuid: "e23799a9ec6848db8869919122abde42"
mode: GRACEFUL
new_leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
 from {username='slave'} at 127.0.0.1:49848
I20260709 13:03:21.209393 10139 raft_consensus.cc:606] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Received request to transfer leadership to TS dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:21.219152 10349 raft_consensus.cc:2749] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:21.230778 10348 raft_consensus.cc:993] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c: : Instructing follower dcea1aa9581a44ba9b2b88c1fd4e6d39 to start an election
I20260709 13:03:21.231345 10348 raft_consensus.cc:1081] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Signalling peer dcea1aa9581a44ba9b2b88c1fd4e6d39 to start an election
I20260709 13:03:21.236394 10349 consensus_queue.cc:1048] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:21.238188 10214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac"
dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
 from {username='slave'} at 127.0.0.1:60246
I20260709 13:03:21.239035 10214 raft_consensus.cc:493] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:21.239491 10214 raft_consensus.cc:3060] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.252399 10370 raft_consensus.cc:993] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c: : Instructing follower e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:21.252159 10214 raft_consensus.cc:515] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.253010 10370 raft_consensus.cc:1081] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Signalling peer e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:21.255591 10214 leader_election.cc:290] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 2 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:21.255558 10138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:21.256413 10138 raft_consensus.cc:3060] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.256527 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:21.257102 10140 raft_consensus.cc:3060] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:21.257186 10289 raft_consensus.cc:3055] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:21.257654 10289 raft_consensus.cc:740] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:21.255177 10139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f"
dest_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:49824
I20260709 13:03:21.259157 10139 raft_consensus.cc:493] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:21.259001 10289 consensus_queue.cc:260] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.259639 10139 raft_consensus.cc:3060] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.260633 10289 raft_consensus.cc:3060] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.269284 10349 consensus_queue.cc:1048] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.269408 10139 raft_consensus.cc:515] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.270706 10289 raft_consensus.cc:2468] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 2.
I20260709 13:03:21.271898 10139 leader_election.cc:290] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:21.273087 10180 leader_election.cc:304] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:21.274372 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:21.274507 10361 raft_consensus.cc:2804] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:21.275035 10214 raft_consensus.cc:3060] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.275164 10361 raft_consensus.cc:697] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Becoming Leader. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:21.266505 10138 raft_consensus.cc:2468] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 2.
I20260709 13:03:21.276461 10361 consensus_queue.cc:237] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.280141 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa611a8fd5d4a6fa1478a1aa374166f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:21.280790 10289 raft_consensus.cc:3055] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:21.281158 10289 raft_consensus.cc:740] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:21.282284 10289 consensus_queue.cc:260] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.283716 10289 raft_consensus.cc:3060] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.285099 10214 raft_consensus.cc:2468] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
I20260709 13:03:21.287132 10106 leader_election.cc:304] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:21.288313 10338 raft_consensus.cc:2804] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:21.288842 10338 raft_consensus.cc:697] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:21.293972 10348 raft_consensus.cc:993] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c: : Instructing follower e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:21.294687 10348 raft_consensus.cc:1081] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Signalling peer e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:21.295243 10363 consensus_queue.cc:1048] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.295341 10338 consensus_queue.cc:237] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.299677 10035 catalog_manager.cc:5697] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 reported cstate change: term changed from 1 to 2, leader changed from d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195) to dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.301080 10140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd"
dest_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:49824
I20260709 13:03:21.301713 10140 raft_consensus.cc:493] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:21.302181 10140 raft_consensus.cc:3060] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.304330 10289 raft_consensus.cc:2468] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
I20260709 13:03:21.305647 10370 consensus_queue.cc:1048] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:21.316021 10370 consensus_queue.cc:1048] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:21.315637 10036 catalog_manager.cc:5697] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 1 to 2, leader changed from d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195) to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.321007 10140 raft_consensus.cc:515] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.322280 10137 raft_consensus.cc:1240] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Rejecting Update request from peer d0cbad478c6d47d19d9d3c2bec9ecb1c for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:21.324152 10213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:21.324756 10140 leader_election.cc:290] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:21.324882 10213 raft_consensus.cc:3060] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.326642 10370 consensus_queue.cc:1059] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:21.326960 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353f0591a3d84639bed4b8625d66e1dd" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:21.327929 10289 raft_consensus.cc:3055] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:21.328248 10289 raft_consensus.cc:740] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:21.329178 10289 consensus_queue.cc:260] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.330282 10289 raft_consensus.cc:3060] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.336943 10361 consensus_queue.cc:1048] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.336982 10289 raft_consensus.cc:2468] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
W20260709 13:03:21.339427 10337 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:21.340631 10213 raft_consensus.cc:2468] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
I20260709 13:03:21.342445 10105 leader_election.cc:304] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:21.343719 10338 raft_consensus.cc:2804] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:21.344338 10338 raft_consensus.cc:697] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:21.345518 10338 consensus_queue.cc:237] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.367878 10365 consensus_queue.cc:1048] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.372251 10349 consensus_queue.cc:1048] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:21.372524 10405 consensus_queue.cc:1048] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:21.379383 10037 catalog_manager.cc:5697] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 1 to 2, leader changed from d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195) to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.449287 10405 consensus_queue.cc:1048] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:21.453644 10405 consensus_queue.cc:1048] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:21.464767 10338 raft_consensus.cc:993] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42: : Instructing follower dcea1aa9581a44ba9b2b88c1fd4e6d39 to start an election
I20260709 13:03:21.465247 10338 raft_consensus.cc:1081] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Signalling peer dcea1aa9581a44ba9b2b88c1fd4e6d39 to start an election
I20260709 13:03:21.467378 10214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96cbfd73a4d44a70b799f689a31a66f0"
dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
 from {username='slave'} at 127.0.0.1:60252
I20260709 13:03:21.468688 10214 raft_consensus.cc:493] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:21.469060 10214 raft_consensus.cc:3060] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.475854 10214 raft_consensus.cc:515] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.478209 10214 leader_election.cc:290] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 2 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:21.478475 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cbfd73a4d44a70b799f689a31a66f0" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:21.478864 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cbfd73a4d44a70b799f689a31a66f0" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:21.479215 10140 raft_consensus.cc:3055] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:21.479465 10289 raft_consensus.cc:3060] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.479590 10140 raft_consensus.cc:740] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:21.480592 10140 consensus_queue.cc:260] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.481886 10140 raft_consensus.cc:3060] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.486951 10289 raft_consensus.cc:2468] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 2.
I20260709 13:03:21.488122 10180 leader_election.cc:304] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:21.488809 10361 raft_consensus.cc:2804] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:21.488746 10140 raft_consensus.cc:2468] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 2.
I20260709 13:03:21.489534 10361 raft_consensus.cc:697] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Becoming Leader. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:21.490626 10361 consensus_queue.cc:237] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.497408 10036 catalog_manager.cc:5697] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 reported cstate change: term changed from 1 to 2, leader changed from e23799a9ec6848db8869919122abde42 (127.0.107.193) to dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.568941 10349 raft_consensus.cc:993] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c: : Instructing follower e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:21.569506 10337 raft_consensus.cc:1081] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Signalling peer e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:21.571082 10140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1df83beac2984ad6806b47d864405481"
dest_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:49824
I20260709 13:03:21.571549 10140 raft_consensus.cc:493] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:21.571892 10140 raft_consensus.cc:3060] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.576683 10140 raft_consensus.cc:515] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.578328 10140 leader_election.cc:290] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:21.579103 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df83beac2984ad6806b47d864405481" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:21.579366 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df83beac2984ad6806b47d864405481" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:21.579706 10214 raft_consensus.cc:3060] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.580008 10289 raft_consensus.cc:3055] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:21.580324 10289 raft_consensus.cc:740] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:21.581107 10289 consensus_queue.cc:260] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.582139 10289 raft_consensus.cc:3060] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.584748 10214 raft_consensus.cc:2468] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
I20260709 13:03:21.585892 10106 leader_election.cc:304] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:21.586711 10405 raft_consensus.cc:2804] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:21.587141 10405 raft_consensus.cc:697] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:21.587368 10289 raft_consensus.cc:2468] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
I20260709 13:03:21.588039 10405 consensus_queue.cc:237] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:21.594269 10036 catalog_manager.cc:5697] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 1 to 2, leader changed from d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195) to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.703622 10289 raft_consensus.cc:1275] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer dcea1aa9581a44ba9b2b88c1fd4e6d39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.704916 10365 consensus_queue.cc:1048] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.708529 10140 raft_consensus.cc:1275] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Refusing update from remote peer dcea1aa9581a44ba9b2b88c1fd4e6d39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.710027 10365 consensus_queue.cc:1048] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.732525 10289 raft_consensus.cc:1275] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.733618 10405 consensus_queue.cc:1048] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.740856 10214 raft_consensus.cc:1275] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.742452 10363 consensus_queue.cc:1048] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.760893 10289 raft_consensus.cc:1275] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.762115 10363 consensus_queue.cc:1048] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.770486 10214 raft_consensus.cc:1275] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.771853 10338 consensus_queue.cc:1048] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.975945 10140 raft_consensus.cc:1275] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Refusing update from remote peer dcea1aa9581a44ba9b2b88c1fd4e6d39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.977146 10365 consensus_queue.cc:1048] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.984602 10289 raft_consensus.cc:1275] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer dcea1aa9581a44ba9b2b88c1fd4e6d39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.986258 10361 consensus_queue.cc:1048] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:22.103274 10214 raft_consensus.cc:1275] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.104640 10412 consensus_queue.cc:1048] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:22.113255 10289 raft_consensus.cc:1275] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.115196 10412 consensus_queue.cc:1048] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:24.248363 10037 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52238:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:24.250553 10037 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:24.305970 10129 tablet_service.cc:1511] Processing CreateTablet for tablet e279e6629ead480f949ba07a71d0db3d (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:24.307255 10205 tablet_service.cc:1511] Processing CreateTablet for tablet e279e6629ead480f949ba07a71d0db3d (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:24.307737 10129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e279e6629ead480f949ba07a71d0db3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.308836 10205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e279e6629ead480f949ba07a71d0db3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.308655 10279 tablet_service.cc:1511] Processing CreateTablet for tablet e279e6629ead480f949ba07a71d0db3d (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:24.310163 10279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e279e6629ead480f949ba07a71d0db3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.312999 10275 tablet_service.cc:1511] Processing CreateTablet for tablet 3b7d0d52ca5f4afe943feea489c33281 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:24.314426 10275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b7d0d52ca5f4afe943feea489c33281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.319468 10204 tablet_service.cc:1511] Processing CreateTablet for tablet 3b7d0d52ca5f4afe943feea489c33281 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:24.319774 10278 tablet_service.cc:1511] Processing CreateTablet for tablet fcdc68c737ef4db89d6f5db97318c4e4 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:24.320883 10204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b7d0d52ca5f4afe943feea489c33281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.321161 10278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdc68c737ef4db89d6f5db97318c4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.325466 10128 tablet_service.cc:1511] Processing CreateTablet for tablet 3b7d0d52ca5f4afe943feea489c33281 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:24.326834 10128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b7d0d52ca5f4afe943feea489c33281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.332324 10123 tablet_service.cc:1511] Processing CreateTablet for tablet fcdc68c737ef4db89d6f5db97318c4e4 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:24.333371 10203 tablet_service.cc:1511] Processing CreateTablet for tablet fcdc68c737ef4db89d6f5db97318c4e4 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:24.334205 10123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdc68c737ef4db89d6f5db97318c4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.334762 10203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdc68c737ef4db89d6f5db97318c4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.337299 10274 tablet_service.cc:1511] Processing CreateTablet for tablet be98fc3e135c404996c5875017b2b8bc (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:24.339365 10202 tablet_service.cc:1511] Processing CreateTablet for tablet be98fc3e135c404996c5875017b2b8bc (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:24.340718 10202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be98fc3e135c404996c5875017b2b8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.340241 10277 tablet_service.cc:1511] Processing CreateTablet for tablet bbebb793bacb455cb8ffb010370d5ed4 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:24.342054 10277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbebb793bacb455cb8ffb010370d5ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.343755 10201 tablet_service.cc:1511] Processing CreateTablet for tablet bbebb793bacb455cb8ffb010370d5ed4 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:24.345005 10201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbebb793bacb455cb8ffb010370d5ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.349382 10273 tablet_service.cc:1511] Processing CreateTablet for tablet 9d4248c5db9d44519763182f5198c24f (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:24.355209 10273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d4248c5db9d44519763182f5198c24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.356981 10274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be98fc3e135c404996c5875017b2b8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.402170 10200 tablet_service.cc:1511] Processing CreateTablet for tablet 9d4248c5db9d44519763182f5198c24f (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:24.404207 10200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d4248c5db9d44519763182f5198c24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.423277 10204 tablet_service.cc:1511] Processing CreateTablet for tablet fbbd94272e1d43f0b3babff434819669 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:24.424799 10204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbd94272e1d43f0b3babff434819669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.424192 10199 tablet_service.cc:1511] Processing CreateTablet for tablet c6c6e16e99db430483f8223387e05756 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:24.426097 10199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c6e16e99db430483f8223387e05756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.428138 10276 tablet_service.cc:1511] Processing CreateTablet for tablet fbbd94272e1d43f0b3babff434819669 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:24.429442 10276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbd94272e1d43f0b3babff434819669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.436347 10272 tablet_service.cc:1511] Processing CreateTablet for tablet c6c6e16e99db430483f8223387e05756 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:24.436772 10198 tablet_service.cc:1511] Processing CreateTablet for tablet af05560942434cd283af3936771f53e2 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:24.437752 10272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c6e16e99db430483f8223387e05756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.438602 10198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af05560942434cd283af3936771f53e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.443858 10271 tablet_service.cc:1511] Processing CreateTablet for tablet af05560942434cd283af3936771f53e2 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:24.445161 10271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af05560942434cd283af3936771f53e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.452458 10130 tablet_service.cc:1511] Processing CreateTablet for tablet bbebb793bacb455cb8ffb010370d5ed4 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:24.452495 10127 tablet_service.cc:1511] Processing CreateTablet for tablet be98fc3e135c404996c5875017b2b8bc (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:24.453748 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbebb793bacb455cb8ffb010370d5ed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.454543 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be98fc3e135c404996c5875017b2b8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.460107 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 9d4248c5db9d44519763182f5198c24f (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:24.461403 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d4248c5db9d44519763182f5198c24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.468374 10125 tablet_service.cc:1511] Processing CreateTablet for tablet fbbd94272e1d43f0b3babff434819669 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:24.469727 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbd94272e1d43f0b3babff434819669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.476894 10122 tablet_service.cc:1511] Processing CreateTablet for tablet af05560942434cd283af3936771f53e2 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:24.477020 10126 tablet_service.cc:1511] Processing CreateTablet for tablet c6c6e16e99db430483f8223387e05756 (DEFAULT_TABLE table=soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:24.478406 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af05560942434cd283af3936771f53e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.479140 10126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c6e16e99db430483f8223387e05756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:24.578109 10430 tablet_bootstrap.cc:492] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:24.614548 10430 tablet_bootstrap.cc:654] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.619098 10429 tablet_bootstrap.cc:492] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:24.619295 10428 tablet_bootstrap.cc:492] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:24.627452 10428 tablet_bootstrap.cc:654] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.644304 10429 tablet_bootstrap.cc:654] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:24.647794 10086 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:24.648869 10430 tablet_bootstrap.cc:492] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:24.649369 10430 ts_tablet_manager.cc:1403] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.008s
I20260709 13:03:24.652454 10430 raft_consensus.cc:359] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.653239 10430 raft_consensus.cc:385] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.653564 10430 raft_consensus.cc:740] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.654114 10428 tablet_bootstrap.cc:492] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:24.654909 10428 ts_tablet_manager.cc:1403] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.007s
I20260709 13:03:24.654451 10430 consensus_queue.cc:260] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.657258 10430 ts_tablet_manager.cc:1434] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:24.657600 10429 tablet_bootstrap.cc:492] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:24.658131 10429 ts_tablet_manager.cc:1403] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.007s
I20260709 13:03:24.661105 10428 raft_consensus.cc:359] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.661382 10429 raft_consensus.cc:359] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.661909 10428 raft_consensus.cc:385] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.662124 10429 raft_consensus.cc:385] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.662384 10428 raft_consensus.cc:740] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.662468 10429 raft_consensus.cc:740] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.663568 10429 consensus_queue.cc:260] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.663513 10428 consensus_queue.cc:260] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.677134 10428 ts_tablet_manager.cc:1434] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:03:24.678560 10428 tablet_bootstrap.cc:492] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:24.677136 10429 ts_tablet_manager.cc:1434] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:03:24.680814 10429 tablet_bootstrap.cc:492] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:24.687474 10428 tablet_bootstrap.cc:654] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.688300 10429 tablet_bootstrap.cc:654] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.710495 10429 tablet_bootstrap.cc:492] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:24.711194 10429 ts_tablet_manager.cc:1403] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.007s
I20260709 13:03:24.715255 10429 raft_consensus.cc:359] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.716148 10429 raft_consensus.cc:385] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.716495 10429 raft_consensus.cc:740] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.717433 10429 consensus_queue.cc:260] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.720443 10429 ts_tablet_manager.cc:1434] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:24.721686 10429 tablet_bootstrap.cc:492] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:24.732417 10413 raft_consensus.cc:493] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.733204 10413 raft_consensus.cc:515] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.735664 10413 leader_election.cc:290] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:24.737422 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c6e16e99db430483f8223387e05756" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:24.737908 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c6e16e99db430483f8223387e05756" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
W20260709 13:03:24.739446 10255 leader_election.cc:343] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:24.740374 10255 leader_election.cc:343] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.740850 10255 leader_election.cc:304] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c; no voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42
I20260709 13:03:24.744966 10413 raft_consensus.cc:2749] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:24.746116 10429 tablet_bootstrap.cc:654] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.752426 10430 tablet_bootstrap.cc:492] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:24.764894 10429 tablet_bootstrap.cc:492] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:24.765592 10429 ts_tablet_manager.cc:1403] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.003s
I20260709 13:03:24.766759 10430 tablet_bootstrap.cc:654] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.769410 10429 raft_consensus.cc:359] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.770658 10429 raft_consensus.cc:385] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.771001 10429 raft_consensus.cc:740] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.771682 10429 consensus_queue.cc:260] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.775822 10428 tablet_bootstrap.cc:492] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:24.776391 10428 ts_tablet_manager.cc:1403] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.098s	user 0.027s	sys 0.054s
I20260709 13:03:24.776446 10429 ts_tablet_manager.cc:1434] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:03:24.777612 10429 tablet_bootstrap.cc:492] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:24.779707 10428 raft_consensus.cc:359] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.780444 10428 raft_consensus.cc:385] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.780710 10428 raft_consensus.cc:740] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.781417 10428 consensus_queue.cc:260] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.784538 10429 tablet_bootstrap.cc:654] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.792273 10417 raft_consensus.cc:493] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.792718 10430 tablet_bootstrap.cc:492] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:24.793397 10430 ts_tablet_manager.cc:1403] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.000s
I20260709 13:03:24.792801 10417 raft_consensus.cc:515] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.796510 10430 raft_consensus.cc:359] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.797019 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:24.797224 10430 raft_consensus.cc:385] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.797477 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:24.797850 10430 raft_consensus.cc:740] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
W20260709 13:03:24.798629 10180 leader_election.cc:343] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.798779 10430 consensus_queue.cc:260] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.799245 10417 leader_election.cc:290] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
W20260709 13:03:24.799906 10181 leader_election.cc:343] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.800427 10181 leader_election.cc:304] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42
I20260709 13:03:24.801203 10417 raft_consensus.cc:2749] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:24.801662 10430 ts_tablet_manager.cc:1434] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:03:24.802487 10428 ts_tablet_manager.cc:1434] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 13:03:24.803668 10428 tablet_bootstrap.cc:492] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:24.802701 10430 tablet_bootstrap.cc:492] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:24.818883 10429 tablet_bootstrap.cc:492] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:24.819494 10429 ts_tablet_manager.cc:1403] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.008s
I20260709 13:03:24.819933 10430 tablet_bootstrap.cc:654] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.822731 10429 raft_consensus.cc:359] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.823770 10429 raft_consensus.cc:385] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.824164 10429 raft_consensus.cc:740] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.824632 10428 tablet_bootstrap.cc:654] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.825133 10429 consensus_queue.cc:260] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.828001 10429 ts_tablet_manager.cc:1434] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:24.828980 10429 tablet_bootstrap.cc:492] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:24.835512 10429 tablet_bootstrap.cc:654] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.840977 10413 raft_consensus.cc:493] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.843668 10413 raft_consensus.cc:515] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.845908 10413 leader_election.cc:290] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:24.847306 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:24.847674 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
W20260709 13:03:24.848783 10255 leader_election.cc:343] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:24.849795 10255 leader_election.cc:343] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.850333 10255 leader_election.cc:304] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c; no voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42
I20260709 13:03:24.851445 10413 raft_consensus.cc:2749] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:24.846557 10429 tablet_bootstrap.cc:492] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:24.852560 10429 ts_tablet_manager.cc:1403] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:03:24.853375 10430 tablet_bootstrap.cc:492] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:24.853883 10430 ts_tablet_manager.cc:1403] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.003s
I20260709 13:03:24.855549 10429 raft_consensus.cc:359] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.856300 10429 raft_consensus.cc:385] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.856578 10429 raft_consensus.cc:740] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.856860 10430 raft_consensus.cc:359] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.857568 10430 raft_consensus.cc:385] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.857307 10429 consensus_queue.cc:260] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.857854 10430 raft_consensus.cc:740] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.858805 10430 consensus_queue.cc:260] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.863150 10429 ts_tablet_manager.cc:1434] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:24.864164 10429 tablet_bootstrap.cc:492] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:24.872778 10430 ts_tablet_manager.cc:1434] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:03:24.874290 10428 tablet_bootstrap.cc:492] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:24.874894 10428 ts_tablet_manager.cc:1403] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.020s
I20260709 13:03:24.875062 10429 tablet_bootstrap.cc:654] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.882846 10428 raft_consensus.cc:359] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.883523 10430 tablet_bootstrap.cc:492] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:24.883702 10428 raft_consensus.cc:385] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.884117 10428 raft_consensus.cc:740] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.887760 10428 consensus_queue.cc:260] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.890722 10428 ts_tablet_manager.cc:1434] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:03:24.892204 10428 tablet_bootstrap.cc:492] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:24.892246 10430 tablet_bootstrap.cc:654] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.897492 10429 tablet_bootstrap.cc:492] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:24.898072 10429 ts_tablet_manager.cc:1403] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.005s
I20260709 13:03:24.900169 10428 tablet_bootstrap.cc:654] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.900964 10429 raft_consensus.cc:359] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.902133 10429 raft_consensus.cc:385] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.902416 10429 raft_consensus.cc:740] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.903146 10429 consensus_queue.cc:260] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.904784 10417 raft_consensus.cc:493] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.905249 10417 raft_consensus.cc:515] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.905864 10429 ts_tablet_manager.cc:1434] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:24.906951 10429 tablet_bootstrap.cc:492] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:24.912024 10430 tablet_bootstrap.cc:492] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:24.912319 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:24.913978 10429 tablet_bootstrap.cc:654] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:24.913921 10181 leader_election.cc:343] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.912554 10430 ts_tablet_manager.cc:1403] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.004s
I20260709 13:03:24.916188 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:24.916872 10289 raft_consensus.cc:2468] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:24.918399 10180 leader_election.cc:304] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: e23799a9ec6848db8869919122abde42
I20260709 13:03:24.920753 10430 raft_consensus.cc:359] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.921554 10430 raft_consensus.cc:385] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.921859 10430 raft_consensus.cc:740] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.925148 10430 consensus_queue.cc:260] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.919517 10417 leader_election.cc:290] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:24.928225 10417 raft_consensus.cc:2804] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:24.932107 10417 raft_consensus.cc:493] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.932619 10417 raft_consensus.cc:3060] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.936234 10430 ts_tablet_manager.cc:1434] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:03:24.944139 10417 raft_consensus.cc:515] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.946874 10430 tablet_bootstrap.cc:492] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:24.947980 10428 tablet_bootstrap.cc:492] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:24.948506 10428 ts_tablet_manager.cc:1403] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.016s
I20260709 13:03:24.949203 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
W20260709 13:03:24.950708 10181 leader_election.cc:343] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.951609 10428 raft_consensus.cc:359] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.952361 10428 raft_consensus.cc:385] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.952646 10428 raft_consensus.cc:740] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.953365 10428 consensus_queue.cc:260] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.953751 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:24.954309 10289 raft_consensus.cc:3060] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.955731 10428 ts_tablet_manager.cc:1434] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:03:24.956750 10428 tablet_bootstrap.cc:492] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:24.963199 10428 tablet_bootstrap.cc:654] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.971635 10289 raft_consensus.cc:2468] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 1.
I20260709 13:03:24.974422 10429 tablet_bootstrap.cc:492] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:24.974325 10180 leader_election.cc:304] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: e23799a9ec6848db8869919122abde42
I20260709 13:03:24.974979 10429 ts_tablet_manager.cc:1403] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.015s
I20260709 13:03:24.975469 10444 raft_consensus.cc:2804] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:24.972995 10417 leader_election.cc:290] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:24.976675 10417 raft_consensus.cc:493] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.977716 10417 raft_consensus.cc:515] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.977173 10444 raft_consensus.cc:697] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Becoming Leader. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:24.978215 10429 raft_consensus.cc:359] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.979084 10429 raft_consensus.cc:385] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.979403 10429 raft_consensus.cc:740] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.981101 10363 raft_consensus.cc:493] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.987390 10429 consensus_queue.cc:260] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.987812 10363 raft_consensus.cc:515] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.990123 10413 raft_consensus.cc:493] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.990655 10413 raft_consensus.cc:515] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.991816 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:24.992671 10289 raft_consensus.cc:2468] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 0.
I20260709 13:03:24.992748 10413 leader_election.cc:290] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:24.993237 10363 leader_election.cc:290] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:24.998394 10448 raft_consensus.cc:493] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.979581 10444 consensus_queue.cc:237] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:24.999399 10105 leader_election.cc:304] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:24.994534 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:25.000487 10137 raft_consensus.cc:2468] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:24.996066 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:24.996630 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:25.001827 10140 raft_consensus.cc:2468] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:25.002373 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:25.003129 10181 leader_election.cc:304] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.004297 10255 leader_election.cc:304] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.005300 10413 raft_consensus.cc:2804] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.005672 10413 raft_consensus.cc:493] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.006016 10413 raft_consensus.cc:3060] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.010114 10289 raft_consensus.cc:2468] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:25.003779 10417 leader_election.cc:290] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.014117 10417 raft_consensus.cc:2804] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.016453 10417 raft_consensus.cc:493] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.018191 10417 raft_consensus.cc:3060] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.014635 10413 raft_consensus.cc:515] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.018903 10363 raft_consensus.cc:2804] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.022805 10363 raft_consensus.cc:493] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.023350 10363 raft_consensus.cc:3060] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.023387 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:25.024175 10140 raft_consensus.cc:3060] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.034899 10140 raft_consensus.cc:2468] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:25.036303 10255 leader_election.cc:304] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.038702 10429 ts_tablet_manager.cc:1434] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.063s	user 0.013s	sys 0.021s
I20260709 13:03:25.039848 10429 tablet_bootstrap.cc:492] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:25.054049 10429 tablet_bootstrap.cc:654] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.059875 10038 catalog_manager.cc:5697] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.998984 10448 raft_consensus.cc:515] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.063015 10214 raft_consensus.cc:2468] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:25.070115 10455 raft_consensus.cc:493] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.070523 10413 leader_election.cc:290] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:25.074898 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:24.954309 10430 tablet_bootstrap.cc:654] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.075690 10448 leader_election.cc:290] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.076949 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:25.079840 10140 raft_consensus.cc:2393] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in current term 1: Already voted for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in this term.
I20260709 13:03:25.078569 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:25.071780 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:25.077086 10363 raft_consensus.cc:515] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.072896 10428 tablet_bootstrap.cc:492] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:25.074378 10429 tablet_bootstrap.cc:492] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:25.070739 10455 raft_consensus.cc:515] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.081955 10214 raft_consensus.cc:3060] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.090394 10449 raft_consensus.cc:493] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.091032 10212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:25.091106 10449 raft_consensus.cc:515] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.091917 10212 raft_consensus.cc:2468] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 0.
I20260709 13:03:25.086576 10213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:25.088059 10288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.094183 10288 raft_consensus.cc:3060] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.084031 10428 ts_tablet_manager.cc:1403] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.038s
I20260709 13:03:25.084012 10429 ts_tablet_manager.cc:1403] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 13:03:25.097756 10428 raft_consensus.cc:359] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.097978 10429 raft_consensus.cc:359] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.098430 10428 raft_consensus.cc:385] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.098723 10429 raft_consensus.cc:385] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.090464 10287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:25.103047 10428 raft_consensus.cc:740] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.103363 10288 raft_consensus.cc:2468] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 1.
I20260709 13:03:25.089155 10455 leader_election.cc:290] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.103955 10428 consensus_queue.cc:260] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.101357 10286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:25.101575 10213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:25.102476 10449 leader_election.cc:290] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.105376 10417 raft_consensus.cc:515] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.104542 10429 raft_consensus.cc:740] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.106007 10213 raft_consensus.cc:2468] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 0.
I20260709 13:03:25.106530 10429 consensus_queue.cc:260] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.108706 10429 ts_tablet_manager.cc:1434] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:25.101069 10214 raft_consensus.cc:2468] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:25.087342 10363 leader_election.cc:290] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.099850 10106 leader_election.cc:304] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.109937 10428 ts_tablet_manager.cc:1434] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:03:25.110257 10106 leader_election.cc:304] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.110973 10428 tablet_bootstrap.cc:492] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:25.111096 10455 raft_consensus.cc:2804] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:25.111163 10105 leader_election.cc:343] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.111943 10363 raft_consensus.cc:2804] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.112300 10363 raft_consensus.cc:493] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.112666 10363 raft_consensus.cc:3060] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.114141 10105 leader_election.cc:304] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:25.072362 10453 raft_consensus.cc:2804] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.115489 10453 raft_consensus.cc:697] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:25.115985 10429 tablet_bootstrap.cc:492] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39: Bootstrap starting.
I20260709 13:03:25.116329 10453 consensus_queue.cc:237] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
W20260709 13:03:25.116874 10105 leader_election.cc:343] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.117488 10430 tablet_bootstrap.cc:492] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:25.118219 10215 raft_consensus.cc:2393] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e23799a9ec6848db8869919122abde42 in current term 1: Already voted for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in this term.
I20260709 13:03:25.118664 10455 raft_consensus.cc:493] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.121902 10455 raft_consensus.cc:3060] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.123466 10430 ts_tablet_manager.cc:1403] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.001s
I20260709 13:03:25.123009 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:25.127708 10363 raft_consensus.cc:515] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.128057 10286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.128872 10286 raft_consensus.cc:2393] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in current term 1: Already voted for candidate e23799a9ec6848db8869919122abde42 in this term.
I20260709 13:03:25.130422 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:25.130944 10417 leader_election.cc:290] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.131014 10215 raft_consensus.cc:3060] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.133101 10455 raft_consensus.cc:515] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.133401 10430 raft_consensus.cc:359] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.119802 10460 raft_consensus.cc:2804] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.134732 10430 raft_consensus.cc:385] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.135102 10430 raft_consensus.cc:740] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.135424 10460 raft_consensus.cc:697] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:25.135871 10430 consensus_queue.cc:260] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.137079 10460 consensus_queue.cc:237] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.139377 10430 ts_tablet_manager.cc:1434] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:03:25.140427 10430 tablet_bootstrap.cc:492] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:25.140468 10429 tablet_bootstrap.cc:654] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.142247 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:25.142351 10288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.142903 10455 leader_election.cc:290] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.142976 10214 raft_consensus.cc:3060] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:25.143741 10105 leader_election.cc:343] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.145715 10363 leader_election.cc:290] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.140786 10215 raft_consensus.cc:2468] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 1.
I20260709 13:03:25.146437 10288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.147181 10106 leader_election.cc:304] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
W20260709 13:03:25.148054 10105 leader_election.cc:343] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.148322 10363 raft_consensus.cc:2804] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.148898 10363 raft_consensus.cc:697] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:25.149716 10363 consensus_queue.cc:237] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.150377 10428 tablet_bootstrap.cc:654] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.150997 10214 raft_consensus.cc:2468] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 1.
I20260709 13:03:25.152333 10106 leader_election.cc:304] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: d0cbad478c6d47d19d9d3c2bec9ecb1c
I20260709 13:03:25.153355 10455 raft_consensus.cc:2804] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.154163 10455 raft_consensus.cc:697] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:25.155368 10455 consensus_queue.cc:237] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.159471 10180 leader_election.cc:304] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42
I20260709 13:03:25.160800 10451 raft_consensus.cc:2749] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.167596 10428 tablet_bootstrap.cc:492] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:25.168331 10428 ts_tablet_manager.cc:1403] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.007s
I20260709 13:03:25.170499 10038 catalog_manager.cc:5697] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.172053 10428 raft_consensus.cc:359] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.173007 10428 raft_consensus.cc:385] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.173309 10428 raft_consensus.cc:740] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.174386 10428 consensus_queue.cc:260] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.180681 10428 ts_tablet_manager.cc:1434] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:03:25.181814 10428 tablet_bootstrap.cc:492] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:25.187237 10429 tablet_bootstrap.cc:492] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39: No bootstrap required, opened a new log
I20260709 13:03:25.187788 10429 ts_tablet_manager.cc:1403] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.009s
I20260709 13:03:25.190697 10428 tablet_bootstrap.cc:654] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.192257 10429 raft_consensus.cc:359] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.192847 10429 raft_consensus.cc:385] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.193065 10429 raft_consensus.cc:740] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.193714 10429 consensus_queue.cc:260] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.198449 10429 ts_tablet_manager.cc:1434] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:25.199841 10430 tablet_bootstrap.cc:654] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.200413 10181 leader_election.cc:304] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42
I20260709 13:03:25.201934 10448 raft_consensus.cc:2749] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.203543 10035 catalog_manager.cc:5697] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 0 to 1, leader changed from <none> to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.221494 10428 tablet_bootstrap.cc:492] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:25.222021 10428 ts_tablet_manager.cc:1403] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.022s
I20260709 13:03:25.223181 10430 tablet_bootstrap.cc:492] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:25.223961 10430 ts_tablet_manager.cc:1403] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.015s
I20260709 13:03:25.224964 10428 raft_consensus.cc:359] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.225706 10428 raft_consensus.cc:385] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.225970 10428 raft_consensus.cc:740] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.226620 10428 consensus_queue.cc:260] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.227063 10430 raft_consensus.cc:359] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.228102 10430 raft_consensus.cc:385] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.227766 10037 catalog_manager.cc:5697] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 0 to 1, leader changed from <none> to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.228408 10430 raft_consensus.cc:740] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.228902 10428 ts_tablet_manager.cc:1434] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:03:25.229933 10428 tablet_bootstrap.cc:492] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:25.229246 10430 consensus_queue.cc:260] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.229257 10037 catalog_manager.cc:5697] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 0 to 1, leader changed from <none> to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.232331 10430 ts_tablet_manager.cc:1434] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:03:25.233397 10430 tablet_bootstrap.cc:492] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:25.237123 10428 tablet_bootstrap.cc:654] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.240031 10430 tablet_bootstrap.cc:654] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.248715 10428 tablet_bootstrap.cc:492] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:25.249200 10428 ts_tablet_manager.cc:1403] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:03:25.250723 10430 tablet_bootstrap.cc:492] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:25.251212 10430 ts_tablet_manager.cc:1403] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:03:25.251456 10413 raft_consensus.cc:493] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.251827 10413 raft_consensus.cc:515] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.251891 10428 raft_consensus.cc:359] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.252559 10428 raft_consensus.cc:385] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.252832 10428 raft_consensus.cc:740] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.253412 10413 leader_election.cc:290] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:25.253413 10428 consensus_queue.cc:260] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.253858 10430 raft_consensus.cc:359] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.254853 10430 raft_consensus.cc:385] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.255155 10430 raft_consensus.cc:740] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.255415 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:25.255810 10428 ts_tablet_manager.cc:1434] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:03:25.255877 10430 consensus_queue.cc:260] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.254068 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:25.256043 10214 raft_consensus.cc:2468] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:25.258885 10140 raft_consensus.cc:2468] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 0.
I20260709 13:03:25.256901 10428 tablet_bootstrap.cc:492] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42: Bootstrap starting.
I20260709 13:03:25.260483 10255 leader_election.cc:304] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:25.262217 10413 raft_consensus.cc:2804] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.262571 10413 raft_consensus.cc:493] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.262962 10413 raft_consensus.cc:3060] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.258239 10430 ts_tablet_manager.cc:1434] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:03:25.264477 10430 tablet_bootstrap.cc:492] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:25.270299 10428 tablet_bootstrap.cc:654] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.270514 10430 tablet_bootstrap.cc:654] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.272356 10413 raft_consensus.cc:515] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.275182 10413 leader_election.cc:290] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:25.275867 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:25.276340 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:25.276467 10140 raft_consensus.cc:3060] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.276625 10430 tablet_bootstrap.cc:492] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:25.276978 10214 raft_consensus.cc:3060] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.277189 10430 ts_tablet_manager.cc:1403] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.001s
I20260709 13:03:25.277650 10428 tablet_bootstrap.cc:492] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42: No bootstrap required, opened a new log
I20260709 13:03:25.278121 10428 ts_tablet_manager.cc:1403] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.007s
I20260709 13:03:25.279944 10430 raft_consensus.cc:359] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.280629 10430 raft_consensus.cc:385] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.280913 10430 raft_consensus.cc:740] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.280773 10428 raft_consensus.cc:359] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.281576 10428 raft_consensus.cc:385] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.281922 10428 raft_consensus.cc:740] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.281661 10430 consensus_queue.cc:260] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.282697 10428 consensus_queue.cc:260] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.283823 10430 ts_tablet_manager.cc:1434] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:25.283864 10214 raft_consensus.cc:2468] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:25.284793 10430 tablet_bootstrap.cc:492] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Bootstrap starting.
I20260709 13:03:25.285151 10255 leader_election.cc:304] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:25.286253 10453 raft_consensus.cc:2804] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.286706 10453 raft_consensus.cc:697] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:25.287200 10428 ts_tablet_manager.cc:1434] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:03:25.287498 10453 consensus_queue.cc:237] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.291565 10430 tablet_bootstrap.cc:654] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.290297 10140 raft_consensus.cc:2468] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 1.
I20260709 13:03:25.309254 10430 tablet_bootstrap.cc:492] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: No bootstrap required, opened a new log
I20260709 13:03:25.309736 10430 ts_tablet_manager.cc:1403] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 13:03:25.312352 10430 raft_consensus.cc:359] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.313004 10430 raft_consensus.cc:385] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.313280 10430 raft_consensus.cc:740] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.313272 10037 catalog_manager.cc:5697] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.314273 10430 consensus_queue.cc:260] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.316697 10430 ts_tablet_manager.cc:1434] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:25.362942 10448 raft_consensus.cc:493] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.363386 10448 raft_consensus.cc:515] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.365257 10448 leader_election.cc:290] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.365922 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:25.366271 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:25.366609 10140 raft_consensus.cc:2468] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:25.367038 10289 raft_consensus.cc:2468] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:25.367758 10181 leader_election.cc:304] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.368544 10448 raft_consensus.cc:2804] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.368928 10448 raft_consensus.cc:493] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.369243 10448 raft_consensus.cc:3060] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.374477 10448 raft_consensus.cc:515] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.375972 10448 leader_election.cc:290] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.376631 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:25.376935 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.377161 10140 raft_consensus.cc:3060] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.377478 10289 raft_consensus.cc:3060] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.381767 10289 raft_consensus.cc:2468] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 1.
I20260709 13:03:25.381853 10140 raft_consensus.cc:2468] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 1.
I20260709 13:03:25.382750 10180 leader_election.cc:304] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:25.383417 10448 raft_consensus.cc:2804] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.383837 10448 raft_consensus.cc:697] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Becoming Leader. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:25.384573 10448 consensus_queue.cc:237] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.391850 10037 catalog_manager.cc:5697] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.395649 10448 raft_consensus.cc:493] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.396153 10448 raft_consensus.cc:515] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.398145 10448 leader_election.cc:290] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.399140 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c6e16e99db430483f8223387e05756" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:25.399376 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c6e16e99db430483f8223387e05756" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:25.399834 10140 raft_consensus.cc:2468] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:25.399919 10289 raft_consensus.cc:2468] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 0.
I20260709 13:03:25.400899 10181 leader_election.cc:304] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.401544 10448 raft_consensus.cc:2804] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.401866 10448 raft_consensus.cc:493] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.402174 10448 raft_consensus.cc:3060] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.406780 10448 raft_consensus.cc:515] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.408483 10448 leader_election.cc:290] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.409061 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c6e16e99db430483f8223387e05756" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:25.409442 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c6e16e99db430483f8223387e05756" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.409746 10140 raft_consensus.cc:3060] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.410069 10289 raft_consensus.cc:3060] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.414378 10289 raft_consensus.cc:2468] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 1.
I20260709 13:03:25.414585 10140 raft_consensus.cc:2468] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 1.
I20260709 13:03:25.415320 10180 leader_election.cc:304] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:25.416191 10448 raft_consensus.cc:2804] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.416622 10448 raft_consensus.cc:697] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Becoming Leader. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:25.417248 10448 consensus_queue.cc:237] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.424084 10037 catalog_manager.cc:5697] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.446242 10453 raft_consensus.cc:493] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.446966 10453 raft_consensus.cc:515] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.448745 10453 leader_election.cc:290] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:25.449302 10140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:25.449615 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:25.450412 10214 raft_consensus.cc:2393] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in current term 1: Already voted for candidate e23799a9ec6848db8869919122abde42 in this term.
I20260709 13:03:25.451215 10255 leader_election.cc:304] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c; no voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42
I20260709 13:03:25.451809 10453 raft_consensus.cc:3060] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.456708 10453 raft_consensus.cc:2749] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.458962 10363 raft_consensus.cc:493] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.459472 10363 raft_consensus.cc:515] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.461426 10363 leader_election.cc:290] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.462105 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdc68c737ef4db89d6f5db97318c4e4" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:25.462325 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdc68c737ef4db89d6f5db97318c4e4" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:25.462774 10214 raft_consensus.cc:2468] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 0.
I20260709 13:03:25.463001 10289 raft_consensus.cc:2468] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 0.
I20260709 13:03:25.463855 10106 leader_election.cc:304] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.464548 10363 raft_consensus.cc:2804] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.464942 10363 raft_consensus.cc:493] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.465258 10363 raft_consensus.cc:3060] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.470052 10363 raft_consensus.cc:515] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.471658 10363 leader_election.cc:290] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.472342 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdc68c737ef4db89d6f5db97318c4e4" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:25.472554 10288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdc68c737ef4db89d6f5db97318c4e4" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.472875 10214 raft_consensus.cc:3060] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.473213 10288 raft_consensus.cc:3060] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.478004 10214 raft_consensus.cc:2468] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 1.
I20260709 13:03:25.478452 10288 raft_consensus.cc:2468] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 1.
I20260709 13:03:25.479085 10106 leader_election.cc:304] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.479956 10363 raft_consensus.cc:2804] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.480435 10363 raft_consensus.cc:697] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:25.481134 10363 consensus_queue.cc:237] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.487592 10037 catalog_manager.cc:5697] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 0 to 1, leader changed from <none> to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.496502 10363 raft_consensus.cc:493] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.496996 10363 raft_consensus.cc:515] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.498725 10363 leader_election.cc:290] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.499284 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:25.499650 10288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" is_pre_election: true
I20260709 13:03:25.500355 10288 raft_consensus.cc:2393] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e23799a9ec6848db8869919122abde42 in current term 1: Already voted for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in this term.
I20260709 13:03:25.501262 10105 leader_election.cc:304] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e23799a9ec6848db8869919122abde42; no voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:25.501907 10363 raft_consensus.cc:3060] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.507680 10363 raft_consensus.cc:2749] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.510610 10448 consensus_queue.cc:1048] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.520300 10288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
mode: GRACEFUL
new_leader_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:58834
I20260709 13:03:25.522024 10288 raft_consensus.cc:606] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Received request to transfer leadership to TS e23799a9ec6848db8869919122abde42
I20260709 13:03:25.525967 10417 consensus_queue.cc:1048] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.534121 10288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
mode: GRACEFUL
new_leader_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:58834
I20260709 13:03:25.534732 10288 raft_consensus.cc:606] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Received request to transfer leadership to TS e23799a9ec6848db8869919122abde42
I20260709 13:03:25.541088 10363 consensus_queue.cc:1048] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.545300 10453 consensus_queue.cc:1048] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.556941 10453 raft_consensus.cc:993] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c: : Instructing follower e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:25.557399 10453 raft_consensus.cc:1081] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Signalling peer e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:25.561893 10137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d"
dest_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:49824
I20260709 13:03:25.562520 10137 raft_consensus.cc:493] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.563450 10137 raft_consensus.cc:3060] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.569283 10413 consensus_queue.cc:1048] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.571288 10137 raft_consensus.cc:515] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.578318 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:25.578395 10455 consensus_queue.cc:1048] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:25.580068 10288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e279e6629ead480f949ba07a71d0db3d" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.580621 10288 raft_consensus.cc:3055] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:25.582791 10137 leader_election.cc:290] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.583142 10288 raft_consensus.cc:740] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:25.585803 10288 consensus_queue.cc:260] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.586953 10288 raft_consensus.cc:3060] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.614564 10455 consensus_queue.cc:1048] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.616828 10288 raft_consensus.cc:2468] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
I20260709 13:03:25.619807 10105 leader_election.cc:304] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:25.621421 10455 raft_consensus.cc:2804] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:25.621970 10455 raft_consensus.cc:697] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:25.622800 10455 consensus_queue.cc:237] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.627939 10214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc"
dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
mode: GRACEFUL
new_leader_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:44980
I20260709 13:03:25.628983 10214 raft_consensus.cc:606] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Received request to transfer leadership to TS e23799a9ec6848db8869919122abde42
I20260709 13:03:25.631615 10460 consensus_queue.cc:1048] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.631841 10037 catalog_manager.cc:5697] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 1 to 2, leader changed from d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195) to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.641188 10137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4"
dest_uuid: "e23799a9ec6848db8869919122abde42"
mode: GRACEFUL
new_leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
 from {username='slave'} at 127.0.0.1:49848
I20260709 13:03:25.641801 10137 raft_consensus.cc:606] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Received request to transfer leadership to TS dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:25.647861 10137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f"
dest_uuid: "e23799a9ec6848db8869919122abde42"
mode: GRACEFUL
new_leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
 from {username='slave'} at 127.0.0.1:49848
I20260709 13:03:25.648463 10137 raft_consensus.cc:606] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Received request to transfer leadership to TS dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:25.653456 10487 raft_consensus.cc:493] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.653906 10487 raft_consensus.cc:515] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.662494 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23799a9ec6848db8869919122abde42" is_pre_election: true
I20260709 13:03:25.663203 10487 leader_election.cc:290] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:25.664645 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" is_pre_election: true
I20260709 13:03:25.665944 10215 raft_consensus.cc:2393] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in current term 1: Already voted for candidate e23799a9ec6848db8869919122abde42 in this term.
I20260709 13:03:25.665813 10137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af05560942434cd283af3936771f53e2"
dest_uuid: "e23799a9ec6848db8869919122abde42"
mode: GRACEFUL
new_leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:49848
I20260709 13:03:25.666483 10137 raft_consensus.cc:606] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Received request to transfer leadership to TS d0cbad478c6d47d19d9d3c2bec9ecb1c
I20260709 13:03:25.666977 10255 leader_election.cc:304] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c; no voters: dcea1aa9581a44ba9b2b88c1fd4e6d39, e23799a9ec6848db8869919122abde42
I20260709 13:03:25.668821 10289 raft_consensus.cc:3060] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.674187 10487 raft_consensus.cc:2749] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.674597 10460 consensus_queue.cc:1048] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.688848 10460 consensus_queue.cc:1048] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:25.697386 10455 raft_consensus.cc:993] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42: : Instructing follower dcea1aa9581a44ba9b2b88c1fd4e6d39 to start an election
I20260709 13:03:25.697865 10460 raft_consensus.cc:1081] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Signalling peer dcea1aa9581a44ba9b2b88c1fd4e6d39 to start an election
I20260709 13:03:25.699429 10215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4"
dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
 from {username='slave'} at 127.0.0.1:60252
I20260709 13:03:25.699940 10215 raft_consensus.cc:493] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.700241 10215 raft_consensus.cc:3060] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.705009 10215 raft_consensus.cc:515] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.706512 10215 leader_election.cc:290] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 2 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.707333 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:25.707734 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbebb793bacb455cb8ffb010370d5ed4" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.707995 10137 raft_consensus.cc:3055] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:25.708357 10289 raft_consensus.cc:3060] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.708402 10137 raft_consensus.cc:740] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:25.709370 10137 consensus_queue.cc:260] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.710654 10137 raft_consensus.cc:3060] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.713533 10289 raft_consensus.cc:2468] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 2.
I20260709 13:03:25.714529 10180 leader_election.cc:304] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:25.715310 10417 raft_consensus.cc:2804] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:25.715727 10417 raft_consensus.cc:697] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Becoming Leader. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:25.716418 10137 raft_consensus.cc:2468] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 2.
I20260709 13:03:25.716441 10417 consensus_queue.cc:237] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.722450 10035 catalog_manager.cc:5697] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 reported cstate change: term changed from 1 to 2, leader changed from e23799a9ec6848db8869919122abde42 (127.0.107.193) to dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.787312 10417 consensus_queue.cc:1048] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.797147 10451 consensus_queue.cc:1048] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.806516 10448 raft_consensus.cc:993] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39: : Instructing follower e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:25.807031 10417 raft_consensus.cc:1081] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Signalling peer e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:25.808719 10137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc"
dest_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:49838
I20260709 13:03:25.809195 10137 raft_consensus.cc:493] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.809563 10137 raft_consensus.cc:3060] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.814248 10137 raft_consensus.cc:515] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.815904 10137 leader_election.cc:290] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.816519 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:25.816979 10289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.817188 10215 raft_consensus.cc:3055] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:25.817598 10215 raft_consensus.cc:740] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:25.817649 10289 raft_consensus.cc:3060] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.818517 10215 consensus_queue.cc:260] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.819777 10215 raft_consensus.cc:3060] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.824242 10289 raft_consensus.cc:2468] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
I20260709 13:03:25.825588 10105 leader_election.cc:304] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:25.826404 10460 raft_consensus.cc:2804] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:25.826473 10215 raft_consensus.cc:2468] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
I20260709 13:03:25.826900 10460 raft_consensus.cc:697] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:25.827780 10460 consensus_queue.cc:237] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.833572 10035 catalog_manager.cc:5697] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 1 to 2, leader changed from dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194) to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.845481 10487 consensus_queue.cc:1048] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.848033 10496 consensus_queue.cc:1048] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.852010 10413 raft_consensus.cc:993] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c: : Instructing follower e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:25.852474 10413 raft_consensus.cc:1081] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Signalling peer e23799a9ec6848db8869919122abde42 to start an election
I20260709 13:03:25.854349 10138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281"
dest_uuid: "e23799a9ec6848db8869919122abde42"
 from {username='slave'} at 127.0.0.1:49824
I20260709 13:03:25.854905 10138 raft_consensus.cc:493] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.855258 10138 raft_consensus.cc:3060] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.857513 10413 consensus_queue.cc:1048] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.865679 10417 consensus_queue.cc:1048] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.869617 10138 raft_consensus.cc:515] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.871775 10140 raft_consensus.cc:1240] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Rejecting Update request from peer d0cbad478c6d47d19d9d3c2bec9ecb1c for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:25.874598 10138 leader_election.cc:290] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Requested vote from peers dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.877121 10288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.875284 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7d0d52ca5f4afe943feea489c33281" candidate_uuid: "e23799a9ec6848db8869919122abde42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:25.876111 10413 consensus_queue.cc:1059] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.883261 10288 raft_consensus.cc:3055] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:25.883630 10288 raft_consensus.cc:740] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:25.884428 10288 consensus_queue.cc:260] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.892701 10288 raft_consensus.cc:3060] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.900704 10288 raft_consensus.cc:2468] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23799a9ec6848db8869919122abde42 in term 2.
W20260709 13:03:25.901535 10453 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:25.901964 10105 leader_election.cc:304] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: dcea1aa9581a44ba9b2b88c1fd4e6d39
I20260709 13:03:25.903179 10460 raft_consensus.cc:2804] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:25.903635 10460 raft_consensus.cc:697] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Becoming Leader. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:25.904402 10460 consensus_queue.cc:237] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.910725 10037 catalog_manager.cc:5697] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 reported cstate change: term changed from 1 to 2, leader changed from d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195) to e23799a9ec6848db8869919122abde42 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e23799a9ec6848db8869919122abde42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.951956 10460 raft_consensus.cc:993] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42: : Instructing follower dcea1aa9581a44ba9b2b88c1fd4e6d39 to start an election
I20260709 13:03:25.952358 10455 raft_consensus.cc:1081] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Signalling peer dcea1aa9581a44ba9b2b88c1fd4e6d39 to start an election
I20260709 13:03:25.953496 10215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f"
dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
 from {username='slave'} at 127.0.0.1:60252
I20260709 13:03:25.953900 10215 raft_consensus.cc:493] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.954157 10215 raft_consensus.cc:3060] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.958174 10215 raft_consensus.cc:515] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.959532 10215 leader_election.cc:290] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 2 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195:40691)
I20260709 13:03:25.960264 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:25.960608 10288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4248c5db9d44519763182f5198c24f" candidate_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
I20260709 13:03:25.960873 10137 raft_consensus.cc:3055] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:25.961215 10288 raft_consensus.cc:3060] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.961261 10137 raft_consensus.cc:740] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:25.962100 10137 consensus_queue.cc:260] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.963078 10137 raft_consensus.cc:3060] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.967007 10288 raft_consensus.cc:2468] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 2.
I20260709 13:03:25.968165 10180 leader_election.cc:304] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:25.968986 10417 raft_consensus.cc:2804] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:25.969408 10417 raft_consensus.cc:697] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Becoming Leader. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:25.969336 10137 raft_consensus.cc:2468] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea1aa9581a44ba9b2b88c1fd4e6d39 in term 2.
I20260709 13:03:25.970264 10417 consensus_queue.cc:237] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:25.970876 10455 consensus_queue.cc:1048] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.978119 10037 catalog_manager.cc:5697] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 reported cstate change: term changed from 1 to 2, leader changed from e23799a9ec6848db8869919122abde42 (127.0.107.193) to dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.981328 10455 consensus_queue.cc:1048] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.007601 10215 raft_consensus.cc:3060] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.012313 10215 raft_consensus.cc:1275] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.013412 10455 consensus_queue.cc:1048] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.020521 10288 raft_consensus.cc:1275] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.022629 10493 consensus_queue.cc:1048] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.154846 10460 raft_consensus.cc:993] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42: : Instructing follower d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:26.155275 10460 raft_consensus.cc:1081] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Signalling peer d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:26.156685 10288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af05560942434cd283af3936771f53e2"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:58822
I20260709 13:03:26.157212 10288 raft_consensus.cc:493] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:26.157558 10288 raft_consensus.cc:3060] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.164202 10288 raft_consensus.cc:515] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:26.165668 10288 leader_election.cc:290] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 2 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:26.166313 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:26.166594 10215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af05560942434cd283af3936771f53e2" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:26.166998 10137 raft_consensus.cc:3055] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:26.167176 10215 raft_consensus.cc:3060] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.167379 10137 raft_consensus.cc:740] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:26.168233 10137 consensus_queue.cc:260] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:26.169436 10137 raft_consensus.cc:3060] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.173403 10215 raft_consensus.cc:2468] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 2.
I20260709 13:03:26.174463 10255 leader_election.cc:304] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:26.175191 10453 raft_consensus.cc:2804] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:26.175604 10453 raft_consensus.cc:697] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:26.175961 10137 raft_consensus.cc:2468] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 2.
I20260709 13:03:26.176323 10453 consensus_queue.cc:237] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:26.182883 10037 catalog_manager.cc:5697] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 1 to 2, leader changed from e23799a9ec6848db8869919122abde42 (127.0.107.193) to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.248134 10288 raft_consensus.cc:1275] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.249397 10460 consensus_queue.cc:1048] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.256480 10215 raft_consensus.cc:1275] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.257783 10493 consensus_queue.cc:1048] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.306663 10137 raft_consensus.cc:1275] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Refusing update from remote peer dcea1aa9581a44ba9b2b88c1fd4e6d39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.308095 10496 consensus_queue.cc:1048] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.316466 10288 raft_consensus.cc:1275] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer dcea1aa9581a44ba9b2b88c1fd4e6d39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.317854 10448 consensus_queue.cc:1048] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.405814 10288 raft_consensus.cc:1275] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.407085 10460 consensus_queue.cc:1048] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.414388 10215 raft_consensus.cc:3060] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.422250 10215 raft_consensus.cc:1275] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Refusing update from remote peer e23799a9ec6848db8869919122abde42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.423542 10455 consensus_queue.cc:1048] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.474536 10288 raft_consensus.cc:1275] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Refusing update from remote peer dcea1aa9581a44ba9b2b88c1fd4e6d39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.475912 10448 consensus_queue.cc:1048] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.484369 10137 raft_consensus.cc:1275] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Refusing update from remote peer dcea1aa9581a44ba9b2b88c1fd4e6d39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.485766 10417 consensus_queue.cc:1048] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.654871 10137 raft_consensus.cc:1275] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.656109 10453 consensus_queue.cc:1048] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.664235 10215 raft_consensus.cc:1275] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:26.668467 10453 consensus_queue.cc:1048] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:28.670531 10037 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52238:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:03:28.690662 10037 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52238:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:03:28.766945   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:03:28.839673 10549 tablet.cc:1724] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:28.837417 10548 tablet.cc:1724] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:28.864226 10545 tablet.cc:1724] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:28.867710 10547 tablet.cc:1724] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:28.897104 10552 tablet.cc:1724] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:28.958876 10105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:40691, user_credentials={real_user=slave}} blocked reactor thread for 57947.5us
W20260709 13:03:28.983072 10556 log.cc:927] Time spent T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:28.980007 10559 tablet.cc:1724] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:28.987309 10547 tablet.cc:1724] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.013583 10573 tablet.cc:1724] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.008554 10561 tablet.cc:1724] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.035830 10545 tablet.cc:1724] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.036741 10548 tablet.cc:1724] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.054203 10545 tablet.cc:1724] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.055838 10549 tablet.cc:1724] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.057677 10561 tablet.cc:1724] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.061640 10552 tablet.cc:1724] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.012980 10574 tablet.cc:1724] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.075194 10570 tablet.cc:1724] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.075088 10547 tablet.cc:1724] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.107784 10559 tablet.cc:1724] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.111160 10573 tablet.cc:1724] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.115474 10575 tablet.cc:1724] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.119509 10561 tablet.cc:1724] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.121587 10139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc"
dest_uuid: "e23799a9ec6848db8869919122abde42"
mode: GRACEFUL
new_leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:50436
I20260709 13:03:29.122248 10139 raft_consensus.cc:606] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Received request to transfer leadership to TS d0cbad478c6d47d19d9d3c2bec9ecb1c
I20260709 13:03:29.146214 10574 tablet.cc:1724] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.152941 10575 tablet.cc:1724] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.195806 10545 tablet.cc:1724] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.200899 10548 tablet.cc:1724] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.204476 10212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669"
dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
mode: GRACEFUL
new_leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:44982
I20260709 13:03:29.205129 10212 raft_consensus.cc:606] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Received request to transfer leadership to TS d0cbad478c6d47d19d9d3c2bec9ecb1c
I20260709 13:03:29.206432   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:03:29.206931   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:29.215207 10137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47f5d94334ce4648ba5bbd70e77f412f"
dest_uuid: "e23799a9ec6848db8869919122abde42"
mode: GRACEFUL
new_leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:50436
I20260709 13:03:29.215750 10137 raft_consensus.cc:606] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Received request to transfer leadership to TS d0cbad478c6d47d19d9d3c2bec9ecb1c
I20260709 13:03:29.200085 10573 tablet.cc:1724] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:29.218739 10212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac"
dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
mode: GRACEFUL
new_leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:44982
I20260709 13:03:29.219380 10212 raft_consensus.cc:606] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Received request to transfer leadership to TS d0cbad478c6d47d19d9d3c2bec9ecb1c
I20260709 13:03:29.220525   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:29.221129   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:29.225464 10565 raft_consensus.cc:993] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42: : Instructing follower d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:29.225989 10565 raft_consensus.cc:1081] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Signalling peer d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:29.227905 10287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47f5d94334ce4648ba5bbd70e77f412f"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:58822
I20260709 13:03:29.228384 10287 raft_consensus.cc:493] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:29.228690 10287 raft_consensus.cc:3060] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:29.235535 10287 raft_consensus.cc:515] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.237499 10287 leader_election.cc:290] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 2 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:29.238117 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5d94334ce4648ba5bbd70e77f412f" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:29.238473 10212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5d94334ce4648ba5bbd70e77f412f" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:29.238811 10137 raft_consensus.cc:3055] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:29.239159 10137 raft_consensus.cc:740] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:29.239890 10137 consensus_queue.cc:260] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.241029 10137 raft_consensus.cc:3060] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:29.239168 10212 raft_consensus.cc:3060] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:29.248010 10137 raft_consensus.cc:2468] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 2.
I20260709 13:03:29.248010 10212 raft_consensus.cc:2468] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 2.
I20260709 13:03:29.249262 10255 leader_election.cc:304] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:29.250825 10580 raft_consensus.cc:2804] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:29.251358 10580 raft_consensus.cc:697] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:29.252198 10580 consensus_queue.cc:237] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.250617 10038 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96: soft_deleted_table [id=1094f7132c6f45e6aad7078f465d195c] alter complete (version 1)
I20260709 13:03:29.261286 10038 catalog_manager.cc:5697] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 1 to 2, leader changed from e23799a9ec6848db8869919122abde42 (127.0.107.193) to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.558913 10509 raft_consensus.cc:993] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39: : Instructing follower d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:29.559352 10448 raft_consensus.cc:1081] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Signalling peer d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:29.560591 10287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:58810
I20260709 13:03:29.561074 10287 raft_consensus.cc:493] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:29.561401 10287 raft_consensus.cc:3060] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:29.566172 10287 raft_consensus.cc:515] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.567741 10287 leader_election.cc:290] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 3 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:29.568679 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:29.568411 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ac5d0a485a44a48e57a0c62d4d29ac" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:29.569516 10214 raft_consensus.cc:3055] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:29.569598 10137 raft_consensus.cc:3060] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:29.569824 10214 raft_consensus.cc:740] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:29.570665 10214 consensus_queue.cc:260] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.571763 10214 raft_consensus.cc:3060] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:29.571904 10509 raft_consensus.cc:993] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39: : Instructing follower d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:29.572433 10448 raft_consensus.cc:1081] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Signalling peer d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:29.573838 10287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:58810
I20260709 13:03:29.574383 10287 raft_consensus.cc:493] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:29.574762 10287 raft_consensus.cc:3060] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:29.576781 10565 raft_consensus.cc:993] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42: : Instructing follower d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:29.577364 10455 raft_consensus.cc:1081] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Signalling peer d0cbad478c6d47d19d9d3c2bec9ecb1c to start an election
I20260709 13:03:29.579434 10285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc"
dest_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c"
 from {username='slave'} at 127.0.0.1:58822
I20260709 13:03:29.580008 10285 raft_consensus.cc:493] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:29.580444 10285 raft_consensus.cc:3060] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:29.585912 10137 raft_consensus.cc:2468] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 3.
I20260709 13:03:29.587013 10214 raft_consensus.cc:2468] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 3.
I20260709 13:03:29.587100 10255 leader_election.cc:304] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, e23799a9ec6848db8869919122abde42; no voters: 
I20260709 13:03:29.588265 10580 raft_consensus.cc:2804] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:29.588724 10580 raft_consensus.cc:697] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:29.589504 10580 consensus_queue.cc:237] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.590482 10287 raft_consensus.cc:515] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.592782 10287 leader_election.cc:290] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 2 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:29.592696 10285 raft_consensus.cc:515] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.595135 10285 leader_election.cc:290] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 3 election: Requested vote from peers e23799a9ec6848db8869919122abde42 (127.0.107.193:42291), dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995)
I20260709 13:03:29.595654 10138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:29.610911 10138 raft_consensus.cc:3055] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:29.600677 10038 catalog_manager.cc:5697] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 2 to 3, leader changed from dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194) to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.611243 10138 raft_consensus.cc:740] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e23799a9ec6848db8869919122abde42, State: Running, Role: LEADER
I20260709 13:03:29.611994 10138 consensus_queue.cc:260] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.594717 10214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:29.594508 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbd94272e1d43f0b3babff434819669" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e23799a9ec6848db8869919122abde42"
I20260709 13:03:29.613133 10214 raft_consensus.cc:3055] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:29.613307 10137 raft_consensus.cc:3060] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:29.613473 10214 raft_consensus.cc:740] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcea1aa9581a44ba9b2b88c1fd4e6d39, State: Running, Role: LEADER
I20260709 13:03:29.614370 10214 consensus_queue.cc:260] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.615490 10214 raft_consensus.cc:3060] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:29.596728 10212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be98fc3e135c404996c5875017b2b8bc" candidate_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39"
I20260709 13:03:29.619300 10212 raft_consensus.cc:3060] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:29.621220 10214 raft_consensus.cc:2468] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 2.
I20260709 13:03:29.621946 10138 raft_consensus.cc:3060] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:29.622392 10255 leader_election.cc:304] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:29.623322 10580 raft_consensus.cc:2804] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:29.623821 10580 raft_consensus.cc:697] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:29.623931 10137 raft_consensus.cc:2468] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 2.
I20260709 13:03:29.624671 10580 consensus_queue.cc:237] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.625711 10212 raft_consensus.cc:2468] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 3.
I20260709 13:03:29.626839 10255 leader_election.cc:304] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0cbad478c6d47d19d9d3c2bec9ecb1c, dcea1aa9581a44ba9b2b88c1fd4e6d39; no voters: 
I20260709 13:03:29.627647 10580 raft_consensus.cc:2804] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:29.628186 10580 raft_consensus.cc:697] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 LEADER]: Becoming Leader. State: Replica: d0cbad478c6d47d19d9d3c2bec9ecb1c, State: Running, Role: LEADER
I20260709 13:03:29.628890 10580 consensus_queue.cc:237] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } }
I20260709 13:03:29.627658 10138 raft_consensus.cc:2468] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0cbad478c6d47d19d9d3c2bec9ecb1c in term 3.
I20260709 13:03:29.632366 10038 catalog_manager.cc:5697] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 1 to 2, leader changed from dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194) to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.644289 10038 catalog_manager.cc:5697] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c reported cstate change: term changed from 2 to 3, leader changed from e23799a9ec6848db8869919122abde42 (127.0.107.193) to d0cbad478c6d47d19d9d3c2bec9ecb1c (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0cbad478c6d47d19d9d3c2bec9ecb1c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.785465 10138 raft_consensus.cc:1275] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:29.786706 10580 consensus_queue.cc:1048] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:29.797119 10212 raft_consensus.cc:1275] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:29.798528 10588 consensus_queue.cc:1048] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:30.021804 10138 raft_consensus.cc:1275] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 3 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:30.023070 10588 consensus_queue.cc:1048] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:30.025157 10212 raft_consensus.cc:1275] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 3 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:30.027017 10588 consensus_queue.cc:1048] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:30.033684 10214 raft_consensus.cc:1275] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 3 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:30.035185 10588 consensus_queue.cc:1048] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:30.042342 10138 raft_consensus.cc:1275] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 3 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:30.043978 10593 consensus_queue.cc:1048] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:30.059254 10214 raft_consensus.cc:1275] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:30.060537 10593 consensus_queue.cc:1048] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcea1aa9581a44ba9b2b88c1fd4e6d39" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:30.067801 10138 raft_consensus.cc:1275] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Refusing update from remote peer d0cbad478c6d47d19d9d3c2bec9ecb1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:30.069444 10593 consensus_queue.cc:1048] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23799a9ec6848db8869919122abde42" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:30.273181   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:03:30.279624   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:03:30.279938   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:30.284384   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:03:30.284792   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:31.323172   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:31.353149   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:31.354049   431 tablet_replica.cc:333] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.355288   431 raft_consensus.cc:2243] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.356199   431 raft_consensus.cc:2272] T c6c6e16e99db430483f8223387e05756 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.360936   431 tablet_replica.cc:333] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.362205   431 raft_consensus.cc:2243] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.363545   431 raft_consensus.cc:2272] T 9d4248c5db9d44519763182f5198c24f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.367183   431 tablet_replica.cc:333] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.367972   431 raft_consensus.cc:2243] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.368878   431 raft_consensus.cc:2272] T bbebb793bacb455cb8ffb010370d5ed4 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.372066   431 tablet_replica.cc:333] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.372720   431 raft_consensus.cc:2243] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.373836   431 raft_consensus.cc:2272] T 3b7d0d52ca5f4afe943feea489c33281 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.376382   431 tablet_replica.cc:333] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.376950   431 raft_consensus.cc:2243] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.377867   431 raft_consensus.cc:2272] T af05560942434cd283af3936771f53e2 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.380833   431 tablet_replica.cc:333] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.381528   431 raft_consensus.cc:2243] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.382091   431 raft_consensus.cc:2272] T e97633190bbb4792821e9b0d837d5b89 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.384729   431 tablet_replica.cc:333] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.385453   431 raft_consensus.cc:2243] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.386855   431 raft_consensus.cc:2272] T fcdc68c737ef4db89d6f5db97318c4e4 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.387343 10181 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 13:03:31.390491   431 tablet_replica.cc:333] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42: stopping tablet replica
W20260709 13:03:31.390930 10181 consensus_peers.cc:597] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 -> Peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Couldn't send request to peer e23799a9ec6848db8869919122abde42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.391299   431 raft_consensus.cc:2243] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.391978   431 raft_consensus.cc:2272] T 96cbfd73a4d44a70b799f689a31a66f0 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.395591   431 tablet_replica.cc:333] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.396463   431 raft_consensus.cc:2243] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.397862   431 raft_consensus.cc:2272] T 1df83beac2984ad6806b47d864405481 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.400164   431 tablet_replica.cc:333] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.400748   431 raft_consensus.cc:2243] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.401377   431 raft_consensus.cc:2272] T fbbd94272e1d43f0b3babff434819669 P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.403851   431 tablet_replica.cc:333] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.404407   431 raft_consensus.cc:2243] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.405040   431 raft_consensus.cc:2272] T c4ac5d0a485a44a48e57a0c62d4d29ac P e23799a9ec6848db8869919122abde42 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.407500   431 tablet_replica.cc:333] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.408208   431 raft_consensus.cc:2243] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.408805   431 raft_consensus.cc:2272] T be98fc3e135c404996c5875017b2b8bc P e23799a9ec6848db8869919122abde42 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.411614   431 tablet_replica.cc:333] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.412539   431 raft_consensus.cc:2243] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.413276   431 raft_consensus.cc:2272] T 47f5d94334ce4648ba5bbd70e77f412f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.416441   431 tablet_replica.cc:333] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.416956   431 raft_consensus.cc:2243] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.418948   431 raft_consensus.cc:2272] T 5aa611a8fd5d4a6fa1478a1aa374166f P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.421983 10181 consensus_peers.cc:597] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 -> Peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Couldn't send request to peer e23799a9ec6848db8869919122abde42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.423302   431 tablet_replica.cc:333] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.423894   431 raft_consensus.cc:2243] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.425125   431 raft_consensus.cc:2272] T e279e6629ead480f949ba07a71d0db3d P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.427543   431 tablet_replica.cc:333] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.428016   431 raft_consensus.cc:2243] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.429153   431 raft_consensus.cc:2272] T 353f0591a3d84639bed4b8625d66e1dd P e23799a9ec6848db8869919122abde42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.431452   431 tablet_replica.cc:333] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.431912   431 raft_consensus.cc:2243] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.432392   431 raft_consensus.cc:2272] T e057094087fc4a17b1bf35eec9526373 P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.434746   431 tablet_replica.cc:333] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42: stopping tablet replica
I20260709 13:03:31.435197   431 raft_consensus.cc:2243] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.435603   431 raft_consensus.cc:2272] T 2c24bf92377c400982f46c56a1b2756c P e23799a9ec6848db8869919122abde42 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.441931 10255 consensus_peers.cc:597] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c -> Peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Couldn't send request to peer e23799a9ec6848db8869919122abde42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.484767   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:31.516987 10255 consensus_peers.cc:597] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c -> Peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Couldn't send request to peer e23799a9ec6848db8869919122abde42. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.533799   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:31.539649 10255 consensus_peers.cc:597] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c -> Peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Couldn't send request to peer e23799a9ec6848db8869919122abde42. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.563858   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:31.564723   431 tablet_replica.cc:333] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.565491   431 raft_consensus.cc:2243] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.566406   431 raft_consensus.cc:2272] T bbebb793bacb455cb8ffb010370d5ed4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.570048   431 tablet_replica.cc:333] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.570833   431 raft_consensus.cc:2243] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.572118   431 raft_consensus.cc:2272] T c6c6e16e99db430483f8223387e05756 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.572686 10255 consensus_peers.cc:597] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c -> Peer dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995): Couldn't send request to peer dcea1aa9581a44ba9b2b88c1fd4e6d39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.574793   431 tablet_replica.cc:333] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.575408   431 raft_consensus.cc:2243] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.576336   431 raft_consensus.cc:2272] T 9d4248c5db9d44519763182f5198c24f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.578510   431 tablet_replica.cc:333] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.579097   431 raft_consensus.cc:2243] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.579559   431 raft_consensus.cc:2272] T af05560942434cd283af3936771f53e2 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.581614   431 tablet_replica.cc:333] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.582156   431 raft_consensus.cc:2243] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.582609   431 raft_consensus.cc:2272] T 3b7d0d52ca5f4afe943feea489c33281 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.584764   431 tablet_replica.cc:333] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.585299   431 raft_consensus.cc:2243] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.585723   431 raft_consensus.cc:2272] T e97633190bbb4792821e9b0d837d5b89 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.587829   431 tablet_replica.cc:333] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.588313   431 raft_consensus.cc:2243] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.589320   431 raft_consensus.cc:2272] T 2c24bf92377c400982f46c56a1b2756c P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.591415   431 tablet_replica.cc:333] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.591910   431 raft_consensus.cc:2243] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.592344   431 raft_consensus.cc:2272] T 5aa611a8fd5d4a6fa1478a1aa374166f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.594475   431 tablet_replica.cc:333] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.595008   431 raft_consensus.cc:2243] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.595398   431 raft_consensus.cc:2272] T fbbd94272e1d43f0b3babff434819669 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.597383   431 tablet_replica.cc:333] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.597862   431 raft_consensus.cc:2243] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.598260   431 raft_consensus.cc:2272] T c4ac5d0a485a44a48e57a0c62d4d29ac P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.600261   431 tablet_replica.cc:333] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.600726   431 raft_consensus.cc:2243] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.601364   431 raft_consensus.cc:2272] T be98fc3e135c404996c5875017b2b8bc P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.603477   431 tablet_replica.cc:333] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.603941   431 raft_consensus.cc:2243] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.604409   431 raft_consensus.cc:2272] T 47f5d94334ce4648ba5bbd70e77f412f P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.606477   431 tablet_replica.cc:333] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.606997   431 raft_consensus.cc:2243] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.607453   431 raft_consensus.cc:2272] T e279e6629ead480f949ba07a71d0db3d P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.609616   431 tablet_replica.cc:333] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.610025   431 raft_consensus.cc:2243] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.611454   431 raft_consensus.cc:2272] T e057094087fc4a17b1bf35eec9526373 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.614279   431 tablet_replica.cc:333] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.614943   431 raft_consensus.cc:2243] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.615625   431 raft_consensus.cc:2272] T 353f0591a3d84639bed4b8625d66e1dd P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.615765 10255 consensus_peers.cc:597] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c -> Peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Couldn't send request to peer e23799a9ec6848db8869919122abde42. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.618070   431 tablet_replica.cc:333] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.618721   431 raft_consensus.cc:2243] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.619238   431 raft_consensus.cc:2272] T fcdc68c737ef4db89d6f5db97318c4e4 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.621450   431 tablet_replica.cc:333] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.621937   431 raft_consensus.cc:2243] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.622872   431 raft_consensus.cc:2272] T 96cbfd73a4d44a70b799f689a31a66f0 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.624986   431 tablet_replica.cc:333] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39: stopping tablet replica
I20260709 13:03:31.625485   431 raft_consensus.cc:2243] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.625959   431 raft_consensus.cc:2272] T 1df83beac2984ad6806b47d864405481 P dcea1aa9581a44ba9b2b88c1fd4e6d39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.669150   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:31.706997   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:31.713328 10255 consensus_peers.cc:597] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c -> Peer e23799a9ec6848db8869919122abde42 (127.0.107.193:42291): Couldn't send request to peer e23799a9ec6848db8869919122abde42. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.739724   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:31.740774   431 tablet_replica.cc:333] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.741873   431 raft_consensus.cc:2243] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.742471   431 raft_consensus.cc:2272] T bbebb793bacb455cb8ffb010370d5ed4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.743950 10255 consensus_peers.cc:597] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c -> Peer dcea1aa9581a44ba9b2b88c1fd4e6d39 (127.0.107.194:41995): Couldn't send request to peer dcea1aa9581a44ba9b2b88c1fd4e6d39. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.745038   431 tablet_replica.cc:333] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.745755   431 raft_consensus.cc:2243] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.746248   431 raft_consensus.cc:2272] T 9d4248c5db9d44519763182f5198c24f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.748397   431 tablet_replica.cc:333] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.748984   431 raft_consensus.cc:2243] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.749493   431 raft_consensus.cc:2272] T e279e6629ead480f949ba07a71d0db3d P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.751722   431 tablet_replica.cc:333] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.752345   431 raft_consensus.cc:2243] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.752827   431 raft_consensus.cc:2272] T 3b7d0d52ca5f4afe943feea489c33281 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.754971   431 tablet_replica.cc:333] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.755529   431 raft_consensus.cc:2243] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.756453   431 raft_consensus.cc:2272] T e97633190bbb4792821e9b0d837d5b89 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.758483   431 tablet_replica.cc:333] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.759016   431 raft_consensus.cc:2243] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.759796   431 raft_consensus.cc:2272] T af05560942434cd283af3936771f53e2 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.761706   431 tablet_replica.cc:333] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.762245   431 raft_consensus.cc:2243] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.762738   431 raft_consensus.cc:2272] T 2c24bf92377c400982f46c56a1b2756c P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.764699   431 tablet_replica.cc:333] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.765195   431 raft_consensus.cc:2243] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.765725   431 raft_consensus.cc:2272] T c6c6e16e99db430483f8223387e05756 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.768015   431 tablet_replica.cc:333] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.768699   431 raft_consensus.cc:2243] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.769455   431 raft_consensus.cc:2272] T fbbd94272e1d43f0b3babff434819669 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.771345   431 tablet_replica.cc:333] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.771776   431 raft_consensus.cc:2243] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.772501   431 raft_consensus.cc:2272] T c4ac5d0a485a44a48e57a0c62d4d29ac P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.774333   431 tablet_replica.cc:333] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.774756   431 raft_consensus.cc:2243] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.775555   431 raft_consensus.cc:2272] T be98fc3e135c404996c5875017b2b8bc P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.777603   431 tablet_replica.cc:333] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.778066   431 raft_consensus.cc:2243] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.778831   431 raft_consensus.cc:2272] T 47f5d94334ce4648ba5bbd70e77f412f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.780942   431 tablet_replica.cc:333] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.781405   431 raft_consensus.cc:2243] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.781860   431 raft_consensus.cc:2272] T 353f0591a3d84639bed4b8625d66e1dd P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.783870   431 tablet_replica.cc:333] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.784308   431 raft_consensus.cc:2243] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.784705   431 raft_consensus.cc:2272] T e057094087fc4a17b1bf35eec9526373 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.786654   431 tablet_replica.cc:333] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.787112   431 raft_consensus.cc:2243] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.787568   431 raft_consensus.cc:2272] T 5aa611a8fd5d4a6fa1478a1aa374166f P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.789583   431 tablet_replica.cc:333] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.790098   431 raft_consensus.cc:2243] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.790488   431 raft_consensus.cc:2272] T fcdc68c737ef4db89d6f5db97318c4e4 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.792446   431 tablet_replica.cc:333] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.792904   431 raft_consensus.cc:2243] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.793316   431 raft_consensus.cc:2272] T 96cbfd73a4d44a70b799f689a31a66f0 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.795255   431 tablet_replica.cc:333] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c: stopping tablet replica
I20260709 13:03:31.795624   431 raft_consensus.cc:2243] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.796011   431 raft_consensus.cc:2272] T 1df83beac2984ad6806b47d864405481 P d0cbad478c6d47d19d9d3c2bec9ecb1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.837782   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:31.873936   431 master.cc:562] Master@127.0.107.254:43545 shutting down...
I20260709 13:03:31.904088   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.904742   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.905114   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8cef729add4f456cb0da53efd2266e96: stopping tablet replica
I20260709 13:03:31.925745   431 master.cc:584] Master@127.0.107.254:43545 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12484 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:03:31.978214   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37585
I20260709 13:03:31.979337   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:31.984980 10602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:31.985106 10603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:31.985850 10605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:31.986189   431 server_base.cc:1061] running on GCE node
I20260709 13:03:31.987144   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:31.987317   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:31.987426   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602211987416 us; error 0 us; skew 500 ppm
I20260709 13:03:31.987929   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:31.990155   431 webserver.cc:533] Webserver started at http://127.0.107.254:42417/ using document root <none> and password file <none>
I20260709 13:03:31.990577   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:31.990787   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:31.991014   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:31.992064   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/master-0-root/instance:
uuid: "e4c000169d56480486a985486ee02c5c"
format_stamp: "Formatted at 2026-07-09 13:03:31 on dist-test-slave-szgt"
I20260709 13:03:31.996232   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:03:31.999282 10610 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:31.999954   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:32.000229   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/master-0-root
uuid: "e4c000169d56480486a985486ee02c5c"
format_stamp: "Formatted at 2026-07-09 13:03:31 on dist-test-slave-szgt"
I20260709 13:03:32.000528   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:32.014492   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:32.015645   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:32.052402   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37585
I20260709 13:03:32.052510 10661 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37585 every 8 connection(s)
I20260709 13:03:32.056254 10662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.067138 10662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c: Bootstrap starting.
I20260709 13:03:32.071990 10662 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.076282 10662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c: No bootstrap required, opened a new log
I20260709 13:03:32.078612 10662 raft_consensus.cc:359] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c000169d56480486a985486ee02c5c" member_type: VOTER }
I20260709 13:03:32.079118 10662 raft_consensus.cc:385] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.079342 10662 raft_consensus.cc:740] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c000169d56480486a985486ee02c5c, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.080050 10662 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c000169d56480486a985486ee02c5c" member_type: VOTER }
I20260709 13:03:32.080572 10662 raft_consensus.cc:399] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:32.080817 10662 raft_consensus.cc:493] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:32.081107 10662 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.085691 10662 raft_consensus.cc:515] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c000169d56480486a985486ee02c5c" member_type: VOTER }
I20260709 13:03:32.086194 10662 leader_election.cc:304] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4c000169d56480486a985486ee02c5c; no voters: 
I20260709 13:03:32.087289 10662 leader_election.cc:290] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:32.087633 10665 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:32.089098 10665 raft_consensus.cc:697] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 1 LEADER]: Becoming Leader. State: Replica: e4c000169d56480486a985486ee02c5c, State: Running, Role: LEADER
I20260709 13:03:32.089767 10665 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c000169d56480486a985486ee02c5c" member_type: VOTER }
I20260709 13:03:32.090278 10662 sys_catalog.cc:565] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:32.094628 10667 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4c000169d56480486a985486ee02c5c. Latest consensus state: current_term: 1 leader_uuid: "e4c000169d56480486a985486ee02c5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c000169d56480486a985486ee02c5c" member_type: VOTER } }
I20260709 13:03:32.095640 10667 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:32.094553 10666 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4c000169d56480486a985486ee02c5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c000169d56480486a985486ee02c5c" member_type: VOTER } }
I20260709 13:03:32.097424 10666 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:32.101917 10673 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:32.107815 10673 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:32.109622   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:32.116510 10673 catalog_manager.cc:1383] Generated new cluster ID: 9747449d0d654a87b5dfe749b5dc1a12
I20260709 13:03:32.116760 10673 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:32.130513 10673 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:32.131784 10673 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:32.143184 10673 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c: Generated new TSK 0
I20260709 13:03:32.143759 10673 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:32.175886   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:32.182282 10683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.183974 10684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.185796 10686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:32.185839   431 server_base.cc:1061] running on GCE node
I20260709 13:03:32.186961   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:32.187157   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:32.187342   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602212187322 us; error 0 us; skew 500 ppm
I20260709 13:03:32.187865   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:32.190147   431 webserver.cc:533] Webserver started at http://127.0.107.193:39217/ using document root <none> and password file <none>
I20260709 13:03:32.190614   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:32.190831   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:32.191047   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:32.192096   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-0-root/instance:
uuid: "5ec16e68839f47c38eefc730712b7c96"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-szgt"
I20260709 13:03:32.196274   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:32.199317 10691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.200026   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:32.200333   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-0-root
uuid: "5ec16e68839f47c38eefc730712b7c96"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-szgt"
I20260709 13:03:32.200584   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:32.219460   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:32.220709   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:32.222110   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:32.224385   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:32.224598   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.224838   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:32.225033   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.263167   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43801
I20260709 13:03:32.263258 10753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43801 every 8 connection(s)
I20260709 13:03:32.268154   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:32.275132 10758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.276196 10759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.279310 10761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:32.280696   431 server_base.cc:1061] running on GCE node
I20260709 13:03:32.281942   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:32.282204   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:32.282392   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602212282378 us; error 0 us; skew 500 ppm
I20260709 13:03:32.283020   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:32.285354   431 webserver.cc:533] Webserver started at http://127.0.107.194:34765/ using document root <none> and password file <none>
I20260709 13:03:32.285897   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:32.286088   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:32.286418   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:32.287882   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-1-root/instance:
uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-szgt"
I20260709 13:03:32.288669 10754 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37585
I20260709 13:03:32.289116 10754 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:32.289999 10754 heartbeater.cc:507] Master 127.0.107.254:37585 requested a full tablet report, sending...
I20260709 13:03:32.292311 10627 ts_manager.cc:194] Registered new tserver with Master: 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801)
I20260709 13:03:32.293279   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:03:32.294150 10627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33926
I20260709 13:03:32.297036 10766 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.297823   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:32.298113   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-1-root
uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-szgt"
I20260709 13:03:32.298393   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:32.309584   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:32.310803   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:32.312176   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:32.314363   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:32.314580   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.314862   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:32.315044   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.353788   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45593
I20260709 13:03:32.353896 10828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45593 every 8 connection(s)
I20260709 13:03:32.358517   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:32.365381 10832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.366343 10833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.369856 10835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:32.370316   431 server_base.cc:1061] running on GCE node
I20260709 13:03:32.370904 10829 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37585
I20260709 13:03:32.371349 10829 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:32.371461   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:32.371767   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:32.371969   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602212371949 us; error 0 us; skew 500 ppm
I20260709 13:03:32.372227 10829 heartbeater.cc:507] Master 127.0.107.254:37585 requested a full tablet report, sending...
I20260709 13:03:32.372789   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:32.374511 10627 ts_manager.cc:194] Registered new tserver with Master: fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:32.375546   431 webserver.cc:533] Webserver started at http://127.0.107.195:37499/ using document root <none> and password file <none>
I20260709 13:03:32.376209   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:32.376456   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:32.376405 10627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33942
I20260709 13:03:32.377039   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:32.378559   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-2-root/instance:
uuid: "ec424be61499475db7217e8842759609"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-szgt"
I20260709 13:03:32.382910   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:32.386021 10840 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.386786   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:32.387027   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-2-root
uuid: "ec424be61499475db7217e8842759609"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-szgt"
I20260709 13:03:32.387245   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknjpBse/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601902018772-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:32.426573   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:32.427779   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:32.429172   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:32.431321   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:32.431555   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.431793   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:32.431969   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.472430   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35161
I20260709 13:03:32.472528 10902 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35161 every 8 connection(s)
I20260709 13:03:32.485738 10903 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37585
I20260709 13:03:32.486145 10903 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:32.486874 10903 heartbeater.cc:507] Master 127.0.107.254:37585 requested a full tablet report, sending...
I20260709 13:03:32.488626 10627 ts_manager.cc:194] Registered new tserver with Master: ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:32.489001   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013335414s
I20260709 13:03:32.490499 10627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33958
I20260709 13:03:32.513881 10627 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33964:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:32.516605 10627 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:32.583706 10794 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1ee054575f49a382f11ad9b5b7647b (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:32.585216 10794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1ee054575f49a382f11ad9b5b7647b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.589507 10793 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba95b0ae3a44536bf292beca934fffe (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:32.591464 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba95b0ae3a44536bf292beca934fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.600515 10718 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba95b0ae3a44536bf292beca934fffe (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:32.602723 10718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba95b0ae3a44536bf292beca934fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.603770 10719 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1ee054575f49a382f11ad9b5b7647b (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:32.606443 10719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1ee054575f49a382f11ad9b5b7647b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.609141 10717 tablet_service.cc:1511] Processing CreateTablet for tablet 4ede29f0e5414131b44056468158fd15 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:32.609354 10868 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1ee054575f49a382f11ad9b5b7647b (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:32.610069 10867 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba95b0ae3a44536bf292beca934fffe (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:32.610786 10868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1ee054575f49a382f11ad9b5b7647b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.611431 10867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba95b0ae3a44536bf292beca934fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.610455 10717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ede29f0e5414131b44056468158fd15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.614693 10792 tablet_service.cc:1511] Processing CreateTablet for tablet 4ede29f0e5414131b44056468158fd15 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:32.615592 10716 tablet_service.cc:1511] Processing CreateTablet for tablet 97bf4a1578b245d0b12586d8313c428c (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:32.615993 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ede29f0e5414131b44056468158fd15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.617158 10791 tablet_service.cc:1511] Processing CreateTablet for tablet 97bf4a1578b245d0b12586d8313c428c (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:32.619159 10716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bf4a1578b245d0b12586d8313c428c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.619726 10791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bf4a1578b245d0b12586d8313c428c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.639338 10715 tablet_service.cc:1511] Processing CreateTablet for tablet 81a44e0477fe43b0bee6903f79c01141 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:32.640796 10715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a44e0477fe43b0bee6903f79c01141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.652674 10866 tablet_service.cc:1511] Processing CreateTablet for tablet 4ede29f0e5414131b44056468158fd15 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:32.654064 10866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ede29f0e5414131b44056468158fd15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.659667 10792 tablet_service.cc:1511] Processing CreateTablet for tablet 81a44e0477fe43b0bee6903f79c01141 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:32.661160 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a44e0477fe43b0bee6903f79c01141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.661783 10918 tablet_bootstrap.cc:492] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:32.670277 10918 tablet_bootstrap.cc:654] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.669975 10714 tablet_service.cc:1511] Processing CreateTablet for tablet c616781e3e9d4730884eff5393860171 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:32.674417 10714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c616781e3e9d4730884eff5393860171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.676625 10865 tablet_service.cc:1511] Processing CreateTablet for tablet 97bf4a1578b245d0b12586d8313c428c (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:32.678018 10865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bf4a1578b245d0b12586d8313c428c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.685168 10794 tablet_service.cc:1511] Processing CreateTablet for tablet c616781e3e9d4730884eff5393860171 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:32.686487 10794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c616781e3e9d4730884eff5393860171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.690135 10867 tablet_service.cc:1511] Processing CreateTablet for tablet c616781e3e9d4730884eff5393860171 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:32.691258 10864 tablet_service.cc:1511] Processing CreateTablet for tablet 81a44e0477fe43b0bee6903f79c01141 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:32.693807 10918 tablet_bootstrap.cc:492] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:32.715243 10918 ts_tablet_manager.cc:1403] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.054s	user 0.000s	sys 0.021s
I20260709 13:03:32.715644 10864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a44e0477fe43b0bee6903f79c01141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.718495 10918 raft_consensus.cc:359] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.699386 10713 tablet_service.cc:1511] Processing CreateTablet for tablet fca0492e8d6b4f9d8222c92a0e604901 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:32.720427 10713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca0492e8d6b4f9d8222c92a0e604901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.723388 10714 tablet_service.cc:1511] Processing CreateTablet for tablet 09c9bb6fbe7849b19c4618982ffec63f (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:32.724705 10794 tablet_service.cc:1511] Processing CreateTablet for tablet 09c9bb6fbe7849b19c4618982ffec63f (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:32.725961 10794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c9bb6fbe7849b19c4618982ffec63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.708247 10793 tablet_service.cc:1511] Processing CreateTablet for tablet fca0492e8d6b4f9d8222c92a0e604901 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:32.726970 10867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c616781e3e9d4730884eff5393860171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.727391 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca0492e8d6b4f9d8222c92a0e604901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.710816 10865 tablet_service.cc:1511] Processing CreateTablet for tablet fca0492e8d6b4f9d8222c92a0e604901 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:32.724694 10714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c9bb6fbe7849b19c4618982ffec63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.729851 10865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca0492e8d6b4f9d8222c92a0e604901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.719298 10918 raft_consensus.cc:385] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.733222 10918 raft_consensus.cc:740] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.734598 10863 tablet_service.cc:1511] Processing CreateTablet for tablet 09c9bb6fbe7849b19c4618982ffec63f (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:32.736368 10863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c9bb6fbe7849b19c4618982ffec63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.736029 10918 consensus_queue.cc:260] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.751871 10791 tablet_service.cc:1511] Processing CreateTablet for tablet 3966b43f418e499e9e0b614f4d681720 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:32.753831 10862 tablet_service.cc:1511] Processing CreateTablet for tablet 3966b43f418e499e9e0b614f4d681720 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:32.760390 10791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3966b43f418e499e9e0b614f4d681720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.760879 10862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3966b43f418e499e9e0b614f4d681720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.750604 10715 tablet_service.cc:1511] Processing CreateTablet for tablet 3966b43f418e499e9e0b614f4d681720 (DEFAULT_TABLE table=test-workload [id=a19e2e0f7c9e4744a65d40055cdac45d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:32.780252 10715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3966b43f418e499e9e0b614f4d681720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.802371 10919 tablet_bootstrap.cc:492] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:32.807466 10921 tablet_bootstrap.cc:492] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:32.811369 10919 tablet_bootstrap.cc:654] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.813617 10921 tablet_bootstrap.cc:654] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.818866 10829 heartbeater.cc:499] Master 127.0.107.254:37585 was elected leader, sending a full tablet report...
I20260709 13:03:32.823755 10918 ts_tablet_manager.cc:1434] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.108s	user 0.020s	sys 0.016s
I20260709 13:03:32.824745 10918 tablet_bootstrap.cc:492] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:32.845350 10918 tablet_bootstrap.cc:654] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.852231 10918 tablet_bootstrap.cc:492] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:32.852743 10918 ts_tablet_manager.cc:1403] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:03:32.855574 10918 raft_consensus.cc:359] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.856591 10918 raft_consensus.cc:385] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.856997 10918 raft_consensus.cc:740] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.857771 10918 consensus_queue.cc:260] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.858876 10919 tablet_bootstrap.cc:492] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:32.859400 10919 ts_tablet_manager.cc:1403] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.008s
I20260709 13:03:32.861783 10921 tablet_bootstrap.cc:492] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:32.862298 10921 ts_tablet_manager.cc:1403] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.020s
I20260709 13:03:32.862746 10919 raft_consensus.cc:359] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.863507 10919 raft_consensus.cc:385] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.863806 10919 raft_consensus.cc:740] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.864171 10918 ts_tablet_manager.cc:1434] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:03:32.864647 10919 consensus_queue.cc:260] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.865198 10918 tablet_bootstrap.cc:492] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:32.865171 10921 raft_consensus.cc:359] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.866020 10921 raft_consensus.cc:385] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.866335 10921 raft_consensus.cc:740] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.867093 10921 consensus_queue.cc:260] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.873148 10903 heartbeater.cc:499] Master 127.0.107.254:37585 was elected leader, sending a full tablet report...
I20260709 13:03:32.873497 10918 tablet_bootstrap.cc:654] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.874213 10919 ts_tablet_manager.cc:1434] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 13:03:32.875264 10919 tablet_bootstrap.cc:492] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:32.883662 10919 tablet_bootstrap.cc:654] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.888952 10918 tablet_bootstrap.cc:492] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:32.889761 10918 ts_tablet_manager.cc:1403] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 13:03:32.893378 10918 raft_consensus.cc:359] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.894094 10918 raft_consensus.cc:385] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.894497 10918 raft_consensus.cc:740] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.895491 10918 consensus_queue.cc:260] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.897737 10918 ts_tablet_manager.cc:1434] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:03:32.898205 10919 tablet_bootstrap.cc:492] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:32.898792 10919 ts_tablet_manager.cc:1403] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 13:03:32.899164 10918 tablet_bootstrap.cc:492] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:32.902048 10919 raft_consensus.cc:359] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.902794 10919 raft_consensus.cc:385] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.903110 10919 raft_consensus.cc:740] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.903997 10919 consensus_queue.cc:260] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.906373 10919 ts_tablet_manager.cc:1434] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:03:32.906859 10918 tablet_bootstrap.cc:654] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.907371 10919 tablet_bootstrap.cc:492] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:32.916045 10919 tablet_bootstrap.cc:654] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.922631 10918 tablet_bootstrap.cc:492] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:32.923297 10918 ts_tablet_manager.cc:1403] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.011s
I20260709 13:03:32.925374 10919 tablet_bootstrap.cc:492] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:32.925918 10919 ts_tablet_manager.cc:1403] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:03:32.926355 10918 raft_consensus.cc:359] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.927217 10918 raft_consensus.cc:385] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.927565 10918 raft_consensus.cc:740] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.928412 10918 consensus_queue.cc:260] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.929246 10919 raft_consensus.cc:359] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.929987 10919 raft_consensus.cc:385] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.930295 10919 raft_consensus.cc:740] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.931074 10918 ts_tablet_manager.cc:1434] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:32.931166 10919 consensus_queue.cc:260] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.932374 10918 tablet_bootstrap.cc:492] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:32.933708 10919 ts_tablet_manager.cc:1434] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:32.934777 10919 tablet_bootstrap.cc:492] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:32.939569 10918 tablet_bootstrap.cc:654] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.940274 10926 raft_consensus.cc:493] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.940819 10926 raft_consensus.cc:515] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.949560 10754 heartbeater.cc:499] Master 127.0.107.254:37585 was elected leader, sending a full tablet report...
I20260709 13:03:32.950165 10921 ts_tablet_manager.cc:1434] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.088s	user 0.032s	sys 0.056s
I20260709 13:03:32.951150 10921 tablet_bootstrap.cc:492] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:32.951699 10918 tablet_bootstrap.cc:492] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:32.952307 10918 ts_tablet_manager.cc:1403] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:03:32.955224 10918 raft_consensus.cc:359] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.955911 10918 raft_consensus.cc:385] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.956249 10918 raft_consensus.cc:740] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.957412 10921 tablet_bootstrap.cc:654] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.957067 10918 consensus_queue.cc:260] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.959450 10918 ts_tablet_manager.cc:1434] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:32.960532 10918 tablet_bootstrap.cc:492] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:32.960947 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba95b0ae3a44536bf292beca934fffe" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:32.961710 10804 raft_consensus.cc:2468] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 0.
I20260709 13:03:32.963106 10842 leader_election.cc:304] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:32.964908 10926 leader_election.cc:290] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:32.965468 10926 raft_consensus.cc:2804] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:32.965821 10926 raft_consensus.cc:493] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.966147 10926 raft_consensus.cc:3060] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.967116 10918 tablet_bootstrap.cc:654] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.969944 10921 tablet_bootstrap.cc:492] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:32.970549 10921 ts_tablet_manager.cc:1403] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.012s
I20260709 13:03:32.973552 10921 raft_consensus.cc:359] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.974195 10921 raft_consensus.cc:385] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.974478 10921 raft_consensus.cc:740] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.975425 10919 tablet_bootstrap.cc:654] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.975353 10921 consensus_queue.cc:260] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.977752 10921 ts_tablet_manager.cc:1434] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:32.978703 10921 tablet_bootstrap.cc:492] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:32.982170 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba95b0ae3a44536bf292beca934fffe" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
W20260709 13:03:32.983947 10844 leader_election.cc:343] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:32.984812 10921 tablet_bootstrap.cc:654] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.994560 10919 tablet_bootstrap.cc:492] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:32.995271 10919 ts_tablet_manager.cc:1403] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.006s
I20260709 13:03:32.996366 10921 tablet_bootstrap.cc:492] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:32.996904 10921 ts_tablet_manager.cc:1403] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:03:32.999219 10919 raft_consensus.cc:359] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.999857 10921 raft_consensus.cc:359] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:32.990199 10926 raft_consensus.cc:515] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.000598 10919 raft_consensus.cc:385] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.004386 10921 raft_consensus.cc:385] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.004779 10919 raft_consensus.cc:740] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.004837 10921 raft_consensus.cc:740] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.008435 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba95b0ae3a44536bf292beca934fffe" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:33.008224 10921 consensus_queue.cc:260] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.009553 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba95b0ae3a44536bf292beca934fffe" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:33.010144 10804 raft_consensus.cc:3060] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:33.010471 10844 leader_election.cc:343] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.008482 10918 tablet_bootstrap.cc:492] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:33.011514 10918 ts_tablet_manager.cc:1403] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.018s
I20260709 13:03:33.011986 10921 ts_tablet_manager.cc:1434] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.002s
I20260709 13:03:33.013411 10921 tablet_bootstrap.cc:492] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:33.014413 10918 raft_consensus.cc:359] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.015157 10918 raft_consensus.cc:385] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.015455 10918 raft_consensus.cc:740] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.016183 10918 consensus_queue.cc:260] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.018410 10918 ts_tablet_manager.cc:1434] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:03:33.008615 10919 consensus_queue.cc:260] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.019985 10921 tablet_bootstrap.cc:654] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.020982 10919 ts_tablet_manager.cc:1434] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:03:33.022032 10919 tablet_bootstrap.cc:492] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:33.035368 10919 tablet_bootstrap.cc:654] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.031405 10921 tablet_bootstrap.cc:492] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:33.028314 10918 tablet_bootstrap.cc:492] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:33.036664 10921 ts_tablet_manager.cc:1403] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:03:33.008656 10926 leader_election.cc:290] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:33.035310 10804 raft_consensus.cc:2468] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 1.
I20260709 13:03:33.038168 10842 leader_election.cc:304] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:33.039306 10926 raft_consensus.cc:2804] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.039865 10921 raft_consensus.cc:359] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.040477 10926 raft_consensus.cc:697] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 1 LEADER]: Becoming Leader. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:33.040643 10921 raft_consensus.cc:385] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.041100 10921 raft_consensus.cc:740] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.041522 10926 consensus_queue.cc:237] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.042070 10921 consensus_queue.cc:260] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.042948 10922 raft_consensus.cc:493] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.043407 10922 raft_consensus.cc:515] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.044566 10921 ts_tablet_manager.cc:1434] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:33.045516 10918 tablet_bootstrap.cc:654] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.045580 10921 tablet_bootstrap.cc:492] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:33.051388 10922 leader_election.cc:290] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.056747 10921 tablet_bootstrap.cc:654] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.066602 10935 raft_consensus.cc:493] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.067294 10935 raft_consensus.cc:515] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.071300 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede29f0e5414131b44056468158fd15" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.071962 10935 leader_election.cc:290] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801)
I20260709 13:03:33.072372 10922 raft_consensus.cc:493] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.072963 10922 raft_consensus.cc:515] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.074143 10919 tablet_bootstrap.cc:492] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:33.074285 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:33.074954 10919 ts_tablet_manager.cc:1403] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.011s
I20260709 13:03:33.075485 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:33.076130 10804 raft_consensus.cc:2468] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 0.
I20260709 13:03:33.076390 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.077045 10877 raft_consensus.cc:2468] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:33.077607 10842 leader_election.cc:304] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.072245 10878 raft_consensus.cc:2468] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:33.074985 10922 leader_election.cc:290] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.079138 10935 raft_consensus.cc:2804] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.079509 10935 raft_consensus.cc:493] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.079859 10935 raft_consensus.cc:3060] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.080333 10918 tablet_bootstrap.cc:492] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:33.080920 10918 ts_tablet_manager.cc:1403] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.004s
I20260709 13:03:33.075114 10729 raft_consensus.cc:2468] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 0.
I20260709 13:03:33.078519 10767 leader_election.cc:304] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.085738 10922 raft_consensus.cc:2804] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.086221 10922 raft_consensus.cc:493] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.086634 10922 raft_consensus.cc:3060] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.089700 10767 leader_election.cc:304] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.084882 10918 raft_consensus.cc:359] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.087616 10919 raft_consensus.cc:359] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.092170 10918 raft_consensus.cc:385] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.092463 10919 raft_consensus.cc:385] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.097904 10927 raft_consensus.cc:493] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.097317 10919 raft_consensus.cc:740] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.098663 10927 raft_consensus.cc:515] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.101933 10927 leader_election.cc:290] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
W20260709 13:03:33.105654 10675 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:33.103964 10919 consensus_queue.cc:260] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.115355 10918 raft_consensus.cc:740] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.119436 10918 consensus_queue.cc:260] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.122005 10950 raft_consensus.cc:2804] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.122473 10950 raft_consensus.cc:493] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.122818 10918 ts_tablet_manager.cc:1434] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.001s
I20260709 13:03:33.122902 10950 raft_consensus.cc:3060] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.140014 10946 raft_consensus.cc:493] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.139710 10625 catalog_manager.cc:5697] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec424be61499475db7217e8842759609 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ec424be61499475db7217e8842759609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.140540 10946 raft_consensus.cc:515] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.141180 10921 tablet_bootstrap.cc:492] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:33.141688 10921 ts_tablet_manager.cc:1403] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.026s
I20260709 13:03:33.145781 10918 tablet_bootstrap.cc:492] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:33.148535 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede29f0e5414131b44056468158fd15" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:33.148571 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a44e0477fe43b0bee6903f79c01141" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:33.149428 10804 raft_consensus.cc:2468] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:33.149914 10919 ts_tablet_manager.cc:1434] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.002s
I20260709 13:03:33.150102 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:33.150851 10728 raft_consensus.cc:2468] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:33.151037 10919 tablet_bootstrap.cc:492] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:33.151962 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:33.152599 10727 raft_consensus.cc:2468] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:33.152685 10918 tablet_bootstrap.cc:654] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.152796 10935 raft_consensus.cc:515] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
W20260709 13:03:33.154069 10770 leader_election.cc:343] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.151003 10693 leader_election.cc:304] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.155593 10927 raft_consensus.cc:2804] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.156010 10927 raft_consensus.cc:493] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.156430 10927 raft_consensus.cc:3060] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.156059 10921 raft_consensus.cc:359] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.156826 10921 raft_consensus.cc:385] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.157117 10921 raft_consensus.cc:740] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.155503 10770 leader_election.cc:304] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.157967 10922 raft_consensus.cc:515] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.159483 10946 leader_election.cc:290] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.159919 10949 raft_consensus.cc:2804] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.160526 10922 leader_election.cc:290] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.163030 10935 leader_election.cc:290] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801)
I20260709 13:03:33.163609 10921 consensus_queue.cc:260] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.164073 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:33.160444 10949 raft_consensus.cc:493] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.165858 10949 raft_consensus.cc:3060] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.164635 10727 raft_consensus.cc:3060] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.171836 10919 tablet_bootstrap.cc:654] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.172662 10927 raft_consensus.cc:515] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
W20260709 13:03:33.137917 10767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35161, user_credentials={real_user=slave}} blocked reactor thread for 48348.1us
I20260709 13:03:33.177942 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a44e0477fe43b0bee6903f79c01141" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:33.178594 10804 raft_consensus.cc:3060] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.178959 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.179738 10878 raft_consensus.cc:2468] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:33.169992 10950 raft_consensus.cc:515] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.176427 10927 leader_election.cc:290] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.184868 10950 leader_election.cc:290] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.185571 10727 raft_consensus.cc:2468] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 1.
I20260709 13:03:33.186973 10844 leader_election.cc:304] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:33.187388 10804 raft_consensus.cc:2468] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:33.188001 10935 raft_consensus.cc:2804] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.188472 10935 raft_consensus.cc:697] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 1 LEADER]: Becoming Leader. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:33.188813 10693 leader_election.cc:304] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.189286 10935 consensus_queue.cc:237] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.191830 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a44e0477fe43b0bee6903f79c01141" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.193006 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:33.193764 10804 raft_consensus.cc:2393] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec424be61499475db7217e8842759609 in current term 1: Already voted for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in this term.
I20260709 13:03:33.196816 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede29f0e5414131b44056468158fd15" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:33.197686 10728 raft_consensus.cc:3060] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.201326 10921 ts_tablet_manager.cc:1434] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.059s	user 0.018s	sys 0.002s
I20260709 13:03:33.191219 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a44e0477fe43b0bee6903f79c01141" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:33.205622 10927 raft_consensus.cc:2804] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.206365 10927 raft_consensus.cc:697] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:33.207165 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede29f0e5414131b44056468158fd15" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:33.209930 10878 raft_consensus.cc:3060] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.207228 10927 consensus_queue.cc:237] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
W20260709 13:03:33.205722 10692 leader_election.cc:343] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.216171 10949 raft_consensus.cc:515] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
W20260709 13:03:33.216562 10692 leader_election.cc:343] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.218750 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:33.217744 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:33.227397 10728 raft_consensus.cc:2468] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 1.
I20260709 13:03:33.227955 10878 raft_consensus.cc:2468] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 1.
I20260709 13:03:33.230155 10952 raft_consensus.cc:493] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.231402 10918 tablet_bootstrap.cc:492] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:33.232904 10918 ts_tablet_manager.cc:1403] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.022s
I20260709 13:03:33.236302 10921 tablet_bootstrap.cc:492] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:33.236724 10919 tablet_bootstrap.cc:492] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:33.232297 10727 raft_consensus.cc:2393] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fb7a8d90f85e4a5697ab2933e4bc8251 in current term 1: Already voted for candidate ec424be61499475db7217e8842759609 in this term.
I20260709 13:03:33.238085 10950 raft_consensus.cc:493] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.241140 10919 ts_tablet_manager.cc:1403] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.005s
I20260709 13:03:33.241060 10950 raft_consensus.cc:515] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.243227 10950 leader_election.cc:290] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.238837 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:33.238958 10952 raft_consensus.cc:515] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.239744 10918 raft_consensus.cc:359] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.237643 10949 leader_election.cc:290] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.244427 10918 raft_consensus.cc:385] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.244915 10728 raft_consensus.cc:3060] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.243897 10767 leader_election.cc:304] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.244989 10919 raft_consensus.cc:359] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.247102 10919 raft_consensus.cc:385] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.247473 10919 raft_consensus.cc:740] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.248261 10919 consensus_queue.cc:260] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.248968 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:33.244867 10918 raft_consensus.cc:740] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.251204 10921 tablet_bootstrap.cc:654] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.255113 10918 consensus_queue.cc:260] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.250478 10919 ts_tablet_manager.cc:1434] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.003s
I20260709 13:03:33.257176 10918 ts_tablet_manager.cc:1434] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
W20260709 13:03:33.252573 10770 leader_election.cc:343] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.258467 10770 leader_election.cc:304] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609
I20260709 13:03:33.251223 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:33.244406 10927 raft_consensus.cc:493] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.259320 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:33.260460 10922 raft_consensus.cc:2804] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.260836 10878 raft_consensus.cc:3060] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.261016 10922 raft_consensus.cc:697] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:33.260888 10927 raft_consensus.cc:515] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.262151 10922 consensus_queue.cc:237] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.265597 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:33.266850 10918 tablet_bootstrap.cc:492] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:33.266445 10804 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:33.267503 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.268504 10729 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:33.268887 10878 raft_consensus.cc:2468] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 1.
I20260709 13:03:33.268739 10693 leader_election.cc:304] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.270079 10954 raft_consensus.cc:2804] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.270437 10954 raft_consensus.cc:493] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.270793 10954 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:33.271077 10692 leader_election.cc:343] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.272859 10919 tablet_bootstrap.cc:492] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:33.273373 10770 leader_election.cc:304] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.266705 10949 raft_consensus.cc:2749] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.274509 10946 raft_consensus.cc:2804] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.275130 10946 raft_consensus.cc:493] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.275490 10946 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.277633 10767 leader_election.cc:304] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.278779 10954 raft_consensus.cc:515] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.279034 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.252848 10952 leader_election.cc:290] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.252480 10626 catalog_manager.cc:5697] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.281553 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
W20260709 13:03:33.285471 10767 leader_election.cc:343] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.282259 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.282996 10728 raft_consensus.cc:2468] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 1.
I20260709 13:03:33.288542 10946 raft_consensus.cc:515] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.283613 10954 leader_election.cc:290] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.278877 10949 raft_consensus.cc:2804] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.287456 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:33.289861 10804 raft_consensus.cc:2393] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec16e68839f47c38eefc730712b7c96 in current term 1: Already voted for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in this term.
W20260709 13:03:33.290855 10692 leader_election.cc:343] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.291793 10949 raft_consensus.cc:697] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:33.292606 10949 consensus_queue.cc:237] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.292922 10693 leader_election.cc:304] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96; no voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:33.271925 10927 leader_election.cc:290] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.295622 10954 raft_consensus.cc:2749] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:03:33.297088 10767 leader_election.cc:343] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.300012 10767 leader_election.cc:304] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609
I20260709 13:03:33.307909 10922 raft_consensus.cc:2749] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.310084 10921 tablet_bootstrap.cc:492] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:33.310979 10921 ts_tablet_manager.cc:1403] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.010s
I20260709 13:03:33.312274 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:33.313349 10728 raft_consensus.cc:2393] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fb7a8d90f85e4a5697ab2933e4bc8251 in current term 1: Already voted for candidate 5ec16e68839f47c38eefc730712b7c96 in this term.
I20260709 13:03:33.313763 10918 tablet_bootstrap.cc:654] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.313979 10921 raft_consensus.cc:359] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.301878 10946 leader_election.cc:290] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.316186 10921 raft_consensus.cc:385] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.316643 10921 raft_consensus.cc:740] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.316900 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:33.317968 10921 consensus_queue.cc:260] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
W20260709 13:03:33.319847 10767 leader_election.cc:343] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.320914 10767 leader_election.cc:304] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609
I20260709 13:03:33.322994 10921 ts_tablet_manager.cc:1434] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:33.324397 10921 tablet_bootstrap.cc:492] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:33.324623 10949 raft_consensus.cc:2749] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.326586 10919 tablet_bootstrap.cc:654] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.323788 10625 catalog_manager.cc:5697] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.333053 10918 tablet_bootstrap.cc:492] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:33.333549 10918 ts_tablet_manager.cc:1403] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.007s
I20260709 13:03:33.336205 10918 raft_consensus.cc:359] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.336807 10918 raft_consensus.cc:385] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.337070 10918 raft_consensus.cc:740] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.340963 10921 tablet_bootstrap.cc:654] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.342621 10626 catalog_manager.cc:5697] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec424be61499475db7217e8842759609 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ec424be61499475db7217e8842759609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.344343 10918 consensus_queue.cc:260] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.346702 10918 ts_tablet_manager.cc:1434] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:03:33.349721 10625 catalog_manager.cc:5697] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.362442 10921 tablet_bootstrap.cc:492] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:33.364125 10921 ts_tablet_manager.cc:1403] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.011s
I20260709 13:03:33.365346 10919 tablet_bootstrap.cc:492] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:33.365867 10919 ts_tablet_manager.cc:1403] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.025s
I20260709 13:03:33.367347 10921 raft_consensus.cc:359] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.368129 10921 raft_consensus.cc:385] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.368427 10921 raft_consensus.cc:740] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.368808 10919 raft_consensus.cc:359] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.369571 10919 raft_consensus.cc:385] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.369169 10921 consensus_queue.cc:260] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.369874 10919 raft_consensus.cc:740] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.370640 10919 consensus_queue.cc:260] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.372931 10919 ts_tablet_manager.cc:1434] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:03:33.373504 10921 ts_tablet_manager.cc:1434] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:03:33.373915 10919 tablet_bootstrap.cc:492] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:33.374523 10921 tablet_bootstrap.cc:492] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:33.380721 10921 tablet_bootstrap.cc:654] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.380721 10919 tablet_bootstrap.cc:654] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.385180 10921 tablet_bootstrap.cc:492] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:33.385608 10921 ts_tablet_manager.cc:1403] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:03:33.388325 10919 tablet_bootstrap.cc:492] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:33.388126 10921 raft_consensus.cc:359] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.388803 10919 ts_tablet_manager.cc:1403] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.005s
I20260709 13:03:33.388870 10921 raft_consensus.cc:385] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.389202 10921 raft_consensus.cc:740] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.389881 10921 consensus_queue.cc:260] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.391366 10919 raft_consensus.cc:359] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.391840 10921 ts_tablet_manager.cc:1434] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:03:33.392199 10919 raft_consensus.cc:385] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.392470 10919 raft_consensus.cc:740] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.392860 10921 tablet_bootstrap.cc:492] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:33.394999 10919 consensus_queue.cc:260] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.396673 10919 ts_tablet_manager.cc:1434] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:03:33.397545 10919 tablet_bootstrap.cc:492] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:33.398726 10921 tablet_bootstrap.cc:654] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.403257 10919 tablet_bootstrap.cc:654] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.405578 10927 raft_consensus.cc:493] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.406139 10927 raft_consensus.cc:515] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.408044 10927 leader_election.cc:290] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.408143 10919 tablet_bootstrap.cc:492] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:33.408707 10919 ts_tablet_manager.cc:1403] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 13:03:33.409597 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c9bb6fbe7849b19c4618982ffec63f" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.410269 10878 raft_consensus.cc:2468] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:33.410943 10921 tablet_bootstrap.cc:492] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:33.411105 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c9bb6fbe7849b19c4618982ffec63f" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:33.411440 10921 ts_tablet_manager.cc:1403] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 13:03:33.411252 10919 raft_consensus.cc:359] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.411460 10692 leader_election.cc:304] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:33.411845 10804 raft_consensus.cc:2468] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:33.411985 10919 raft_consensus.cc:385] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.412352 10919 raft_consensus.cc:740] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.412521 10927 raft_consensus.cc:2804] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.412959 10927 raft_consensus.cc:493] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.413398 10927 raft_consensus.cc:3060] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.413017 10919 consensus_queue.cc:260] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.414038 10921 raft_consensus.cc:359] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.414647 10921 raft_consensus.cc:385] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.414893 10921 raft_consensus.cc:740] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.415035 10919 ts_tablet_manager.cc:1434] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:33.415524 10921 consensus_queue.cc:260] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.417280 10921 ts_tablet_manager.cc:1434] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:03:33.422165 10927 raft_consensus.cc:515] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.424917 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c9bb6fbe7849b19c4618982ffec63f" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:33.425487 10804 raft_consensus.cc:3060] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.426136 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c9bb6fbe7849b19c4618982ffec63f" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:33.426649 10878 raft_consensus.cc:3060] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.430806 10927 leader_election.cc:290] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.431207 10804 raft_consensus.cc:2468] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:33.431792 10878 raft_consensus.cc:2468] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:33.432092 10693 leader_election.cc:304] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.432870 10927 raft_consensus.cc:2804] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.433245 10927 raft_consensus.cc:697] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:33.433844 10927 consensus_queue.cc:237] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.440310 10624 catalog_manager.cc:5697] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.505244 10935 consensus_queue.cc:1048] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.514825 10728 raft_consensus.cc:3060] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.522228 10927 raft_consensus.cc:493] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.522807 10927 raft_consensus.cc:515] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.523986 10935 consensus_queue.cc:1048] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.525466 10927 leader_election.cc:290] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.525563 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:33.526160 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.526335 10804 raft_consensus.cc:2468] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:33.526734 10878 raft_consensus.cc:2468] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:33.527467 10693 leader_election.cc:304] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.528360 10927 raft_consensus.cc:2804] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.528738 10927 raft_consensus.cc:493] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.528999 10927 raft_consensus.cc:3060] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.535871 10927 raft_consensus.cc:515] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.537907 10927 leader_election.cc:290] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.538470 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:33.539026 10878 raft_consensus.cc:3060] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.538930 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:33.539650 10804 raft_consensus.cc:3060] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.544227 10878 raft_consensus.cc:2468] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:33.545096 10804 raft_consensus.cc:2468] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:33.545128 10692 leader_election.cc:304] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:33.545915 10927 raft_consensus.cc:2804] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.546288 10927 raft_consensus.cc:697] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:33.547014 10927 consensus_queue.cc:237] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.553144 10624 catalog_manager.cc:5697] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.589857 10935 consensus_queue.cc:1048] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.600976 10979 consensus_queue.cc:1048] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:33.656337 10927 consensus_queue.cc:1048] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.659511 10878 raft_consensus.cc:3060] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.670336 10954 consensus_queue.cc:1048] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.702646 10949 consensus_queue.cc:1048] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:33.712697 10949 consensus_queue.cc:1048] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.715113 10979 raft_consensus.cc:493] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.715643 10979 raft_consensus.cc:515] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.717983 10979 leader_election.cc:290] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:33.719444 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:33.720381 10728 raft_consensus.cc:2468] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 0.
I20260709 13:03:33.720543 10949 raft_consensus.cc:493] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.719494 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:33.721101 10949 raft_consensus.cc:515] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.722020 10844 leader_election.cc:304] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:33.722119 10804 raft_consensus.cc:2468] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 0.
I20260709 13:03:33.723310 10949 leader_election.cc:290] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.724256 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:33.724274 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:33.724716 10979 raft_consensus.cc:2804] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.725036 10728 raft_consensus.cc:2468] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:33.725324 10979 raft_consensus.cc:493] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.726253 10979 raft_consensus.cc:3060] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.726116 10770 leader_election.cc:304] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:33.727273 10922 raft_consensus.cc:2804] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.727588 10922 raft_consensus.cc:493] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.727862 10922 raft_consensus.cc:3060] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.734273 10979 raft_consensus.cc:515] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.735503 10877 raft_consensus.cc:2393] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fb7a8d90f85e4a5697ab2933e4bc8251 in current term 1: Already voted for candidate ec424be61499475db7217e8842759609 in this term.
I20260709 13:03:33.735769 10922 raft_consensus.cc:515] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.737898 10922 leader_election.cc:290] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:33.738185 10979 leader_election.cc:290] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:33.738648 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:33.738933 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:33.739109 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:33.739310 10729 raft_consensus.cc:3060] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.739262 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:33.740006 10877 raft_consensus.cc:2393] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fb7a8d90f85e4a5697ab2933e4bc8251 in current term 1: Already voted for candidate ec424be61499475db7217e8842759609 in this term.
I20260709 13:03:33.740325 10804 raft_consensus.cc:2393] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec424be61499475db7217e8842759609 in current term 1: Already voted for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in this term.
I20260709 13:03:33.741295 10842 leader_election.cc:304] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec424be61499475db7217e8842759609; no voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:33.741941 10979 raft_consensus.cc:2749] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.745144 10729 raft_consensus.cc:2468] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 1.
I20260709 13:03:33.746044 10770 leader_election.cc:304] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: ec424be61499475db7217e8842759609
I20260709 13:03:33.746639 10922 raft_consensus.cc:2804] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.747073 10922 raft_consensus.cc:697] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:33.747699 10922 consensus_queue.cc:237] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.755486 10922 consensus_queue.cc:1048] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.754925 10625 catalog_manager.cc:5697] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.766321 10949 consensus_queue.cc:1048] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.825619 10979 raft_consensus.cc:493] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.826097 10979 raft_consensus.cc:515] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:33.827857 10979 leader_election.cc:290] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:33.828579 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:33.828786 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:33.829263 10728 raft_consensus.cc:2393] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec424be61499475db7217e8842759609 in current term 1: Already voted for candidate 5ec16e68839f47c38eefc730712b7c96 in this term.
I20260709 13:03:33.829629 10804 raft_consensus.cc:2393] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec424be61499475db7217e8842759609 in current term 1: Already voted for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in this term.
I20260709 13:03:33.830706 10842 leader_election.cc:304] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec424be61499475db7217e8842759609; no voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:33.831419 10979 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.832604 10954 consensus_queue.cc:1048] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.837231 10979 raft_consensus.cc:2749] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.842880 10954 consensus_queue.cc:1048] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:33.966213 10954 consensus_queue.cc:1048] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:33.976195 10954 consensus_queue.cc:1048] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:34.110586 10675 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:34.155617 10952 consensus_queue.cc:1048] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.167088 10949 consensus_queue.cc:1048] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.884861 10989 raft_consensus.cc:493] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.885258 10989 raft_consensus.cc:515] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:34.886974 10989 leader_election.cc:290] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:34.887727 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:34.887998 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:34.888337 10804 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:34.888664 10877 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:34.889571 10693 leader_election.cc:304] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:34.890300 10989 raft_consensus.cc:2804] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:34.890655 10989 raft_consensus.cc:493] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.890956 10989 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.897006 10989 raft_consensus.cc:515] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:34.898502 10989 leader_election.cc:290] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:34.899214 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:34.899343 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:34.899763 10804 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.899991 10877 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.904947 10804 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:34.905166 10877 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:34.905870 10693 leader_election.cc:304] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:34.906631 10989 raft_consensus.cc:2804] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.907060 10989 raft_consensus.cc:697] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:34.907814 10989 consensus_queue.cc:237] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:34.914620 10624 catalog_manager.cc:5697] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.301143 10877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b"
dest_uuid: "ec424be61499475db7217e8842759609"
mode: GRACEFUL
new_leader_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:03:35.301774 10877 raft_consensus.cc:606] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 1 LEADER]: Received request to transfer leadership to TS 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:35.306618 10877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ba95b0ae3a44536bf292beca934fffe"
dest_uuid: "ec424be61499475db7217e8842759609"
mode: GRACEFUL
new_leader_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:03:35.307111 10877 raft_consensus.cc:606] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 1 LEADER]: Received request to transfer leadership to TS 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:35.318336 10804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ede29f0e5414131b44056468158fd15"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
mode: GRACEFUL
new_leader_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:03:35.318840 10804 raft_consensus.cc:606] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Received request to transfer leadership to TS 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:35.323499 10804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
mode: GRACEFUL
new_leader_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:03:35.324007 10804 raft_consensus.cc:606] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Received request to transfer leadership to TS 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:35.336359 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81a44e0477fe43b0bee6903f79c01141"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
mode: GRACEFUL
new_leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:03:35.336910 10728 raft_consensus.cc:606] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Received request to transfer leadership to TS fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:35.341245 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c616781e3e9d4730884eff5393860171"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
mode: GRACEFUL
new_leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:03:35.341699 10728 raft_consensus.cc:606] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Received request to transfer leadership to TS fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:35.345808 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
mode: GRACEFUL
new_leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:03:35.346244 10728 raft_consensus.cc:606] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Received request to transfer leadership to TS fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:35.350343 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09c9bb6fbe7849b19c4618982ffec63f"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
mode: GRACEFUL
new_leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:03:35.350809 10728 raft_consensus.cc:606] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Received request to transfer leadership to TS fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:35.354823 10804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
mode: GRACEFUL
new_leader_uuid: "ec424be61499475db7217e8842759609"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:03:35.355271 10804 raft_consensus.cc:606] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Received request to transfer leadership to TS ec424be61499475db7217e8842759609
I20260709 13:03:35.386013 10804 raft_consensus.cc:1275] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:35.387272 10989 consensus_queue.cc:1048] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:35.393414 10954 raft_consensus.cc:993] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96: : Instructing follower fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:35.394199 10989 raft_consensus.cc:1081] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Signalling peer fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:35.396099 10803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c616781e3e9d4730884eff5393860171"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:42398
I20260709 13:03:35.398595 10803 raft_consensus.cc:493] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.398998 10803 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.399971 10877 raft_consensus.cc:1275] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:35.401849 11005 consensus_queue.cc:1048] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:35.406618 10803 raft_consensus.cc:515] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.412009 10803 leader_election.cc:290] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:35.413774 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:35.414201 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:35.414316 10877 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.414893 10728 raft_consensus.cc:3055] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:35.415210 10728 raft_consensus.cc:740] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:35.415917 10728 consensus_queue.cc:260] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.417160 10728 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.421748 10877 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 3.
I20260709 13:03:35.423619 10728 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 3.
I20260709 13:03:35.424921 10767 leader_election.cc:304] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:35.426721 11010 raft_consensus.cc:993] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251: : Instructing follower 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:35.426833 10922 raft_consensus.cc:2804] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:35.427201 11010 raft_consensus.cc:1081] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Signalling peer 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:35.427449 10922 raft_consensus.cc:697] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:35.428376 10922 consensus_queue.cc:237] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.431823 10728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:46014
I20260709 13:03:35.432433 10728 raft_consensus.cc:493] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.432768 10728 raft_consensus.cc:3060] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.434495 10625 catalog_manager.cc:5697] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 2 to 3, leader changed from 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193) to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.438462 10728 raft_consensus.cc:515] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.440363 10728 leader_election.cc:290] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:35.441349 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:35.441447 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:35.442243 10803 raft_consensus.cc:3055] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.442318 10877 raft_consensus.cc:3060] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.442584 10803 raft_consensus.cc:740] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:35.443521 10803 consensus_queue.cc:260] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.444780 10803 raft_consensus.cc:3060] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.448146 10877 raft_consensus.cc:2468] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:35.449066 10692 leader_election.cc:304] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:35.449714 10954 raft_consensus.cc:2804] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.450093 10954 raft_consensus.cc:697] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:35.450315 10803 raft_consensus.cc:2468] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:35.450819 10954 consensus_queue.cc:237] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.458184 10625 catalog_manager.cc:5697] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 1 to 2, leader changed from fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194) to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.524843 11016 raft_consensus.cc:993] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609: : Instructing follower 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:35.525283 10926 raft_consensus.cc:1081] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 1 LEADER]: Signalling peer 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:35.526561 10728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:03:35.527032 10728 raft_consensus.cc:493] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.527272 10728 raft_consensus.cc:3060] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.532119 10728 raft_consensus.cc:515] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.533568 10728 leader_election.cc:290] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:35.534452 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:35.534575 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1ee054575f49a382f11ad9b5b7647b" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:35.535209 10803 raft_consensus.cc:3060] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.535283 10877 raft_consensus.cc:3055] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.535893 10877 raft_consensus.cc:740] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:35.536594 10877 consensus_queue.cc:260] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.537539 10877 raft_consensus.cc:3060] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.540082 10803 raft_consensus.cc:2468] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:35.541023 10693 leader_election.cc:304] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:35.541744 11005 raft_consensus.cc:2804] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.542217 11005 raft_consensus.cc:697] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:35.542846 10877 raft_consensus.cc:2468] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:35.543082 11005 consensus_queue.cc:237] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.550071 10625 catalog_manager.cc:5697] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 1 to 2, leader changed from ec424be61499475db7217e8842759609 (127.0.107.195) to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.622695 10954 raft_consensus.cc:993] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96: : Instructing follower fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:35.623128 11005 raft_consensus.cc:1081] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Signalling peer fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:35.624403 10803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09c9bb6fbe7849b19c4618982ffec63f"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:42398
I20260709 13:03:35.624863 10803 raft_consensus.cc:493] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.625168 10803 raft_consensus.cc:3060] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.629778 10803 raft_consensus.cc:515] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.631273 10803 leader_election.cc:290] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:35.632035 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c9bb6fbe7849b19c4618982ffec63f" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:35.632339 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c9bb6fbe7849b19c4618982ffec63f" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:35.632650 10728 raft_consensus.cc:3055] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.632953 10877 raft_consensus.cc:3060] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.632980 10728 raft_consensus.cc:740] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:35.633791 10728 consensus_queue.cc:260] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.634745 10728 raft_consensus.cc:3060] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.637956 10877 raft_consensus.cc:2468] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:35.638965 10767 leader_election.cc:304] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:35.639729 11011 raft_consensus.cc:2804] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.639796 10728 raft_consensus.cc:2468] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:35.640157 11011 raft_consensus.cc:697] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:35.640995 11011 consensus_queue.cc:237] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.647754 10922 raft_consensus.cc:993] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251: : Instructing follower 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:35.648288 11011 raft_consensus.cc:1081] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Signalling peer 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:35.647794 10625 catalog_manager.cc:5697] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 1 to 2, leader changed from 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193) to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.649678 10728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ede29f0e5414131b44056468158fd15"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:46014
I20260709 13:03:35.650132 10728 raft_consensus.cc:493] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.650487 10728 raft_consensus.cc:3060] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.655195 11016 raft_consensus.cc:993] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609: : Instructing follower 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:35.655676 10926 raft_consensus.cc:1081] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 1 LEADER]: Signalling peer 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:35.656749 10728 raft_consensus.cc:515] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.657480 10729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ba95b0ae3a44536bf292beca934fffe"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:03:35.657958 10729 raft_consensus.cc:493] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.658231 10729 raft_consensus.cc:3060] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.658784 10728 leader_election.cc:290] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:35.659472 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede29f0e5414131b44056468158fd15" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:35.659840 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ede29f0e5414131b44056468158fd15" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:35.660145 10803 raft_consensus.cc:3055] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.660503 10877 raft_consensus.cc:3060] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.660535 10803 raft_consensus.cc:740] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:35.661501 10803 consensus_queue.cc:260] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.662863 10803 raft_consensus.cc:3060] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.665001 10729 raft_consensus.cc:515] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.665663 10877 raft_consensus.cc:2468] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:35.666637 10692 leader_election.cc:304] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:35.667367 11005 raft_consensus.cc:2804] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.667788 11005 raft_consensus.cc:697] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:35.667830 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba95b0ae3a44536bf292beca934fffe" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:35.668419 10804 raft_consensus.cc:3060] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.668748 10729 leader_election.cc:290] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:35.668666 11005 consensus_queue.cc:237] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.669612 10803 raft_consensus.cc:2468] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:35.670245 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba95b0ae3a44536bf292beca934fffe" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:35.670806 10877 raft_consensus.cc:3055] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.671103 10877 raft_consensus.cc:740] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:35.671772 10877 consensus_queue.cc:260] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.673036 10877 raft_consensus.cc:3060] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.674978 10804 raft_consensus.cc:2468] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:35.675940 10693 leader_election.cc:304] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:35.676563 11005 raft_consensus.cc:2804] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.677016 11005 raft_consensus.cc:697] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:35.677678 11005 consensus_queue.cc:237] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.677455 10625 catalog_manager.cc:5697] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 1 to 2, leader changed from fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194) to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.678805 10877 raft_consensus.cc:2468] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:35.689303 10625 catalog_manager.cc:5697] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 1 to 2, leader changed from ec424be61499475db7217e8842759609 (127.0.107.195) to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.731205 10922 raft_consensus.cc:993] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251: : Instructing follower ec424be61499475db7217e8842759609 to start an election
I20260709 13:03:35.731631 11011 raft_consensus.cc:1081] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Signalling peer ec424be61499475db7217e8842759609 to start an election
I20260709 13:03:35.733119 10877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720"
dest_uuid: "ec424be61499475db7217e8842759609"
 from {username='slave'} at 127.0.0.1:35780
I20260709 13:03:35.733747 10877 raft_consensus.cc:493] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.734066 10877 raft_consensus.cc:3060] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.738683 10877 raft_consensus.cc:515] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.740198 10877 leader_election.cc:290] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:35.740993 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:35.741173 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3966b43f418e499e9e0b614f4d681720" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:35.741612 10729 raft_consensus.cc:3060] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.741748 10804 raft_consensus.cc:3055] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.742148 10804 raft_consensus.cc:740] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:35.742810 10804 consensus_queue.cc:260] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.743723 10804 raft_consensus.cc:3060] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.746380 10729 raft_consensus.cc:2468] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 2.
I20260709 13:03:35.747401 10844 leader_election.cc:304] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:35.748097 10926 raft_consensus.cc:2804] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.748483 10926 raft_consensus.cc:697] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 2 LEADER]: Becoming Leader. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:35.748636 10804 raft_consensus.cc:2468] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 2.
I20260709 13:03:35.749238 10926 consensus_queue.cc:237] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.755750 10625 catalog_manager.cc:5697] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 reported cstate change: term changed from 1 to 2, leader changed from fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194) to ec424be61499475db7217e8842759609 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ec424be61499475db7217e8842759609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.816244 10954 raft_consensus.cc:993] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96: : Instructing follower fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:35.816727 11005 raft_consensus.cc:1081] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Signalling peer fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:35.818058 10804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:42398
I20260709 13:03:35.818549 10804 raft_consensus.cc:493] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.818897 10804 raft_consensus.cc:3060] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.823607 10804 raft_consensus.cc:515] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.825021 10804 leader_election.cc:290] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:35.825745 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:35.825960 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca0492e8d6b4f9d8222c92a0e604901" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:35.826327 10729 raft_consensus.cc:3055] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.826498 10877 raft_consensus.cc:3060] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.826669 10729 raft_consensus.cc:740] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:35.827594 10729 consensus_queue.cc:260] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.828542 10729 raft_consensus.cc:3060] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.831497 10877 raft_consensus.cc:2468] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:35.832434 10767 leader_election.cc:304] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:35.833087 11011 raft_consensus.cc:2804] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.833395 10729 raft_consensus.cc:2468] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:35.833595 11011 raft_consensus.cc:697] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:35.834492 11011 consensus_queue.cc:237] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.841467 10625 catalog_manager.cc:5697] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 1 to 2, leader changed from 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193) to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.842389 10954 raft_consensus.cc:993] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96: : Instructing follower fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:35.842926 11005 raft_consensus.cc:1081] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Signalling peer fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:35.844359 10804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81a44e0477fe43b0bee6903f79c01141"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:42398
I20260709 13:03:35.844779 10804 raft_consensus.cc:493] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:35.845055 10804 raft_consensus.cc:3060] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.850545 10804 raft_consensus.cc:515] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.852080 10804 leader_election.cc:290] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:35.852790 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a44e0477fe43b0bee6903f79c01141" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:35.853061 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a44e0477fe43b0bee6903f79c01141" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:35.853447 10729 raft_consensus.cc:3055] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.853600 10877 raft_consensus.cc:3060] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.853781 10729 raft_consensus.cc:740] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:35.854535 10729 consensus_queue.cc:260] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.855491 10729 raft_consensus.cc:3060] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.858336 10877 raft_consensus.cc:2468] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:35.859427 10767 leader_election.cc:304] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:35.860224 11011 raft_consensus.cc:2804] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.860641 11011 raft_consensus.cc:697] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:35.860812 10804 raft_consensus.cc:1275] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.860425 10729 raft_consensus.cc:2468] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:35.861526 11011 consensus_queue.cc:237] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:35.862174 11005 consensus_queue.cc:1048] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.869984 10625 catalog_manager.cc:5697] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 1 to 2, leader changed from 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193) to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.870800 10877 raft_consensus.cc:1275] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.872071 10989 consensus_queue.cc:1048] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.913677 10729 raft_consensus.cc:1275] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 3 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:35.915005 11011 consensus_queue.cc:1048] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.922101 10877 raft_consensus.cc:1275] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 3 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:35.923466 10922 consensus_queue.cc:1048] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.072331 10877 raft_consensus.cc:1275] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.073477 10989 consensus_queue.cc:1048] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.081679 10804 raft_consensus.cc:1275] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.083375 10954 consensus_queue.cc:1048] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.131024 10877 raft_consensus.cc:1275] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.132633 11005 consensus_queue.cc:1048] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.133976 10804 raft_consensus.cc:1275] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.136032 11005 consensus_queue.cc:1048] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.144560 10803 raft_consensus.cc:1275] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.146085 10989 consensus_queue.cc:1048] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.156219 10877 raft_consensus.cc:1275] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.159196 10954 consensus_queue.cc:1048] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.244963 10729 raft_consensus.cc:1275] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.246255 10922 consensus_queue.cc:1048] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.254233 10877 raft_consensus.cc:1275] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.256009 11010 consensus_queue.cc:1048] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.343240 10804 raft_consensus.cc:1275] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer ec424be61499475db7217e8842759609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.344329 10926 consensus_queue.cc:1048] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.349736 10729 raft_consensus.cc:1275] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Refusing update from remote peer ec424be61499475db7217e8842759609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.351737 11036 consensus_queue.cc:1048] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.396101 10877 raft_consensus.cc:1275] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.397182 11010 consensus_queue.cc:1048] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.405463 10729 raft_consensus.cc:1275] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.406898 11010 consensus_queue.cc:1048] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.408859 10877 raft_consensus.cc:1275] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.411861 11040 consensus_queue.cc:1048] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.421470 10729 raft_consensus.cc:1275] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.422824 10922 consensus_queue.cc:1048] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:38.383359 10625 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40640:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:38.385355 10625 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:38.434490 10715 tablet_service.cc:1511] Processing CreateTablet for tablet 884a930630a24604b59d2be5d7f21ada (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:38.435756 10715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884a930630a24604b59d2be5d7f21ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.435657 10794 tablet_service.cc:1511] Processing CreateTablet for tablet 884a930630a24604b59d2be5d7f21ada (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:38.436980 10794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884a930630a24604b59d2be5d7f21ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.437947 10718 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5aff08160140138d11b32a4103c057 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:38.439198 10718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5aff08160140138d11b32a4103c057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.439596 10867 tablet_service.cc:1511] Processing CreateTablet for tablet 884a930630a24604b59d2be5d7f21ada (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:38.440776 10867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884a930630a24604b59d2be5d7f21ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.444291 10865 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5aff08160140138d11b32a4103c057 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:38.445475 10865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5aff08160140138d11b32a4103c057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.445389 10791 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5aff08160140138d11b32a4103c057 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:38.446722 10791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5aff08160140138d11b32a4103c057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.447837 10792 tablet_service.cc:1511] Processing CreateTablet for tablet a80b8863a4914dfa96691fd10ef07985 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:38.449007 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80b8863a4914dfa96691fd10ef07985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.450073 10864 tablet_service.cc:1511] Processing CreateTablet for tablet e2a453a38c674d408aba9878f69bb388 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:38.454762 10864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a453a38c674d408aba9878f69bb388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.454628 10790 tablet_service.cc:1511] Processing CreateTablet for tablet f5df8946824d448f9f35583d27043ce0 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:38.455926 10790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5df8946824d448f9f35583d27043ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.450390 10862 tablet_service.cc:1511] Processing CreateTablet for tablet a80b8863a4914dfa96691fd10ef07985 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:38.459403 10862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80b8863a4914dfa96691fd10ef07985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.460525 10789 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2f27d656f941818ccea9cbfb6dc533 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:38.461732 10789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2f27d656f941818ccea9cbfb6dc533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.451520 10713 tablet_service.cc:1511] Processing CreateTablet for tablet a80b8863a4914dfa96691fd10ef07985 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:38.463541 10713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80b8863a4914dfa96691fd10ef07985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.463799 10788 tablet_service.cc:1511] Processing CreateTablet for tablet 48c199431f4f4c2888707f6e2c664769 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:38.464979 10788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c199431f4f4c2888707f6e2c664769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.469017 10787 tablet_service.cc:1511] Processing CreateTablet for tablet 88b7730480fe433981d7e9201128732e (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:38.451648 10714 tablet_service.cc:1511] Processing CreateTablet for tablet e2a453a38c674d408aba9878f69bb388 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:38.470283 10787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b7730480fe433981d7e9201128732e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.470917 10714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a453a38c674d408aba9878f69bb388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.473243 10786 tablet_service.cc:1511] Processing CreateTablet for tablet fcbaf056b5744e1f9ee2190fc6a8a714 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:38.473394 10863 tablet_service.cc:1511] Processing CreateTablet for tablet f5df8946824d448f9f35583d27043ce0 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:38.474462 10786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbaf056b5744e1f9ee2190fc6a8a714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.474789 10863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5df8946824d448f9f35583d27043ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.477072 10716 tablet_service.cc:1511] Processing CreateTablet for tablet 48c199431f4f4c2888707f6e2c664769 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:38.478268 10716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c199431f4f4c2888707f6e2c664769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.477771 10717 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2f27d656f941818ccea9cbfb6dc533 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:38.484136 10711 tablet_service.cc:1511] Processing CreateTablet for tablet fcbaf056b5744e1f9ee2190fc6a8a714 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:38.484522 10866 tablet_service.cc:1511] Processing CreateTablet for tablet 2b2f27d656f941818ccea9cbfb6dc533 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:38.484973 10717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2f27d656f941818ccea9cbfb6dc533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.484829 10868 tablet_service.cc:1511] Processing CreateTablet for tablet 48c199431f4f4c2888707f6e2c664769 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:38.453369 10793 tablet_service.cc:1511] Processing CreateTablet for tablet e2a453a38c674d408aba9878f69bb388 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:38.485757 10866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2f27d656f941818ccea9cbfb6dc533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.486486 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a453a38c674d408aba9878f69bb388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.452998 10719 tablet_service.cc:1511] Processing CreateTablet for tablet f5df8946824d448f9f35583d27043ce0 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:38.487612 10868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c199431f4f4c2888707f6e2c664769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.487818 10861 tablet_service.cc:1511] Processing CreateTablet for tablet 88b7730480fe433981d7e9201128732e (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:38.488955 10861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b7730480fe433981d7e9201128732e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.481843 10712 tablet_service.cc:1511] Processing CreateTablet for tablet 88b7730480fe433981d7e9201128732e (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:38.485677 10711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbaf056b5744e1f9ee2190fc6a8a714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.491154 10712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b7730480fe433981d7e9201128732e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.493202 10719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5df8946824d448f9f35583d27043ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.530360 10860 tablet_service.cc:1511] Processing CreateTablet for tablet fcbaf056b5744e1f9ee2190fc6a8a714 (DEFAULT_TABLE table=soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:38.531664 10860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbaf056b5744e1f9ee2190fc6a8a714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:38.549614 11055 tablet_bootstrap.cc:492] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:38.572476 11055 tablet_bootstrap.cc:654] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.640506 11058 tablet_bootstrap.cc:492] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:38.641872 11055 tablet_bootstrap.cc:492] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:38.643524 11055 ts_tablet_manager.cc:1403] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.012s
I20260709 13:03:38.646234 11055 raft_consensus.cc:359] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.646891 11055 raft_consensus.cc:385] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.647187 11055 raft_consensus.cc:740] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.647850 11055 consensus_queue.cc:260] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.649740 11055 ts_tablet_manager.cc:1434] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:03:38.642915 11056 tablet_bootstrap.cc:492] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:38.655874 11056 tablet_bootstrap.cc:654] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.657029 11058 tablet_bootstrap.cc:654] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.662178 11055 tablet_bootstrap.cc:492] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:38.663774 11056 tablet_bootstrap.cc:492] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:38.664384 11056 ts_tablet_manager.cc:1403] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.007s
I20260709 13:03:38.668006 11056 raft_consensus.cc:359] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.668828 11056 raft_consensus.cc:385] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.669131 11056 raft_consensus.cc:740] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.670331 11055 tablet_bootstrap.cc:654] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.669930 11056 consensus_queue.cc:260] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.673563 11056 ts_tablet_manager.cc:1434] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:03:38.675645 11058 tablet_bootstrap.cc:492] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:38.676133 11058 ts_tablet_manager.cc:1403] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.001s
I20260709 13:03:38.677282 11056 tablet_bootstrap.cc:492] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:38.678905 11058 raft_consensus.cc:359] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.679615 11058 raft_consensus.cc:385] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.679947 11058 raft_consensus.cc:740] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.680711 11058 consensus_queue.cc:260] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.683118 11058 ts_tablet_manager.cc:1434] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 13:03:38.684073 11058 tablet_bootstrap.cc:492] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:38.684437 11056 tablet_bootstrap.cc:654] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.687781 11055 tablet_bootstrap.cc:492] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:38.688277 11055 ts_tablet_manager.cc:1403] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:03:38.691294 11056 tablet_bootstrap.cc:492] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:38.691054 11055 raft_consensus.cc:359] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.691846 11055 raft_consensus.cc:385] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.692209 11055 raft_consensus.cc:740] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.693011 11055 consensus_queue.cc:260] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.695231 11058 tablet_bootstrap.cc:654] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.695251 11055 ts_tablet_manager.cc:1434] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:38.691859 11056 ts_tablet_manager.cc:1403] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.005s
I20260709 13:03:38.699427 11055 tablet_bootstrap.cc:492] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:38.701756 11056 raft_consensus.cc:359] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.703591 11056 raft_consensus.cc:385] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.705835 11056 raft_consensus.cc:740] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.706569 11056 consensus_queue.cc:260] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.707299 11055 tablet_bootstrap.cc:654] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.709095 11056 ts_tablet_manager.cc:1434] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:03:38.710028 11056 tablet_bootstrap.cc:492] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:38.717841 11058 tablet_bootstrap.cc:492] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:38.718304 11058 ts_tablet_manager.cc:1403] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.003s
W20260709 13:03:38.720635 10830 tablet.cc:2406] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:38.721129 11058 raft_consensus.cc:359] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.721772 11056 tablet_bootstrap.cc:654] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.721845 11058 raft_consensus.cc:385] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.722391 11058 raft_consensus.cc:740] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.723137 11058 consensus_queue.cc:260] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.725361 11058 ts_tablet_manager.cc:1434] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:03:38.726358 11058 tablet_bootstrap.cc:492] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:38.728963 11055 tablet_bootstrap.cc:492] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:38.729501 11055 ts_tablet_manager.cc:1403] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.006s
I20260709 13:03:38.731053 11056 tablet_bootstrap.cc:492] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:38.731576 11056 ts_tablet_manager.cc:1403] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.004s
I20260709 13:03:38.732472 11058 tablet_bootstrap.cc:654] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.732441 11055 raft_consensus.cc:359] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.733263 11055 raft_consensus.cc:385] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.733621 11055 raft_consensus.cc:740] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.734387 11055 consensus_queue.cc:260] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.734627 11056 raft_consensus.cc:359] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.735526 11056 raft_consensus.cc:385] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.737112 11055 ts_tablet_manager.cc:1434] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:03:38.739095 11055 tablet_bootstrap.cc:492] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:38.739941 11058 tablet_bootstrap.cc:492] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:38.740413 11058 ts_tablet_manager.cc:1403] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:03:38.743168 11058 raft_consensus.cc:359] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.743816 11058 raft_consensus.cc:385] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.744083 11058 raft_consensus.cc:740] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.744932 11055 tablet_bootstrap.cc:654] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.744861 11058 consensus_queue.cc:260] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.746804 11056 raft_consensus.cc:740] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.747258 11058 ts_tablet_manager.cc:1434] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:38.748185 11058 tablet_bootstrap.cc:492] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:38.748553 11056 consensus_queue.cc:260] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.751091 11056 ts_tablet_manager.cc:1434] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:03:38.752148 11056 tablet_bootstrap.cc:492] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:38.755724 11058 tablet_bootstrap.cc:654] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.756687 11055 tablet_bootstrap.cc:492] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:38.757230 11055 ts_tablet_manager.cc:1403] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:03:38.758944 11056 tablet_bootstrap.cc:654] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.760190 11055 raft_consensus.cc:359] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.760944 11055 raft_consensus.cc:385] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.761215 11055 raft_consensus.cc:740] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.761935 11055 consensus_queue.cc:260] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.771271 11055 ts_tablet_manager.cc:1434] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:03:38.771894 11058 tablet_bootstrap.cc:492] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:38.772221 11055 tablet_bootstrap.cc:492] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:38.772385 11058 ts_tablet_manager.cc:1403] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 13:03:38.775242 11058 raft_consensus.cc:359] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.775864 11058 raft_consensus.cc:385] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.776134 11058 raft_consensus.cc:740] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.776918 11056 tablet_bootstrap.cc:492] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:38.776806 11058 consensus_queue.cc:260] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.777429 11056 ts_tablet_manager.cc:1403] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 13:03:38.782779 11056 raft_consensus.cc:359] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.783512 11056 raft_consensus.cc:385] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.783810 11056 raft_consensus.cc:740] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.779294 11058 ts_tablet_manager.cc:1434] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:03:38.784637 11056 consensus_queue.cc:260] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.787206 11056 ts_tablet_manager.cc:1434] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:03:38.788221 11056 tablet_bootstrap.cc:492] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:38.789038 11055 tablet_bootstrap.cc:654] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.791886 11058 tablet_bootstrap.cc:492] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:38.795472 11056 tablet_bootstrap.cc:654] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.798429 11058 tablet_bootstrap.cc:654] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.799968 11055 tablet_bootstrap.cc:492] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:38.800534 11055 ts_tablet_manager.cc:1403] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:03:38.804999 11055 raft_consensus.cc:359] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.805907 11055 raft_consensus.cc:385] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.806286 11055 raft_consensus.cc:740] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.807173 11055 consensus_queue.cc:260] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.809608 10926 raft_consensus.cc:493] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.810132 10926 raft_consensus.cc:515] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.812306 10926 leader_election.cc:290] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:38.812868 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b7730480fe433981d7e9201128732e" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:38.814217 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b7730480fe433981d7e9201128732e" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
W20260709 13:03:38.814385 10844 leader_election.cc:343] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:38.815618 10842 leader_election.cc:343] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.815999 10842 leader_election.cc:304] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec424be61499475db7217e8842759609; no voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:38.816613 11044 raft_consensus.cc:493] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.816871 10926 raft_consensus.cc:2749] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.817092 11044 raft_consensus.cc:515] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.815878 11056 tablet_bootstrap.cc:492] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:38.818166 11056 ts_tablet_manager.cc:1403] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.006s
I20260709 13:03:38.815860 11055 ts_tablet_manager.cc:1434] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:03:38.819870 11055 tablet_bootstrap.cc:492] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:38.821209 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:38.821305 11044 leader_election.cc:290] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:38.821235 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
W20260709 13:03:38.822539 10693 leader_election.cc:343] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.822750 10877 raft_consensus.cc:2468] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:38.824081 10692 leader_election.cc:304] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:38.824776 10922 raft_consensus.cc:493] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.825202 11044 raft_consensus.cc:2804] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.825713 11044 raft_consensus.cc:493] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.825274 10922 raft_consensus.cc:515] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.826104 11044 raft_consensus.cc:3060] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.826759 11055 tablet_bootstrap.cc:654] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.827702 10922 leader_election.cc:290] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:38.827711 11056 raft_consensus.cc:359] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.828655 11056 raft_consensus.cc:385] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.828935 11056 raft_consensus.cc:740] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.829615 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a453a38c674d408aba9878f69bb388" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:38.829970 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a453a38c674d408aba9878f69bb388" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:38.830250 10727 raft_consensus.cc:2468] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:38.831362 10770 leader_election.cc:304] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
W20260709 13:03:38.832016 10767 leader_election.cc:343] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.832252 10922 raft_consensus.cc:2804] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.832645 10922 raft_consensus.cc:493] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.832762 11058 tablet_bootstrap.cc:492] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:38.833076 10922 raft_consensus.cc:3060] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.833331 11058 ts_tablet_manager.cc:1403] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.004s
I20260709 13:03:38.836283 11058 raft_consensus.cc:359] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.836354 11044 raft_consensus.cc:515] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.837013 11058 raft_consensus.cc:385] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.837352 11058 raft_consensus.cc:740] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.838075 10922 raft_consensus.cc:515] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.839013 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:38.829640 11056 consensus_queue.cc:260] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.840167 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:38.839023 11055 tablet_bootstrap.cc:492] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
W20260709 13:03:38.840593 10693 leader_election.cc:343] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.840679 10877 raft_consensus.cc:3060] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.841120 11055 ts_tablet_manager.cc:1403] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.003s
I20260709 13:03:38.841171 11044 leader_election.cc:290] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:38.843653 11058 consensus_queue.cc:260] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.844204 11056 ts_tablet_manager.cc:1434] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.005s
I20260709 13:03:38.845209 11056 tablet_bootstrap.cc:492] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:38.847143 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a453a38c674d408aba9878f69bb388" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:38.847759 10727 raft_consensus.cc:3060] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.849462 11058 ts_tablet_manager.cc:1434] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:03:38.850565 11058 tablet_bootstrap.cc:492] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:38.852308 11056 tablet_bootstrap.cc:654] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.854441 11075 raft_consensus.cc:493] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.855118 11075 raft_consensus.cc:515] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.857159 11058 tablet_bootstrap.cc:654] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.857589 10922 leader_election.cc:290] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:38.849092 11055 raft_consensus.cc:359] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.858981 11055 raft_consensus.cc:385] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.859418 11055 raft_consensus.cc:740] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.857393 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a453a38c674d408aba9878f69bb388" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:38.860374 11055 consensus_queue.cc:260] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.861291 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80b8863a4914dfa96691fd10ef07985" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
W20260709 13:03:38.861420 10767 leader_election.cc:343] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.862802 11075 leader_election.cc:290] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:38.863826 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80b8863a4914dfa96691fd10ef07985" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:38.863978 10877 raft_consensus.cc:2468] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:38.864881 11075 raft_consensus.cc:493] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:38.865180 10767 leader_election.cc:343] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.865442 11075 raft_consensus.cc:515] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
W20260709 13:03:38.865965 10770 leader_election.cc:343] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.866828 10692 leader_election.cc:304] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:38.867707 11055 ts_tablet_manager.cc:1434] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:03:38.868196 11044 raft_consensus.cc:2804] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.868705 11044 raft_consensus.cc:697] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:38.869305 11055 tablet_bootstrap.cc:492] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:38.869513 11044 consensus_queue.cc:237] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.874200 10727 raft_consensus.cc:2468] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 1.
I20260709 13:03:38.874436 10770 leader_election.cc:304] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609
I20260709 13:03:38.879863 10922 raft_consensus.cc:2749] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.883957 11055 tablet_bootstrap.cc:654] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.885958 10770 leader_election.cc:304] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: ec424be61499475db7217e8842759609
I20260709 13:03:38.887230 10922 raft_consensus.cc:2804] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.890333 11058 tablet_bootstrap.cc:492] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:38.889822 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884a930630a24604b59d2be5d7f21ada" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:38.891422 11058 ts_tablet_manager.cc:1403] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.003s
I20260709 13:03:38.891516 10727 raft_consensus.cc:2468] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:38.894222 10770 leader_election.cc:304] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:38.894544 10627 catalog_manager.cc:5697] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.895874 11075 leader_election.cc:290] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:38.896588 11075 raft_consensus.cc:2804] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.897338 11075 raft_consensus.cc:493] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.895884 11058 raft_consensus.cc:359] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.897455 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884a930630a24604b59d2be5d7f21ada" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:38.898371 11058 raft_consensus.cc:385] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.898913 10926 raft_consensus.cc:493] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.898955 11058 raft_consensus.cc:740] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.899629 10926 raft_consensus.cc:515] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.900228 11058 consensus_queue.cc:260] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.903635 10878 raft_consensus.cc:2468] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 0.
I20260709 13:03:38.905072 10926 leader_election.cc:290] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:38.905804 10926 raft_consensus.cc:493] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.913091 10926 raft_consensus.cc:515] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.916172 10926 leader_election.cc:290] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:38.908035 11058 ts_tablet_manager.cc:1434] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:03:38.916970 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:38.898332 11075 raft_consensus.cc:3060] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.918190 11058 tablet_bootstrap.cc:492] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609: Bootstrap starting.
W20260709 13:03:38.922034 10844 leader_election.cc:343] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.911481 11055 tablet_bootstrap.cc:492] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:38.923394 11055 ts_tablet_manager.cc:1403] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.000s
I20260709 13:03:38.924543 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5aff08160140138d11b32a4103c057" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:38.925173 10727 raft_consensus.cc:2468] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 0.
I20260709 13:03:38.927259 11055 raft_consensus.cc:359] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.928264 11055 raft_consensus.cc:385] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.928011 11075 raft_consensus.cc:515] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.928680 10844 leader_election.cc:304] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:38.929491 10926 raft_consensus.cc:2804] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.929932 10926 raft_consensus.cc:493] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.930133 11075 leader_election.cc:290] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:38.930366 10926 raft_consensus.cc:3060] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.931331 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884a930630a24604b59d2be5d7f21ada" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:38.931908 10877 raft_consensus.cc:3060] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.928658 11055 raft_consensus.cc:740] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.936282 11055 consensus_queue.cc:260] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.939991 10877 raft_consensus.cc:2468] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 1.
W20260709 13:03:38.940176 10770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43801, user_credentials={real_user=slave}} blocked reactor thread for 46035.8us
I20260709 13:03:38.941087 10767 leader_election.cc:304] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:38.943397 11055 ts_tablet_manager.cc:1434] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:03:38.946147 11055 tablet_bootstrap.cc:492] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:38.943521 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:38.948001 10804 raft_consensus.cc:2468] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 0.
I20260709 13:03:38.949610 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5aff08160140138d11b32a4103c057" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:38.950325 10804 raft_consensus.cc:2468] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 0.
I20260709 13:03:38.956266 11055 tablet_bootstrap.cc:654] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.957892 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884a930630a24604b59d2be5d7f21ada" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:38.958634 10842 leader_election.cc:304] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:38.958701 10727 raft_consensus.cc:3060] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.961525 10922 raft_consensus.cc:697] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:38.961913 11079 raft_consensus.cc:2804] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.962445 11079 raft_consensus.cc:697] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:38.962774 11056 tablet_bootstrap.cc:492] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:38.963090 11083 raft_consensus.cc:2804] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.963279 11056 ts_tablet_manager.cc:1403] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.118s	user 0.065s	sys 0.051s
I20260709 13:03:38.963505 11083 raft_consensus.cc:493] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.964022 11083 raft_consensus.cc:3060] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.966434 11056 raft_consensus.cc:359] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.967218 11056 raft_consensus.cc:385] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.967550 11056 raft_consensus.cc:740] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.968277 11056 consensus_queue.cc:260] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.969357 10727 raft_consensus.cc:2468] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 1.
I20260709 13:03:38.963251 11079 consensus_queue.cc:237] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.970623 11056 ts_tablet_manager.cc:1434] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:03:38.962774 10922 consensus_queue.cc:237] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.972200 10926 raft_consensus.cc:515] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.972697 11056 tablet_bootstrap.cc:492] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:38.971002 11058 tablet_bootstrap.cc:654] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.977907 11044 raft_consensus.cc:493] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.971669 11083 raft_consensus.cc:515] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.985292 11044 raft_consensus.cc:515] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.981769 11056 tablet_bootstrap.cc:654] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.988516 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c199431f4f4c2888707f6e2c664769" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:38.989066 10926 leader_election.cc:290] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
W20260709 13:03:38.990017 10693 leader_election.cc:343] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.990419 11083 leader_election.cc:290] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:38.992624 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5aff08160140138d11b32a4103c057" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:38.992713 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:38.993280 10729 raft_consensus.cc:3060] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.993691 11058 tablet_bootstrap.cc:492] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:38.994237 11058 ts_tablet_manager.cc:1403] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.002s
W20260709 13:03:38.994195 10844 leader_election.cc:343] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.997184 11044 leader_election.cc:290] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:38.997366 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c199431f4f4c2888707f6e2c664769" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:38.997942 10877 raft_consensus.cc:2468] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:38.997598 11058 raft_consensus.cc:359] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:38.998642 11058 raft_consensus.cc:385] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.999002 11058 raft_consensus.cc:740] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.999079 10692 leader_election.cc:304] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:39.000166 11058 consensus_queue.cc:260] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.000653 11063 raft_consensus.cc:2804] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:39.001153 11063 raft_consensus.cc:493] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.001483 11063 raft_consensus.cc:3060] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.002282 10729 raft_consensus.cc:2468] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 1.
I20260709 13:03:39.002825 11058 ts_tablet_manager.cc:1434] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:03:39.003741 11058 tablet_bootstrap.cc:492] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:39.003682 10844 leader_election.cc:304] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:39.004639 11056 tablet_bootstrap.cc:492] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:39.004562 10926 raft_consensus.cc:2804] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.005185 11056 ts_tablet_manager.cc:1403] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 13:03:39.005188 10926 raft_consensus.cc:697] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Becoming Leader. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:39.008878 11056 raft_consensus.cc:359] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.009605 11056 raft_consensus.cc:385] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.009893 11056 raft_consensus.cc:740] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.009872 10926 consensus_queue.cc:237] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.010839 11056 consensus_queue.cc:260] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.012838 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.013454 11056 ts_tablet_manager.cc:1434] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:39.013521 10804 raft_consensus.cc:3060] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.014853 11056 tablet_bootstrap.cc:492] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:39.021394 11056 tablet_bootstrap.cc:654] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.025076 11063 raft_consensus.cc:515] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.027295 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5aff08160140138d11b32a4103c057" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.028173 10803 raft_consensus.cc:3060] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.027226 11058 tablet_bootstrap.cc:654] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.037778 10803 raft_consensus.cc:2468] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 1.
I20260709 13:03:39.043128 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c199431f4f4c2888707f6e2c664769" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.043629 10877 raft_consensus.cc:3060] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.046329 10627 catalog_manager.cc:5697] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec424be61499475db7217e8842759609 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ec424be61499475db7217e8842759609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.049768 10877 raft_consensus.cc:2468] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:39.050944 10692 leader_election.cc:304] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:39.055933 11044 raft_consensus.cc:493] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.022403 10804 raft_consensus.cc:2468] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 1.
I20260709 13:03:39.060353 10842 leader_election.cc:304] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:39.061304 10926 raft_consensus.cc:2804] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.062937 10926 raft_consensus.cc:697] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Becoming Leader. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:39.063627 11063 leader_election.cc:290] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.059260 11044 raft_consensus.cc:515] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.064232 10926 consensus_queue.cc:237] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.068214 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df8946824d448f9f35583d27043ce0" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
W20260709 13:03:39.069998 10692 leader_election.cc:343] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:39.071997 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df8946824d448f9f35583d27043ce0" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:39.072633 10804 raft_consensus.cc:2468] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:39.060776 11058 tablet_bootstrap.cc:492] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:39.073464 11093 raft_consensus.cc:493] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.073916 10693 leader_election.cc:304] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: ec424be61499475db7217e8842759609
I20260709 13:03:39.074105 11093 raft_consensus.cc:515] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.074761 11063 raft_consensus.cc:2804] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:39.075138 11063 raft_consensus.cc:493] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.075490 11063 raft_consensus.cc:3060] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.077687 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80b8863a4914dfa96691fd10ef07985" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
W20260709 13:03:39.079102 10692 leader_election.cc:343] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:39.061643 11095 raft_consensus.cc:2804] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.080166 11095 raft_consensus.cc:697] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.081023 11095 consensus_queue.cc:237] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.073532 11058 ts_tablet_manager.cc:1403] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.000s
I20260709 13:03:39.083670 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80b8863a4914dfa96691fd10ef07985" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:39.084270 10804 raft_consensus.cc:2468] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:39.085055 10627 catalog_manager.cc:5697] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec424be61499475db7217e8842759609 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ec424be61499475db7217e8842759609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.085510 10693 leader_election.cc:304] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: ec424be61499475db7217e8842759609
I20260709 13:03:39.072528 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c199431f4f4c2888707f6e2c664769" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.088383 10803 raft_consensus.cc:3060] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.085466 11058 raft_consensus.cc:359] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.089919 11058 raft_consensus.cc:385] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.090770 11091 raft_consensus.cc:2804] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:39.091267 11091 raft_consensus.cc:493] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.091744 11091 raft_consensus.cc:3060] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.090289 11058 raft_consensus.cc:740] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.095940 11063 raft_consensus.cc:515] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.098124 11063 leader_election.cc:290] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.099684 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df8946824d448f9f35583d27043ce0" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.100153 11044 leader_election.cc:290] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.100293 10804 raft_consensus.cc:3060] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.099551 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df8946824d448f9f35583d27043ce0" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
W20260709 13:03:39.102027 10692 leader_election.cc:343] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec424be61499475db7217e8842759609 (127.0.107.195:35161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:39.103004 11058 consensus_queue.cc:260] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.109190 11058 ts_tablet_manager.cc:1434] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:39.109846 11055 tablet_bootstrap.cc:492] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:39.110422 11058 tablet_bootstrap.cc:492] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609: Bootstrap starting.
I20260709 13:03:39.110699 11055 ts_tablet_manager.cc:1403] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.165s	user 0.021s	sys 0.013s
I20260709 13:03:39.113533 11055 raft_consensus.cc:359] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.114243 11055 raft_consensus.cc:385] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.115981 11055 raft_consensus.cc:740] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.116653 11055 consensus_queue.cc:260] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.118713 11055 ts_tablet_manager.cc:1434] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:39.119607 11055 tablet_bootstrap.cc:492] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96: Bootstrap starting.
I20260709 13:03:39.113603 10627 catalog_manager.cc:5697] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.122087 11058 tablet_bootstrap.cc:654] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.134605 11058 tablet_bootstrap.cc:492] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609: No bootstrap required, opened a new log
I20260709 13:03:39.139525 11058 ts_tablet_manager.cc:1403] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.004s
I20260709 13:03:39.135205 10804 raft_consensus.cc:2468] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:39.140141 11056 tablet_bootstrap.cc:492] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:39.140658 11056 ts_tablet_manager.cc:1403] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.126s	user 0.032s	sys 0.088s
I20260709 13:03:39.137514 10803 raft_consensus.cc:2468] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:39.133111 11091 raft_consensus.cc:515] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.142099 11058 raft_consensus.cc:359] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.143263 11058 raft_consensus.cc:385] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.143522 11058 raft_consensus.cc:740] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.143445 11056 raft_consensus.cc:359] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.144160 11056 raft_consensus.cc:385] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.144445 11056 raft_consensus.cc:740] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.144263 11058 consensus_queue.cc:260] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.145051 11056 consensus_queue.cc:260] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.147166 11056 ts_tablet_manager.cc:1434] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:03:39.148028 11056 tablet_bootstrap.cc:492] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251: Bootstrap starting.
I20260709 13:03:39.147516 10693 leader_election.cc:304] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: ec424be61499475db7217e8842759609
I20260709 13:03:39.150501 11058 ts_tablet_manager.cc:1434] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:03:39.151032 11092 raft_consensus.cc:2804] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.150789 10627 catalog_manager.cc:5697] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.151500 11092 raft_consensus.cc:697] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.153126 11055 tablet_bootstrap.cc:654] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:39.133394 11093 leader_election.cc:290] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.153290 11092 consensus_queue.cc:237] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.158432 11056 tablet_bootstrap.cc:654] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:39.159832 10675 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:39.160287 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80b8863a4914dfa96691fd10ef07985" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.161017 10803 raft_consensus.cc:3060] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.155141 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80b8863a4914dfa96691fd10ef07985" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.164178 10877 raft_consensus.cc:3060] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.164714 11093 raft_consensus.cc:493] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.165164 11093 raft_consensus.cc:515] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.168185 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:39.168740 11093 leader_election.cc:290] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.170955 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:39.172259 10804 raft_consensus.cc:2393] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec16e68839f47c38eefc730712b7c96 in current term 1: Already voted for candidate ec424be61499475db7217e8842759609 in this term.
I20260709 13:03:39.173204 10693 leader_election.cc:304] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96; no voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:39.174150 11093 raft_consensus.cc:3060] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.177167 10877 raft_consensus.cc:2468] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:39.178231 10692 leader_election.cc:304] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:39.179126 11044 raft_consensus.cc:2804] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.179639 11044 raft_consensus.cc:697] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.180496 11044 consensus_queue.cc:237] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.153770 11091 leader_election.cc:290] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.184062 11093 raft_consensus.cc:2749] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:39.194114 10803 raft_consensus.cc:2468] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:39.200719 10625 catalog_manager.cc:5697] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.204980 11055 tablet_bootstrap.cc:492] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96: No bootstrap required, opened a new log
I20260709 13:03:39.205781 11055 ts_tablet_manager.cc:1403] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.031s
I20260709 13:03:39.208379 11056 tablet_bootstrap.cc:492] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251: No bootstrap required, opened a new log
I20260709 13:03:39.208837 11056 ts_tablet_manager.cc:1403] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.031s
I20260709 13:03:39.208678 11055 raft_consensus.cc:359] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.209375 11055 raft_consensus.cc:385] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.209695 11055 raft_consensus.cc:740] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.210331 11055 consensus_queue.cc:260] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.211505 11056 raft_consensus.cc:359] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.212286 11056 raft_consensus.cc:385] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:39.212495 11055 ts_tablet_manager.cc:1434] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:39.212543 11056 raft_consensus.cc:740] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Initialized, Role: FOLLOWER
I20260709 13:03:39.213428 11056 consensus_queue.cc:260] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.215430 11056 ts_tablet_manager.cc:1434] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:03:39.221292 10626 catalog_manager.cc:5697] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.222841 10626 catalog_manager.cc:5697] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.235867 11079 raft_consensus.cc:493] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.236330 11079 raft_consensus.cc:515] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.237994 11079 leader_election.cc:290] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.238691 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec16e68839f47c38eefc730712b7c96" is_pre_election: true
I20260709 13:03:39.239197 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:39.239898 10877 raft_consensus.cc:2393] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fb7a8d90f85e4a5697ab2933e4bc8251 in current term 1: Already voted for candidate 5ec16e68839f47c38eefc730712b7c96 in this term.
I20260709 13:03:39.240702 10767 leader_election.cc:304] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609
I20260709 13:03:39.241309 11079 raft_consensus.cc:3060] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.246276 11079 raft_consensus.cc:2749] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:39.261783 11092 consensus_queue.cc:1048] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.271957 11044 consensus_queue.cc:1048] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.297791 11044 raft_consensus.cc:493] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.298157 11044 raft_consensus.cc:515] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.300000 11044 leader_election.cc:290] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.300583 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b7730480fe433981d7e9201128732e" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" is_pre_election: true
I20260709 13:03:39.300822 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b7730480fe433981d7e9201128732e" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609" is_pre_election: true
I20260709 13:03:39.301172 10803 raft_consensus.cc:2468] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:39.301393 10877 raft_consensus.cc:2468] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 0.
I20260709 13:03:39.302201 10693 leader_election.cc:304] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:39.302904 11044 raft_consensus.cc:2804] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:39.303201 11044 raft_consensus.cc:493] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.303457 11044 raft_consensus.cc:3060] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.309803 11044 raft_consensus.cc:515] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.311806 11044 leader_election.cc:290] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.312353 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b7730480fe433981d7e9201128732e" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.312675 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b7730480fe433981d7e9201128732e" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.312901 10803 raft_consensus.cc:3060] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.313256 10877 raft_consensus.cc:3060] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.318061 10803 raft_consensus.cc:2468] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:39.318531 10877 raft_consensus.cc:2468] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 1.
I20260709 13:03:39.319082 10693 leader_election.cc:304] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:39.319912 11044 raft_consensus.cc:2804] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:39.320420 11044 raft_consensus.cc:697] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.321199 11044 consensus_queue.cc:237] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.328588 10625 catalog_manager.cc:5697] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.392892 10877 raft_consensus.cc:3060] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.395432 11079 consensus_queue.cc:1048] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.399895 11079 consensus_queue.cc:1048] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.406082 11075 consensus_queue.cc:1048] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.428161 11079 consensus_queue.cc:1048] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.465155 10803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "884a930630a24604b59d2be5d7f21ada"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
mode: GRACEFUL
new_leader_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:03:39.465669 10803 raft_consensus.cc:606] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Received request to transfer leadership to TS 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:39.470052 10876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f5aff08160140138d11b32a4103c057"
dest_uuid: "ec424be61499475db7217e8842759609"
mode: GRACEFUL
new_leader_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:03:39.470526 10876 raft_consensus.cc:606] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Received request to transfer leadership to TS 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:39.474996 10803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2a453a38c674d408aba9878f69bb388"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
mode: GRACEFUL
new_leader_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:60828
I20260709 13:03:39.475450 10803 raft_consensus.cc:606] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Received request to transfer leadership to TS 5ec16e68839f47c38eefc730712b7c96
I20260709 13:03:39.481863 10727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5df8946824d448f9f35583d27043ce0"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
mode: GRACEFUL
new_leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:03:39.482326 10727 raft_consensus.cc:606] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Received request to transfer leadership to TS fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:39.486620 10876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533"
dest_uuid: "ec424be61499475db7217e8842759609"
mode: GRACEFUL
new_leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:36828
I20260709 13:03:39.487128 10876 raft_consensus.cc:606] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Received request to transfer leadership to TS fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:39.491361 10727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48c199431f4f4c2888707f6e2c664769"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
mode: GRACEFUL
new_leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:03:39.491915 10727 raft_consensus.cc:606] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Received request to transfer leadership to TS fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:39.496306 10727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88b7730480fe433981d7e9201128732e"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
mode: GRACEFUL
new_leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:03:39.496687 10727 raft_consensus.cc:606] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Received request to transfer leadership to TS fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:39.500916 10727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
mode: GRACEFUL
new_leader_uuid: "ec424be61499475db7217e8842759609"
 from {username='slave'} at 127.0.0.1:56240
I20260709 13:03:39.501286 10727 raft_consensus.cc:606] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Received request to transfer leadership to TS ec424be61499475db7217e8842759609
I20260709 13:03:39.504565 10926 consensus_queue.cc:1048] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.513806 11083 consensus_queue.cc:1048] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.523200 11083 raft_consensus.cc:993] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609: : Instructing follower fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:39.523761 11115 raft_consensus.cc:1081] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Signalling peer fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:39.525250 10803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:42394
I20260709 13:03:39.525825 10803 raft_consensus.cc:493] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:39.526177 10803 raft_consensus.cc:3060] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.530550 10803 raft_consensus.cc:515] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.531992 10803 leader_election.cc:290] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.532732 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:39.532954 10876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b2f27d656f941818ccea9cbfb6dc533" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.533382 10727 raft_consensus.cc:3060] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.533591 10876 raft_consensus.cc:3055] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:39.533996 10876 raft_consensus.cc:740] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:39.534778 10876 consensus_queue.cc:260] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.535703 10876 raft_consensus.cc:3060] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.539453 10727 raft_consensus.cc:2468] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:39.540432 10770 leader_election.cc:304] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:39.541056 10876 raft_consensus.cc:2468] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:39.541254 11079 raft_consensus.cc:2804] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:39.541823 11079 raft_consensus.cc:697] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:39.542583 11079 consensus_queue.cc:237] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.544239 10876 raft_consensus.cc:3060] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:39.551008 11044 consensus_queue.cc:1048] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.551775 10626 catalog_manager.cc:5697] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 1 to 2, leader changed from ec424be61499475db7217e8842759609 (127.0.107.195) to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.565219 11091 consensus_queue.cc:1048] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.567281 11091 consensus_queue.cc:1048] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.581765 11044 consensus_queue.cc:1048] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.584431 11083 consensus_queue.cc:1048] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.587055 11044 raft_consensus.cc:993] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96: : Instructing follower fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:39.587656 11044 raft_consensus.cc:1081] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Signalling peer fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:39.589852 10804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5df8946824d448f9f35583d27043ce0"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:42398
I20260709 13:03:39.590313 10804 raft_consensus.cc:493] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:39.590638 10804 raft_consensus.cc:3060] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.592872 10926 raft_consensus.cc:993] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609: : Instructing follower 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:39.593358 11115 raft_consensus.cc:1081] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Signalling peer 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:39.596081 10729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f5aff08160140138d11b32a4103c057"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:46002
I20260709 13:03:39.596625 10729 raft_consensus.cc:493] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:39.597028 10729 raft_consensus.cc:3060] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.597944 11083 consensus_queue.cc:1048] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.605109 10729 raft_consensus.cc:515] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.606108 10727 raft_consensus.cc:1240] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Rejecting Update request from peer ec424be61499475db7217e8842759609 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:39.610157 10804 raft_consensus.cc:515] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.612742 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df8946824d448f9f35583d27043ce0" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:39.613291 10728 raft_consensus.cc:3055] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:39.613585 10728 raft_consensus.cc:740] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.615028 10729 leader_election.cc:290] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.615274 11091 raft_consensus.cc:993] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96: : Instructing follower fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:39.615717 11091 raft_consensus.cc:1081] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Signalling peer fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:39.615763 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5aff08160140138d11b32a4103c057" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.616142 10876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5aff08160140138d11b32a4103c057" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.616724 10876 raft_consensus.cc:3055] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:39.617028 10876 raft_consensus.cc:740] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:39.614317 10728 consensus_queue.cc:260] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.617540 10803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48c199431f4f4c2888707f6e2c664769"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:42398
I20260709 13:03:39.617810 10876 consensus_queue.cc:260] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.618124 10803 raft_consensus.cc:493] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:39.618148 10728 raft_consensus.cc:3060] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.618742 10803 raft_consensus.cc:3060] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.618839 10876 raft_consensus.cc:3060] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:39.618827 11083 consensus_queue.cc:1175] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ec16e68839f47c38eefc730712b7c96" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ec424be61499475db7217e8842759609 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:39.624826 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df8946824d448f9f35583d27043ce0" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.625389 10877 raft_consensus.cc:3060] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.625713 10876 raft_consensus.cc:2468] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:39.626878 10728 raft_consensus.cc:2468] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:39.627170 10692 leader_election.cc:304] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: fb7a8d90f85e4a5697ab2933e4bc8251
I20260709 13:03:39.628042 11044 raft_consensus.cc:2804] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:39.628469 11044 raft_consensus.cc:697] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.629377 10804 leader_election.cc:290] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.625742 10803 raft_consensus.cc:515] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.630579 10770 leader_election.cc:304] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:39.629380 11044 consensus_queue.cc:237] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.631541 11080 raft_consensus.cc:2804] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:39.631994 11080 raft_consensus.cc:697] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:39.632153 10803 leader_election.cc:290] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.632833 11080 consensus_queue.cc:237] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.638171 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c199431f4f4c2888707f6e2c664769" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:39.638751 10728 raft_consensus.cc:3055] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:39.639096 10728 raft_consensus.cc:740] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.639245 10876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c199431f4f4c2888707f6e2c664769" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.639885 10624 catalog_manager.cc:5697] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 1 to 2, leader changed from ec424be61499475db7217e8842759609 (127.0.107.195) to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.639921 10728 consensus_queue.cc:260] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.641295 10728 raft_consensus.cc:3060] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.639808 10876 raft_consensus.cc:3060] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.642731 10877 raft_consensus.cc:2468] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:39.647660 10728 raft_consensus.cc:2468] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:39.649318 10876 raft_consensus.cc:2468] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:39.650549 10770 leader_election.cc:304] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:39.652055 11080 raft_consensus.cc:2804] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:39.652500 11080 raft_consensus.cc:697] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:39.653262 11080 consensus_queue.cc:237] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.656400 10626 catalog_manager.cc:5697] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 1 to 2, leader changed from 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193) to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.667443 10626 catalog_manager.cc:5697] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 1 to 2, leader changed from 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193) to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.722744 11044 consensus_queue.cc:1048] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.732116 11044 consensus_queue.cc:1048] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.785660 11044 consensus_queue.cc:1048] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.793601 11044 consensus_queue.cc:1048] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.801910 11044 raft_consensus.cc:993] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96: : Instructing follower ec424be61499475db7217e8842759609 to start an election
I20260709 13:03:39.802346 11044 raft_consensus.cc:1081] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Signalling peer ec424be61499475db7217e8842759609 to start an election
I20260709 13:03:39.803170 11044 raft_consensus.cc:993] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96: : Instructing follower fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:39.803541 11044 raft_consensus.cc:1081] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Signalling peer fb7a8d90f85e4a5697ab2933e4bc8251 to start an election
I20260709 13:03:39.805132 10802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88b7730480fe433981d7e9201128732e"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
 from {username='slave'} at 127.0.0.1:42398
I20260709 13:03:39.805640 10802 raft_consensus.cc:493] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:39.806010 10802 raft_consensus.cc:3060] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.807933 10876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714"
dest_uuid: "ec424be61499475db7217e8842759609"
 from {username='slave'} at 127.0.0.1:35796
I20260709 13:03:39.808511 10876 raft_consensus.cc:493] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:39.808876 10876 raft_consensus.cc:3060] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.813884 10802 raft_consensus.cc:515] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.815598 10876 raft_consensus.cc:515] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.816704 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b7730480fe433981d7e9201128732e" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:39.816140 10802 leader_election.cc:290] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.816995 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b7730480fe433981d7e9201128732e" candidate_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.817292 10728 raft_consensus.cc:3055] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:39.817610 10877 raft_consensus.cc:3060] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.817647 10728 raft_consensus.cc:740] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.817674 10876 leader_election.cc:290] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:39.818593 10728 consensus_queue.cc:260] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.820211 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.820855 10728 raft_consensus.cc:3060] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.820976 10802 raft_consensus.cc:3060] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.818610 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcbaf056b5744e1f9ee2190fc6a8a714" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:39.822304 10729 raft_consensus.cc:3055] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:39.822602 10729 raft_consensus.cc:740] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.823387 10729 consensus_queue.cc:260] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.824085 10877 raft_consensus.cc:2468] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:39.824657 10729 raft_consensus.cc:3060] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.825232 10767 leader_election.cc:304] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec424be61499475db7217e8842759609, fb7a8d90f85e4a5697ab2933e4bc8251; no voters: 
I20260709 13:03:39.826936 11080 raft_consensus.cc:2804] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:39.827391 11080 raft_consensus.cc:697] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Becoming Leader. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:39.828192 11080 consensus_queue.cc:237] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.828769 10728 raft_consensus.cc:2468] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb7a8d90f85e4a5697ab2933e4bc8251 in term 2.
I20260709 13:03:39.832060 10729 raft_consensus.cc:2468] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 2.
I20260709 13:03:39.833341 10844 leader_election.cc:304] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:39.834118 11083 raft_consensus.cc:2804] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:39.834568 11083 raft_consensus.cc:697] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 2 LEADER]: Becoming Leader. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:39.835162 10802 raft_consensus.cc:2468] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 2.
I20260709 13:03:39.835402 11083 consensus_queue.cc:237] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.837751 10624 catalog_manager.cc:5697] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 reported cstate change: term changed from 1 to 2, leader changed from 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193) to fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.841523 10626 catalog_manager.cc:5697] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 reported cstate change: term changed from 1 to 2, leader changed from 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193) to ec424be61499475db7217e8842759609 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ec424be61499475db7217e8842759609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.878377 11080 raft_consensus.cc:993] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251: : Instructing follower 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:39.878923 11075 raft_consensus.cc:1081] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Signalling peer 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:39.880316 10729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2a453a38c674d408aba9878f69bb388"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:46014
I20260709 13:03:39.880868 10729 raft_consensus.cc:493] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:39.881228 10729 raft_consensus.cc:3060] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.885983 10729 raft_consensus.cc:515] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.887578 10729 leader_election.cc:290] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.888289 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a453a38c674d408aba9878f69bb388" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.888650 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a453a38c674d408aba9878f69bb388" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.888938 10802 raft_consensus.cc:3055] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:39.889247 10877 raft_consensus.cc:3060] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.889273 10802 raft_consensus.cc:740] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:39.890249 10802 consensus_queue.cc:260] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.891554 10802 raft_consensus.cc:3060] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.895677 10877 raft_consensus.cc:2468] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:39.896730 10692 leader_election.cc:304] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:39.897395 11091 raft_consensus.cc:2804] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:39.897879 11091 raft_consensus.cc:697] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.897886 10802 raft_consensus.cc:2468] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:39.898846 11091 consensus_queue.cc:237] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.905855 10626 catalog_manager.cc:5697] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 1 to 2, leader changed from fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194) to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.937423 11080 raft_consensus.cc:993] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251: : Instructing follower 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:39.937865 11075 raft_consensus.cc:1081] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Signalling peer 5ec16e68839f47c38eefc730712b7c96 to start an election
I20260709 13:03:39.939136 10729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "884a930630a24604b59d2be5d7f21ada"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
 from {username='slave'} at 127.0.0.1:46014
I20260709 13:03:39.939610 10729 raft_consensus.cc:493] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:39.939929 10729 raft_consensus.cc:3060] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.944789 10877 raft_consensus.cc:1275] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.944890 10729 raft_consensus.cc:515] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.946036 11075 consensus_queue.cc:1048] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.947202 10729 leader_election.cc:290] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Requested vote from peers fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593), ec424be61499475db7217e8842759609 (127.0.107.195:35161)
I20260709 13:03:39.947491 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884a930630a24604b59d2be5d7f21ada" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:39.947746 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884a930630a24604b59d2be5d7f21ada" candidate_uuid: "5ec16e68839f47c38eefc730712b7c96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec424be61499475db7217e8842759609"
I20260709 13:03:39.948086 10802 raft_consensus.cc:3055] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:39.948227 10877 raft_consensus.cc:3060] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.948436 10802 raft_consensus.cc:740] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:39.949251 10802 consensus_queue.cc:260] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.950451 10802 raft_consensus.cc:3060] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.955418 10877 raft_consensus.cc:2468] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:39.956823 10692 leader_election.cc:304] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:39.957214 10802 raft_consensus.cc:2468] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec16e68839f47c38eefc730712b7c96 in term 2.
I20260709 13:03:39.957515 10729 raft_consensus.cc:1275] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.957590 11044 raft_consensus.cc:2804] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:39.958436 11044 raft_consensus.cc:697] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:39.959227 11080 consensus_queue.cc:1048] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.959268 11044 consensus_queue.cc:237] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:39.968777 10626 catalog_manager.cc:5697] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 reported cstate change: term changed from 1 to 2, leader changed from fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194) to 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "5ec16e68839f47c38eefc730712b7c96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:40.014850 10802 raft_consensus.cc:3060] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.018941 10877 raft_consensus.cc:1275] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.020273 11044 consensus_queue.cc:1048] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.020730 10802 raft_consensus.cc:1275] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.021679 10729 raft_consensus.cc:1275] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.022208 11044 consensus_queue.cc:1048] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.022989 11080 consensus_queue.cc:1048] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.036686 10876 raft_consensus.cc:1275] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.041261 11080 consensus_queue.cc:1048] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.078349 10876 raft_consensus.cc:1275] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.079484 11080 consensus_queue.cc:1048] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.086499 10729 raft_consensus.cc:1275] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.089579 11080 consensus_queue.cc:1048] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.216964 10729 raft_consensus.cc:1275] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Refusing update from remote peer ec424be61499475db7217e8842759609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.218109 11083 consensus_queue.cc:1048] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.226960 10802 raft_consensus.cc:1275] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer ec424be61499475db7217e8842759609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.228235 11127 consensus_queue.cc:1048] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.233572 10729 raft_consensus.cc:1275] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.234779 11080 consensus_queue.cc:1048] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.242522 10877 raft_consensus.cc:1275] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer fb7a8d90f85e4a5697ab2933e4bc8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.243934 11075 consensus_queue.cc:1048] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.318874 10802 raft_consensus.cc:1275] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.319995 11044 consensus_queue.cc:1048] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.326601 10877 raft_consensus.cc:1275] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.327929 11092 consensus_queue.cc:1048] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.387024 10877 raft_consensus.cc:1275] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.388069 11093 consensus_queue.cc:1048] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.395784 10802 raft_consensus.cc:1275] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Refusing update from remote peer 5ec16e68839f47c38eefc730712b7c96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.397164 11091 consensus_queue.cc:1048] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.713629 10625 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40640:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:03:42.735704 10625 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40640:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:03:42.758699   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:43.019752 11168 tablet.cc:1724] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.025547 11169 tablet.cc:1724] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.031703 10625 catalog_manager.cc:5789] TS 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801) does not have the latest schema for tablet a80b8863a4914dfa96691fd10ef07985 (table soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]). Expected version 1 got 0
I20260709 13:03:43.049620 10625 catalog_manager.cc:5789] TS 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801) does not have the latest schema for tablet 1f5aff08160140138d11b32a4103c057 (table soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]). Expected version 1 got 0
I20260709 13:03:43.050325 10625 catalog_manager.cc:5789] TS 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801) does not have the latest schema for tablet 884a930630a24604b59d2be5d7f21ada (table soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]). Expected version 1 got 0
I20260709 13:03:43.052141 10625 catalog_manager.cc:5789] TS 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801) does not have the latest schema for tablet e2a453a38c674d408aba9878f69bb388 (table soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]). Expected version 1 got 0
I20260709 13:03:43.082106 10724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c"
dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
mode: GRACEFUL
new_leader_uuid: "ec424be61499475db7217e8842759609"
 from {username='slave'} at 127.0.0.1:56256
I20260709 13:03:43.083384 10724 raft_consensus.cc:606] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Received request to transfer leadership to TS ec424be61499475db7217e8842759609
I20260709 13:03:43.025915 11177 tablet.cc:1724] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:43.111830 11165 log.cc:927] Time spent T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:03:43.122428 11178 tablet.cc:1724] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.099911 11185 tablet.cc:1724] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.166630 11195 tablet.cc:1724] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.189064 11177 tablet.cc:1724] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.192931 11192 tablet.cc:1724] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.196553 11196 tablet.cc:1724] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.200712 11169 tablet.cc:1724] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.148454 11197 tablet.cc:1724] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.197027 11168 tablet.cc:1724] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.212653 10625 catalog_manager.cc:5789] TS fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593) does not have the latest schema for tablet 2b2f27d656f941818ccea9cbfb6dc533 (table soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]). Expected version 1 got 0
I20260709 13:03:43.216118 10624 catalog_manager.cc:5789] TS ec424be61499475db7217e8842759609 (127.0.107.195:35161) does not have the latest schema for tablet fcbaf056b5744e1f9ee2190fc6a8a714 (table soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd]). Expected version 1 got 0
I20260709 13:03:43.224555 11200 tablet.cc:1724] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.226773 11201 tablet.cc:1724] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.230438 11185 tablet.cc:1724] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.221690 11198 tablet.cc:1724] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.237231 11168 tablet.cc:1724] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.237416 11169 tablet.cc:1724] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.247413 11195 tablet.cc:1724] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.214929 11178 tablet.cc:1724] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.256938 10800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c616781e3e9d4730884eff5393860171"
dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
mode: GRACEFUL
new_leader_uuid: "ec424be61499475db7217e8842759609"
 from {username='slave'} at 127.0.0.1:60830
I20260709 13:03:43.257699 10800 raft_consensus.cc:606] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 LEADER]: Received request to transfer leadership to TS ec424be61499475db7217e8842759609
I20260709 13:03:43.260387   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:43.261056   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:43.261161 11195 tablet.cc:1724] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.281563 11201 tablet.cc:1724] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.284111 11192 tablet.cc:1724] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.293537 11200 tablet.cc:1724] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.295258 11196 tablet.cc:1724] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.306270 11079 raft_consensus.cc:993] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251: : Instructing follower ec424be61499475db7217e8842759609 to start an election
I20260709 13:03:43.306820 11079 raft_consensus.cc:1081] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 LEADER]: Signalling peer ec424be61499475db7217e8842759609 to start an election
I20260709 13:03:43.309721 10872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c616781e3e9d4730884eff5393860171"
dest_uuid: "ec424be61499475db7217e8842759609"
 from {username='slave'} at 127.0.0.1:35780
I20260709 13:03:43.310360 10872 raft_consensus.cc:493] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:43.310837 10872 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:43.313270 11198 tablet.cc:1724] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.318624 11200 tablet.cc:1724] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:43.335402 10872 raft_consensus.cc:515] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:43.337900 10872 leader_election.cc:290] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:43.338930 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:43.339021 10800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c616781e3e9d4730884eff5393860171" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:43.339879 10727 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:43.339938 10800 raft_consensus.cc:3055] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:43.340404 10800 raft_consensus.cc:740] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fb7a8d90f85e4a5697ab2933e4bc8251, State: Running, Role: LEADER
I20260709 13:03:43.341552 10800 consensus_queue.cc:260] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:43.343432 10800 raft_consensus.cc:3060] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:43.345408 11180 raft_consensus.cc:993] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96: : Instructing follower ec424be61499475db7217e8842759609 to start an election
I20260709 13:03:43.345961 11180 raft_consensus.cc:1081] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Signalling peer ec424be61499475db7217e8842759609 to start an election
I20260709 13:03:43.348232 10875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c"
dest_uuid: "ec424be61499475db7217e8842759609"
 from {username='slave'} at 127.0.0.1:35796
I20260709 13:03:43.348801 10875 raft_consensus.cc:493] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:43.349159 10875 raft_consensus.cc:3060] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.349718 10727 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 4.
I20260709 13:03:43.351281 10844 leader_election.cc:304] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:43.352205 11127 raft_consensus.cc:2804] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:43.352300 10800 raft_consensus.cc:2468] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 4.
I20260709 13:03:43.352715 11127 raft_consensus.cc:697] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 4 LEADER]: Becoming Leader. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:43.353698 11127 consensus_queue.cc:237] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:43.357199 10875 raft_consensus.cc:515] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:43.360399 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ec16e68839f47c38eefc730712b7c96"
I20260709 13:03:43.360972 10727 raft_consensus.cc:3055] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:43.361208 10875 leader_election.cc:290] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801), fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593)
I20260709 13:03:43.361833 10727 raft_consensus.cc:740] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec16e68839f47c38eefc730712b7c96, State: Running, Role: LEADER
I20260709 13:03:43.362833 10727 consensus_queue.cc:260] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:43.364094 10800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf4a1578b245d0b12586d8313c428c" candidate_uuid: "ec424be61499475db7217e8842759609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251"
I20260709 13:03:43.364565 10727 raft_consensus.cc:3060] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.364976 10800 raft_consensus.cc:3060] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.370872 10727 raft_consensus.cc:2468] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 3.
I20260709 13:03:43.369938 10625 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c: soft_deleted_table [id=e7d4601ee5fa4d34a25ee40e5ac828bd] alter complete (version 1)
I20260709 13:03:43.372568 10800 raft_consensus.cc:2468] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec424be61499475db7217e8842759609 in term 3.
I20260709 13:03:43.372954 10844 leader_election.cc:304] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec16e68839f47c38eefc730712b7c96, ec424be61499475db7217e8842759609; no voters: 
I20260709 13:03:43.374018 11127 raft_consensus.cc:2804] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:43.374549 11127 raft_consensus.cc:697] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 3 LEADER]: Becoming Leader. State: Replica: ec424be61499475db7217e8842759609, State: Running, Role: LEADER
I20260709 13:03:43.375492 11127 consensus_queue.cc:237] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } }
I20260709 13:03:43.379913 10625 catalog_manager.cc:5697] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 reported cstate change: term changed from 3 to 4, leader changed from fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194) to ec424be61499475db7217e8842759609 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "ec424be61499475db7217e8842759609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.392553 10625 catalog_manager.cc:5697] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 reported cstate change: term changed from 2 to 3, leader changed from 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193) to ec424be61499475db7217e8842759609 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ec424be61499475db7217e8842759609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec424be61499475db7217e8842759609" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35161 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:43.411113 10899 debug-util.cc:398] Leaking SignalData structure 0x7b080000acc0 after lost signal to thread 434
W20260709 13:03:43.412396 10899 debug-util.cc:398] Leaking SignalData structure 0x7b080030dd00 after lost signal to thread 10661
W20260709 13:03:43.415674 10899 debug-util.cc:398] Leaking SignalData structure 0x7b080005e540 after lost signal to thread 10902
I20260709 13:03:43.795464 10801 raft_consensus.cc:1275] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 FOLLOWER]: Refusing update from remote peer ec424be61499475db7217e8842759609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:43.797273 11127 consensus_queue.cc:1048] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:43.810638 10727 raft_consensus.cc:1275] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 3 FOLLOWER]: Refusing update from remote peer ec424be61499475db7217e8842759609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:43.817124 11183 consensus_queue.cc:1048] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:43.922211 10727 raft_consensus.cc:1275] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 4 FOLLOWER]: Refusing update from remote peer ec424be61499475db7217e8842759609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:43.923671 11183 consensus_queue.cc:1048] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec16e68839f47c38eefc730712b7c96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:43.936594 10801 raft_consensus.cc:1275] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 4 FOLLOWER]: Refusing update from remote peer ec424be61499475db7217e8842759609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:43.938649 11127 consensus_queue.cc:1048] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a8d90f85e4a5697ab2933e4bc8251" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:44.320201   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:44.334482 10770 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 13:03:44.347178 10770 consensus_peers.cc:597] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 -> Peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Couldn't send request to peer 5ec16e68839f47c38eefc730712b7c96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.360539   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:44.361389   431 tablet_replica.cc:333] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.362202   431 raft_consensus.cc:2243] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.362783   431 raft_consensus.cc:2272] T 88b7730480fe433981d7e9201128732e P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.365283   431 tablet_replica.cc:333] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.366173   431 raft_consensus.cc:2243] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.367267   431 raft_consensus.cc:2272] T a80b8863a4914dfa96691fd10ef07985 P 5ec16e68839f47c38eefc730712b7c96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.369968   431 tablet_replica.cc:333] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.370761   431 raft_consensus.cc:2243] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:44.371017 10770 consensus_peers.cc:597] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 -> Peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Couldn't send request to peer 5ec16e68839f47c38eefc730712b7c96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.371376   431 raft_consensus.cc:2272] T f5df8946824d448f9f35583d27043ce0 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.373930   431 tablet_replica.cc:333] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.374611   431 raft_consensus.cc:2243] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.375108   431 raft_consensus.cc:2272] T 48c199431f4f4c2888707f6e2c664769 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.377240   431 tablet_replica.cc:333] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.377841   431 raft_consensus.cc:2243] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.378578   431 raft_consensus.cc:2272] T 1f5aff08160140138d11b32a4103c057 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.381273   431 tablet_replica.cc:333] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.382076   431 raft_consensus.cc:2243] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.383213   431 raft_consensus.cc:2272] T e2a453a38c674d408aba9878f69bb388 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.385780   431 tablet_replica.cc:333] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.386407   431 raft_consensus.cc:2243] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.386849   431 raft_consensus.cc:2272] T 2b2f27d656f941818ccea9cbfb6dc533 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.388929   431 tablet_replica.cc:333] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.389588   431 raft_consensus.cc:2243] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.390040   431 raft_consensus.cc:2272] T 09c9bb6fbe7849b19c4618982ffec63f P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.392519   431 tablet_replica.cc:333] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.393045   431 raft_consensus.cc:2243] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.393532   431 raft_consensus.cc:2272] T fca0492e8d6b4f9d8222c92a0e604901 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.395969   431 tablet_replica.cc:333] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.396500   431 raft_consensus.cc:2243] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.397403   431 raft_consensus.cc:2272] T 0ba95b0ae3a44536bf292beca934fffe P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.399991   431 tablet_replica.cc:333] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.400547   431 raft_consensus.cc:2243] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.401391   431 raft_consensus.cc:2272] T 4ede29f0e5414131b44056468158fd15 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.403625   431 tablet_replica.cc:333] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.404160   431 raft_consensus.cc:2243] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.404902   431 raft_consensus.cc:2272] T 884a930630a24604b59d2be5d7f21ada P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.407038   431 tablet_replica.cc:333] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.407574   431 raft_consensus.cc:2243] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.407969   431 raft_consensus.cc:2272] T 97bf4a1578b245d0b12586d8313c428c P 5ec16e68839f47c38eefc730712b7c96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.410387   431 tablet_replica.cc:333] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.410964   431 raft_consensus.cc:2243] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.411458   431 raft_consensus.cc:2272] T 3966b43f418e499e9e0b614f4d681720 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.413558   431 tablet_replica.cc:333] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.414057   431 raft_consensus.cc:2243] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.414528   431 raft_consensus.cc:2272] T c616781e3e9d4730884eff5393860171 P 5ec16e68839f47c38eefc730712b7c96 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.417505   431 tablet_replica.cc:333] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.418045   431 raft_consensus.cc:2243] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.418512   431 raft_consensus.cc:2272] T fcbaf056b5744e1f9ee2190fc6a8a714 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.420763   431 tablet_replica.cc:333] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.421214   431 raft_consensus.cc:2243] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.421737   431 raft_consensus.cc:2272] T 81a44e0477fe43b0bee6903f79c01141 P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.424324   431 tablet_replica.cc:333] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96: stopping tablet replica
I20260709 13:03:44.424793   431 raft_consensus.cc:2243] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.425633   431 raft_consensus.cc:2272] T 6b1ee054575f49a382f11ad9b5b7647b P 5ec16e68839f47c38eefc730712b7c96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.455165 10844 consensus_peers.cc:597] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 -> Peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Couldn't send request to peer 5ec16e68839f47c38eefc730712b7c96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.469730   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:44.493266 10770 consensus_peers.cc:597] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 -> Peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Couldn't send request to peer 5ec16e68839f47c38eefc730712b7c96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.513983   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:44.531101 10770 consensus_peers.cc:597] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 -> Peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Couldn't send request to peer 5ec16e68839f47c38eefc730712b7c96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.543870 10842 consensus_peers.cc:597] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 -> Peer fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593): Couldn't send request to peer fb7a8d90f85e4a5697ab2933e4bc8251. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.545887 10770 consensus_peers.cc:597] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 -> Peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Couldn't send request to peer 5ec16e68839f47c38eefc730712b7c96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.555007 10844 consensus_peers.cc:597] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 -> Peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Couldn't send request to peer 5ec16e68839f47c38eefc730712b7c96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.566622   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:44.567677   431 tablet_replica.cc:333] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.568702   431 raft_consensus.cc:2243] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.569305   431 raft_consensus.cc:2272] T fcbaf056b5744e1f9ee2190fc6a8a714 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.571499   431 tablet_replica.cc:333] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.572077   431 raft_consensus.cc:2243] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.572865   431 raft_consensus.cc:2272] T 48c199431f4f4c2888707f6e2c664769 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.575106   431 tablet_replica.cc:333] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.575832   431 raft_consensus.cc:2243] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.576589   431 raft_consensus.cc:2272] T f5df8946824d448f9f35583d27043ce0 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.578751   431 tablet_replica.cc:333] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.579339   431 raft_consensus.cc:2243] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.579767   431 raft_consensus.cc:2272] T 1f5aff08160140138d11b32a4103c057 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.581909   431 tablet_replica.cc:333] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.582535   431 raft_consensus.cc:2243] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.583312   431 raft_consensus.cc:2272] T 88b7730480fe433981d7e9201128732e P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.587178   431 tablet_replica.cc:333] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.587718   431 raft_consensus.cc:2243] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.588201   431 raft_consensus.cc:2272] T a80b8863a4914dfa96691fd10ef07985 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.590198   431 tablet_replica.cc:333] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.590801   431 raft_consensus.cc:2243] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.591578   431 raft_consensus.cc:2272] T 2b2f27d656f941818ccea9cbfb6dc533 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.594449   431 tablet_replica.cc:333] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.595227   431 raft_consensus.cc:2243] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.596275   431 raft_consensus.cc:2272] T 09c9bb6fbe7849b19c4618982ffec63f P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.596517 10842 consensus_peers.cc:597] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 -> Peer fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593): Couldn't send request to peer fb7a8d90f85e4a5697ab2933e4bc8251. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.598595   431 tablet_replica.cc:333] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.599289   431 raft_consensus.cc:2243] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.600050   431 raft_consensus.cc:2272] T fca0492e8d6b4f9d8222c92a0e604901 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.602329   431 tablet_replica.cc:333] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.602905   431 raft_consensus.cc:2243] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.603355   431 raft_consensus.cc:2272] T 3966b43f418e499e9e0b614f4d681720 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.605562   431 tablet_replica.cc:333] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.606081   431 raft_consensus.cc:2243] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.606483   431 raft_consensus.cc:2272] T c616781e3e9d4730884eff5393860171 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.609041   431 tablet_replica.cc:333] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.609583   431 raft_consensus.cc:2243] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.610163   431 raft_consensus.cc:2272] T 884a930630a24604b59d2be5d7f21ada P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.613009   431 tablet_replica.cc:333] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.613883   431 raft_consensus.cc:2243] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.614418   431 raft_consensus.cc:2272] T 4ede29f0e5414131b44056468158fd15 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.616539   431 tablet_replica.cc:333] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.617067   431 raft_consensus.cc:2243] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.617484   431 raft_consensus.cc:2272] T 97bf4a1578b245d0b12586d8313c428c P fb7a8d90f85e4a5697ab2933e4bc8251 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.619997   431 tablet_replica.cc:333] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.620576   431 raft_consensus.cc:2243] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.621007   431 raft_consensus.cc:2272] T 0ba95b0ae3a44536bf292beca934fffe P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.622956   431 tablet_replica.cc:333] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.623418   431 raft_consensus.cc:2243] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.623940   431 raft_consensus.cc:2272] T e2a453a38c674d408aba9878f69bb388 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.625875   431 tablet_replica.cc:333] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.626371   431 raft_consensus.cc:2243] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.627245   431 raft_consensus.cc:2272] T 81a44e0477fe43b0bee6903f79c01141 P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.629554   431 tablet_replica.cc:333] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251: stopping tablet replica
I20260709 13:03:44.630036   431 raft_consensus.cc:2243] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.630466   431 raft_consensus.cc:2272] T 6b1ee054575f49a382f11ad9b5b7647b P fb7a8d90f85e4a5697ab2933e4bc8251 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.658782 10844 consensus_peers.cc:597] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 -> Peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Couldn't send request to peer 5ec16e68839f47c38eefc730712b7c96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.663271   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:44.723037   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:44.743464 10842 consensus_peers.cc:597] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 -> Peer fb7a8d90f85e4a5697ab2933e4bc8251 (127.0.107.194:45593): Couldn't send request to peer fb7a8d90f85e4a5697ab2933e4bc8251. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.755887   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:44.756887   431 tablet_replica.cc:333] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.757917   431 raft_consensus.cc:2243] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.758507   431 raft_consensus.cc:2272] T f5df8946824d448f9f35583d27043ce0 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.760768   431 tablet_replica.cc:333] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.761307   431 raft_consensus.cc:2243] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.761736   431 raft_consensus.cc:2272] T e2a453a38c674d408aba9878f69bb388 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.763662   431 tablet_replica.cc:333] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.764282   431 raft_consensus.cc:2243] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.764707   431 raft_consensus.cc:2272] T 48c199431f4f4c2888707f6e2c664769 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.766661   431 tablet_replica.cc:333] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.767315   431 raft_consensus.cc:2243] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.767776   431 raft_consensus.cc:2272] T 1f5aff08160140138d11b32a4103c057 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.769537   431 tablet_replica.cc:333] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.770025   431 raft_consensus.cc:2243] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.770448   431 raft_consensus.cc:2272] T a80b8863a4914dfa96691fd10ef07985 P ec424be61499475db7217e8842759609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.772374   431 tablet_replica.cc:333] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.772897   431 raft_consensus.cc:2243] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.773319   431 raft_consensus.cc:2272] T 88b7730480fe433981d7e9201128732e P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.775228   431 tablet_replica.cc:333] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.775738   431 raft_consensus.cc:2243] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.776161   431 raft_consensus.cc:2272] T fca0492e8d6b4f9d8222c92a0e604901 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.778324   431 tablet_replica.cc:333] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.778918   431 raft_consensus.cc:2243] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.779605   431 raft_consensus.cc:2272] T c616781e3e9d4730884eff5393860171 P ec424be61499475db7217e8842759609 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.782320   431 tablet_replica.cc:333] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.782898   431 raft_consensus.cc:2243] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.783907   431 raft_consensus.cc:2272] T 3966b43f418e499e9e0b614f4d681720 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.786464   431 tablet_replica.cc:333] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.787045   431 raft_consensus.cc:2243] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.787590   431 raft_consensus.cc:2272] T 884a930630a24604b59d2be5d7f21ada P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.787845 10844 consensus_peers.cc:597] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 -> Peer 5ec16e68839f47c38eefc730712b7c96 (127.0.107.193:43801): Couldn't send request to peer 5ec16e68839f47c38eefc730712b7c96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.789872   431 tablet_replica.cc:333] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.790539   431 raft_consensus.cc:2243] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.791093   431 raft_consensus.cc:2272] T 4ede29f0e5414131b44056468158fd15 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.793072   431 tablet_replica.cc:333] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.793581   431 raft_consensus.cc:2243] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.794006   431 raft_consensus.cc:2272] T 2b2f27d656f941818ccea9cbfb6dc533 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.795989   431 tablet_replica.cc:333] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.796531   431 raft_consensus.cc:2243] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.797025   431 raft_consensus.cc:2272] T 09c9bb6fbe7849b19c4618982ffec63f P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.799023   431 tablet_replica.cc:333] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.799540   431 raft_consensus.cc:2243] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.800283   431 raft_consensus.cc:2272] T 97bf4a1578b245d0b12586d8313c428c P ec424be61499475db7217e8842759609 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.803046   431 tablet_replica.cc:333] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.803541   431 raft_consensus.cc:2243] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.803975   431 raft_consensus.cc:2272] T 0ba95b0ae3a44536bf292beca934fffe P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.806116   431 tablet_replica.cc:333] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.806581   431 raft_consensus.cc:2243] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.807264   431 raft_consensus.cc:2272] T fcbaf056b5744e1f9ee2190fc6a8a714 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.809095   431 tablet_replica.cc:333] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.809612   431 raft_consensus.cc:2243] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.810037   431 raft_consensus.cc:2272] T 81a44e0477fe43b0bee6903f79c01141 P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.812093   431 tablet_replica.cc:333] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609: stopping tablet replica
I20260709 13:03:44.812568   431 raft_consensus.cc:2243] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.813014   431 raft_consensus.cc:2272] T 6b1ee054575f49a382f11ad9b5b7647b P ec424be61499475db7217e8842759609 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:45.849877   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10899)
I20260709 13:03:46.325873   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:46.359017   431 master.cc:562] Master@127.0.107.254:37585 shutting down...
I20260709 13:03:46.380213   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:46.380821   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:46.381148   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P e4c000169d56480486a985486ee02c5c: stopping tablet replica
I20260709 13:03:46.401374   431 master.cc:584] Master@127.0.107.254:37585 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (14473 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26958 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (324275 ms total)
[  PASSED  ] 8 tests.
I20260709 13:03:46.453969   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 398 messages since previous log ~502 seconds ago
I20260709 13:03:46.454217   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 401 messages since previous log ~502 seconds ago
I20260709 13:03:46.454406   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 401 messages since previous log ~502 seconds ago
I20260709 13:03:46.454615   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:03:46.454874   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:03:46.455102   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~202 seconds ago
I20260709 13:03:46.455297   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~202 seconds ago
I20260709 13:03:46.455493   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~149 seconds ago
I20260709 13:03:46.455754   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~2 seconds ago
I20260709 13:03:46.456063   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~7 seconds ago
